-- Logs begin at Mon 2021-08-23 00:48:43 UTC, end at Mon 2021-08-23 02:12:16 UTC. -- Aug 23 01:20:46.292687 dv-cinder-805529-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 23 01:20:46.299837 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 23 01:20:46.304590 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 23 01:20:46 2021] *** Aug 23 01:20:46.304590 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 01:20:46.304590 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 01:20:46.304590 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: nodename: dv-cinder-805529-1-iscsi Aug 23 01:20:46.304590 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: machine: x86_64 Aug 23 01:20:46.304590 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: clock source: unix Aug 23 01:20:46.304590 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: pcre jit disabled Aug 23 01:20:46.304590 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: detected number of CPU cores: 4 Aug 23 01:20:46.304590 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: current working directory: / Aug 23 01:20:46.304590 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: detected binary path: /usr/bin/uwsgi-core Aug 23 01:20:46.304590 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: your processes number limit is 47680 Aug 23 01:20:46.304590 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: your memory page size is 4096 bytes Aug 23 01:20:46.304590 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: detected max file descriptor number: 2048 Aug 23 01:20:46.304590 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: lock engine: pthread robust mutexes Aug 23 01:20:46.304590 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: thunder lock: enabled Aug 23 01:20:46.304590 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 23 01:20:46.304590 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 23 01:20:46.344293 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: Python main interpreter initialized at 0x55e512dcd9c0 Aug 23 01:20:46.344293 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: python threads support enabled Aug 23 01:20:46.344293 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: your server socket listen backlog is limited to 100 connections Aug 23 01:20:46.344293 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: your mercy for graceful operations on workers is 90 seconds Aug 23 01:20:46.344710 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 01:20:46.344814 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: *** Operational MODE: preforking *** Aug 23 01:20:46.345083 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: *** uWSGI is running in multiple interpreter mode *** Aug 23 01:20:46.345083 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: spawned uWSGI master process (pid: 60162) Aug 23 01:20:46.345300 dv-cinder-805529-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 23 01:20:46.345849 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: spawned uWSGI worker 1 (pid: 60175, cores: 1) Aug 23 01:20:46.346183 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: spawned uWSGI worker 2 (pid: 60176, cores: 1) Aug 23 01:20:46.346401 dv-cinder-805529-1-iscsi devstack@keystone.service[60162]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 01:20:49.162762 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2567}} Aug 23 01:20:49.163350 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2568}} Aug 23 01:20:49.163350 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] command line args: [] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2569}} Aug 23 01:20:49.163533 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2567}} Aug 23 01:20:49.163980 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2570}} Aug 23 01:20:49.163980 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ================================================================================ {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2572}} Aug 23 01:20:49.164138 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2568}} Aug 23 01:20:49.164217 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] admin_token = **** {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.164293 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] command line args: [] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2569}} Aug 23 01:20:49.164364 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] config_dir = [] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.164445 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2570}} Aug 23 01:20:49.164531 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.164747 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ================================================================================ {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2572}} Aug 23 01:20:49.164838 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] config_source = [] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.164838 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] debug = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.164964 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] admin_token = **** {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.165044 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.166195 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] config_dir = [] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.166268 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.166327 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.166389 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] insecure_debug = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.166458 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] config_source = [] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.166458 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] debug = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.166567 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.166623 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.166706 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.166776 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.166835 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] list_limit = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.166890 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] insecure_debug = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.166945 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] log_config_append = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.166945 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.167051 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.167118 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] log_dir = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.167175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.167237 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] log_file = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.167298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] list_limit = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.167359 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.167496 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] log_config_append = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.167557 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.167619 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.167619 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] log_dir = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.167726 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.167783 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] log_file = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.167845 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.167910 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.167972 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.167972 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.168080 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.168263 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.168339 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.168447 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.168517 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.168704 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.168787 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.168914 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.168997 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.169126 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.169220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.169371 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.169475 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.169604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.169685 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.169825 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.169907 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] notification_format = cadf {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.170056 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.170138 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.170291 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.170536 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.170618 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.170734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] publish_errors = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.170809 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] notification_format = cadf {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.170966 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.171083 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.171200 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.171376 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.171519 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.171608 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.171706 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] publish_errors = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.171837 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.171955 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.172068 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] standard_threads = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.172157 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.172296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] strict_password_check = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.172379 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.172535 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.172686 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.172784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] use_eventlog = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.172877 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.172974 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] use_journal = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.173085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] standard_threads = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.173206 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] use_json = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.173206 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] use_stderr = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.173387 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] strict_password_check = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.173481 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] use_syslog = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.173574 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.173667 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] watch_log_file = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.173791 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] use_eventlog = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.173872 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.173943 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] use_journal = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.174062 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] use_json = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.174135 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.174210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] use_stderr = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.174287 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.174363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] use_syslog = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.174519 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.174631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] watch_log_file = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2580}} Aug 23 01:20:49.174767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.174846 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.175003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.175081 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.175250 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.175328 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.175482 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.175565 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.175728 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.175813 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.175973 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.176050 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.176219 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.176298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.176450 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.176537 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.176734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.176826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.176972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.177652 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.177793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.177885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.178025 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.178106 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.178258 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.178337 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.178506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.178597 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.178755 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.178833 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.178985 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.179062 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.179220 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.179306 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.179452 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.179528 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.179688 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.179765 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.179917 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.180006 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.180146 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.180229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.180374 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.180451 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.180634 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.180727 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.180866 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.180943 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.181098 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.181175 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.181349 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.181438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.181580 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.181658 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.181815 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.181894 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.182047 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.182137 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.182282 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.182366 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.182514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.182598 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.182749 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.182834 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.182983 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.183067 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.183217 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.183295 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.183450 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.183529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.183686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.183767 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.183919 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.184001 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.184152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.184239 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.184382 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.184467 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.184641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.184722 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.184879 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.184964 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.185113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.185192 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.185340 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.185418 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.185587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.185664 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.185820 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.185943 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.186051 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.186134 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.186284 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.186375 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.186515 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.186611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.186776 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.186859 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.187005 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.187093 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.187250 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.187327 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.187484 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.187561 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.187727 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] cache.enabled = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.187812 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.187962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.188039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.188195 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.188279 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.188428 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.188517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.188684 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.188762 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] cache.enabled = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.188917 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.189004 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.189174 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.189262 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.189410 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.189489 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.189644 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.189722 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.189872 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.189956 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.190100 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.190185 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.190328 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.190413 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.190560 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.190649 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.190787 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.190871 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.191018 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.191107 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.191249 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.191336 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.191485 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.191565 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.191716 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.191794 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.191972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.192058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.192205 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.192285 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.192449 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.192525 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.192728 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.192807 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] auth.external = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.192961 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] auth.mapped = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.193040 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.193228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.193304 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.193467 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.193544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.193699 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] auth.password = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.193777 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] auth.external = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.193926 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] auth.mapped = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.194003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] auth.token = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.194159 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.194235 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.194389 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] catalog.caching = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.194469 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.194631 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.194709 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] auth.password = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.194860 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.194945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] auth.token = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.195103 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.195182 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.195335 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] catalog.caching = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.195411 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.195561 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.195646 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.195794 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] credential.caching = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.195877 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.196039 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] credential.driver = sql {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.196122 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.196289 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.196443 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.196519 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.196618 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.196786 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.196865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] credential.caching = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.197026 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.197112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] credential.driver = sql {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.197257 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.197335 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.197501 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.197579 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.197751 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.197837 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.197990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.198068 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.198222 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.198299 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.198470 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.198556 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.198725 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.198809 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.198969 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.199048 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.199220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.199305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.199476 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.199554 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.199709 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] federation.caching = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.199787 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.199943 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.200032 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.200186 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] federation.driver = sql {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.200264 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.200429 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.200513 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.200682 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.200772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] federation.caching = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.200927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.201006 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.201167 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.201271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] federation.driver = sql {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.201419 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.201500 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.201648 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.201733 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.201893 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.201972 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.202125 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.202202 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.202368 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.202454 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.202600 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.202678 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] identity.caching = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.202843 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.202920 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.203080 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.203166 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.203316 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.203430 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.203547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.203626 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] identity.caching = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.203825 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.203911 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] identity.driver = sql {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.204080 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.204160 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.204315 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.204394 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.204549 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.204657 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.204849 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.204927 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] identity.driver = sql {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.205081 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.205159 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.205312 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.205399 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.205542 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.205620 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.205785 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.205862 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.206032 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.206111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.206279 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.206357 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.206535 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.206614 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.206782 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.206863 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.207029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.207107 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.207275 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.207352 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.207512 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.207598 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.207743 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.207822 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.207976 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.208054 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.208207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.208287 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.208462 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.208542 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.208725 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.208805 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.208964 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.209044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.209211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.209290 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.209442 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.209520 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.209681 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.209760 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.209945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.210023 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.210174 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.210252 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.210417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.210496 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.210660 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.210738 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.210890 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.210968 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.211127 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.211206 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.211355 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.password = **** {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.211438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.211589 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.211668 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.211822 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.211907 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.212056 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.212140 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.212288 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.password = **** {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.212366 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.212509 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.212601 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.212775 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.212856 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.213017 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.213095 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.213245 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.213324 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.213476 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.213555 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.213723 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.213801 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.213969 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.214051 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.214201 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.214279 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.214432 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.214517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.214659 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.214738 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.214887 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.214964 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.215122 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.215202 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.215358 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.215437 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.215593 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.215673 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.215823 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.215901 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.216062 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.216142 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.216304 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.216381 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.216536 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.216633 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.216787 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.216868 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.217021 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.217099 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.217251 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.217329 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.217484 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.217563 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.217711 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.217789 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.217946 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.218033 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.218179 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.218258 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.218414 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.218494 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.218642 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.218730 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.218885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.218969 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.219112 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.219190 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.219354 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.219440 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.219588 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.219666 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.219821 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.219901 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.220046 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.220131 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.220275 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.220352 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.220517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.220647 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.220789 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.220881 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.221021 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.221100 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.221256 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.221334 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] policy.driver = sql {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.221493 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.221579 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.221735 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.221814 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.221969 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.222053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.222197 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] receipt.caching = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.222283 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] policy.driver = sql {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.222430 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.222509 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.222671 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.222749 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.222908 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.222995 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.223135 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.223213 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] receipt.caching = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.223367 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.223444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.223602 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] resource.caching = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.223687 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.223841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.224418 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.224616 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.224699 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] resource.driver = sql {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.225105 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.225196 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.225355 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.225434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] resource.caching = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.225601 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.225679 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.225835 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] revoke.caching = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.225920 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] resource.driver = sql {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.226071 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.226151 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.226304 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.226382 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.226538 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] role.cache_time = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.226624 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.226770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] role.caching = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.226849 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] revoke.caching = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.227014 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] role.driver = sql {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.227092 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.227242 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] role.list_limit = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.227328 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.227488 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.227567 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] role.cache_time = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.227719 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] role.caching = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.227796 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.227966 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] role.driver = sql {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.228053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.228198 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] role.list_limit = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.228278 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.228445 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.228523 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.228715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.228866 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.228991 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.229112 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.229236 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.229358 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.229480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.229609 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.229731 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.229853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.229974 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.230096 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.230226 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.230351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.230482 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.230604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.230604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.230833 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.230963 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.231085 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.231206 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.231329 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.231451 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.231572 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.231702 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.231823 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.231946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.232076 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.232198 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.232321 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.232452 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.232624 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.232747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.232874 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.232999 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.233125 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.233280 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.233364 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.233442 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.233514 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.233585 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.233655 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.233739 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.233845 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.233924 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.234077 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.234156 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.234309 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.234395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.234541 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.234620 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.234821 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.234900 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] token.cache_time = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.235053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] token.caching = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.235138 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.235288 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.235366 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.235536 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] token.provider = fernet {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.235615 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.235779 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.235971 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.236054 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] token.cache_time = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.236125 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.236220 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] token.caching = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.236298 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.236459 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.236539 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.236727 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.236805 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] token.provider = fernet {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.236963 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.237040 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.237207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] trust.driver = sql {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.237287 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.237440 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.237518 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.237686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.237764 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.237917 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.238000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.238163 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.238241 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.238409 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] trust.driver = sql {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.238486 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.238634 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.238714 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.238870 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.238948 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.239109 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.239188 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.239356 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.239439 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.connection = **** {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.239650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.239734 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.239887 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.239965 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.240130 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.240210 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.240364 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.240441 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.240618 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.240701 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.connection = **** {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.240855 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.240936 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.241088 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.241168 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.241319 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.241397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.241560 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.241640 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.241804 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.241884 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.242043 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.242121 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.242274 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.242354 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.242519 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.242597 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.242751 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.242830 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.242992 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.243071 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.243218 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.243295 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.243455 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.243533 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.243686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.243766 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.244092 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=60175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 01:20:49.244172 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.244172 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.244396 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.244668 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.244904 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2587}} Aug 23 01:20:49.245073 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=60176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 01:20:49.272684 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.272908 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.273021 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.273121 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.273253 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.273479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.282454 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.282904 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.310852 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.311084 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.311421 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.311653 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.365975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.366538 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.415957 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.416192 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.417266 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.417506 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.481261 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.481486 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.481575 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.481709 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.481814 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.481929 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.482019 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.482146 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.482237 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.482359 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.482441 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.482579 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.507395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.507632 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.507853 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.507942 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.508073 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.508159 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.508290 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.508377 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.508505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.508608 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.508751 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.508853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.508969 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.509181 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.519877 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.520253 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.532999 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.533225 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.533444 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.533593 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.533734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.533859 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.533994 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.534134 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.534264 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.534395 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.534523 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=60175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.534661 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.534661 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.534903 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=60176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 01:20:49.551563 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.551770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 01:20:49.552126 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.552209 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.552326 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 01:20:49.552408 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 01:20:49.552614 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.552723 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.552910 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.552999 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 01:20:49.553131 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.553213 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.553381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.553537 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.553692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.553944 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.563668 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.563940 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.564209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.564484 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.564587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.564844 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.565112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.565391 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.572469 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=60175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.573510 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=60176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.575618 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=60175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.575892 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.576166 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.576441 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.576673 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=60176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.576757 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.576949 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.577030 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.577225 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.577319 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.577485 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.577566 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.577747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.577828 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.578007 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.578088 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.578263 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.578342 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.578526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.578788 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.579086 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.579347 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.604664 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.605953 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.606205 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=60175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.606477 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.607492 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=60176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.607767 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.611621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=60175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.611896 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.612171 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.613046 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=60176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.613325 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.613602 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.619700 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=60175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.619976 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.621192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=60176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.621471 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.624231 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=60175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.624514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.624818 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.625095 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.625369 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.625639 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.625754 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=60176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.625904 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.626036 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.626168 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.626349 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.626628 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.626898 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.627167 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.627433 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.627700 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.644221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.644493 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.646449 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.646721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.649452 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=60175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.651226 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=60176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.653071 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.653359 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.654908 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.655198 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.658221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=60175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.660110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=60176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.661777 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=60175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.663672 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=60176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.665277 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.665610 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.665857 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.666134 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.666407 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.666689 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.667388 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.667687 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.667982 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.668265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.668556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.668865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.685814 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=60175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.686092 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.686361 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.686617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.688237 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=60176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.688517 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.688806 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.689064 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.694942 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.696610 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.696884 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.697358 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.699011 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.699281 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.699763 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=60175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.700037 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.700319 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.700626 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.700904 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.702242 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=60176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.702535 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.702821 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.703100 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.703385 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.713853 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=60175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.714129 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.714403 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.714675 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.714948 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.715215 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.715493 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.716446 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=60176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.716747 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.717023 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.717296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.717604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.717887 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.718165 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.732983 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=60175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.735770 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=60176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.737168 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=60175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.740542 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=60176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.740881 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.742406 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.743743 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.743962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=60175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.744233 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.744504 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.745360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.746920 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=60176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.747192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.747466 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.822397 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.823775 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.823962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=60175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.825373 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=60176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.827041 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.827326 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.827607 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.827878 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.828470 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.828782 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.829064 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.829336 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.836952 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=60175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.837232 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.837660 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.838393 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=60176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.838704 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.838989 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.845102 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=60175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.845374 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.845646 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.845912 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.846223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.854276 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.854416 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=60176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 01:20:49.854496 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.854569 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.854642 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.854717 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.854793 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.854866 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.854939 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.854939 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.855073 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.855147 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.855220 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.855293 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.855365 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.855365 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.855494 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=60175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.855568 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.855568 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.855568 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.855568 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.855568 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.855568 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=60176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 01:20:49.886342 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x55e512dcd9c0 pid: 60175 (default app) Aug 23 01:20:49.888537 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x55e512dcd9c0 pid: 60176 (default app) Aug 23 01:20:49.889616 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778e433-91a6-4db0-a0f4-43b3785e9354 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:20:49.889900 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778e433-91a6-4db0-a0f4-43b3785e9354 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:20:49.897561 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778e433-91a6-4db0-a0f4-43b3785e9354 None None] PATH_INFO: `/v3` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:20:49.897561 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 792 bytes} [Mon Aug 23 01:20:49 2021] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:20:56.337589 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dde7a3-2183-4c2d-b3af-337149ebaf9e None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:20:56.338102 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dde7a3-2183-4c2d-b3af-337149ebaf9e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:20:56.338284 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dde7a3-2183-4c2d-b3af-337149ebaf9e None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:20:56.342977 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:20:56 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:20:56.348143 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ffd4b-b594-4667-9630-db367f5a49c6 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:20:56.348552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ffd4b-b594-4667-9630-db367f5a49c6 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:20:56.349392 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ffd4b-b594-4667-9630-db367f5a49c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:20:56.389018 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG oslo_db.sqlalchemy.engines [None req-ec6ffd4b-b594-4667-9630-db367f5a49c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=60175) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Aug 23 01:20:56.538647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG passlib.handlers.bcrypt [None req-ec6ffd4b-b594-4667-9630-db367f5a49c6 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=60175) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:567}} Aug 23 01:20:56.539052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG passlib.handlers.bcrypt [None req-ec6ffd4b-b594-4667-9630-db367f5a49c6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=60175) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:382}} Aug 23 01:20:56.600774 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-ec6ffd4b-b594-4667-9630-db367f5a49c6 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:20:56.602270 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-ec6ffd4b-b594-4667-9630-db367f5a49c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:20:56.703679 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:20:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:20:56.748733 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dde7a3-2183-4c2d-b3af-337149ebaf9e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:20:56.791199 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG oslo_db.sqlalchemy.engines [None req-99dde7a3-2183-4c2d-b3af-337149ebaf9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=60176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Aug 23 01:20:56.885806 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dde7a3-2183-4c2d-b3af-337149ebaf9e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:20:56.889940 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7e07a-86b6-41d7-a740-76beb2f92c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:20:56.890535 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7e07a-86b6-41d7-a740-76beb2f92c55 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:20:56.890827 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7e07a-86b6-41d7-a740-76beb2f92c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:20:56.891109 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7e07a-86b6-41d7-a740-76beb2f92c55 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:20:56.900028 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7e07a-86b6-41d7-a740-76beb2f92c55 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:20:56.931184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9ea7e07a-86b6-41d7-a740-76beb2f92c55 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 01:20:56.931532 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7e07a-86b6-41d7-a740-76beb2f92c55 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:20:56.940362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:20:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:20:56.946865 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ffd4b-b594-4667-9630-db367f5a49c6 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:20:56.957985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ffd4b-b594-4667-9630-db367f5a49c6 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:20:56.962676 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8ef6c-8a85-489c-9e36-2d956a869715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:20:56.963506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8ef6c-8a85-489c-9e36-2d956a869715 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:20:56.963795 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8ef6c-8a85-489c-9e36-2d956a869715 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:20:56.964074 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8ef6c-8a85-489c-9e36-2d956a869715 admin admin] PATH_INFO: `/v3/projects/4f6bd6480e9c4a609f8c029a43846e42` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:20:56.965348 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8ef6c-8a85-489c-9e36-2d956a869715 admin admin] RBAC: Authorizing `identity:get_project(project_id=4f6bd6480e9c4a609f8c029a43846e42)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:20:56.997319 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.common.rbac_enforcer.enforcer [None req-52c8ef6c-8a85-489c-9e36-2d956a869715 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 01:20:56.997656 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8ef6c-8a85-489c-9e36-2d956a869715 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:20:57.002160 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:20:56 2021] GET /identity/v3/projects/4f6bd6480e9c4a609f8c029a43846e42 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:20:58.928263 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4049c8-bd62-4579-a2fa-104cf06319c5 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:20:58.928786 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4049c8-bd62-4579-a2fa-104cf06319c5 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:20:58.928870 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4049c8-bd62-4579-a2fa-104cf06319c5 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:20:58.933254 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:20:58 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 01:20:58.938436 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb15982-80cc-4290-b81a-1d8822df0c57 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:20:58.938793 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb15982-80cc-4290-b81a-1d8822df0c57 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:20:58.939008 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb15982-80cc-4290-b81a-1d8822df0c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:20:58.962468 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-feb15982-80cc-4290-b81a-1d8822df0c57 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:20:58.963930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-feb15982-80cc-4290-b81a-1d8822df0c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:20:58.970814 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:20:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:20:58.992283 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4049c8-bd62-4579-a2fa-104cf06319c5 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:20:59.003468 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4049c8-bd62-4579-a2fa-104cf06319c5 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:20:59.007688 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb72387-c0a1-4dec-b425-907ca220c995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:20:59.008245 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb72387-c0a1-4dec-b425-907ca220c995 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:20:59.008532 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb72387-c0a1-4dec-b425-907ca220c995 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:20:59.008849 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb72387-c0a1-4dec-b425-907ca220c995 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:20:59.016455 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb72387-c0a1-4dec-b425-907ca220c995 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:20:59.043554 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb72387-c0a1-4dec-b425-907ca220c995 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:20:59.051749 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:20:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:20:59.057436 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb15982-80cc-4290-b81a-1d8822df0c57 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:20:59.065886 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb15982-80cc-4290-b81a-1d8822df0c57 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:20:59.069861 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70116f4-3e50-4556-aa2a-cf82fa073af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:20:59.070637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70116f4-3e50-4556-aa2a-cf82fa073af9 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:20:59.070927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70116f4-3e50-4556-aa2a-cf82fa073af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:20:59.071209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70116f4-3e50-4556-aa2a-cf82fa073af9 admin admin] PATH_INFO: `/v3/users/f126ecc3e0554a38839d919cf3fec6e7` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:20:59.072427 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70116f4-3e50-4556-aa2a-cf82fa073af9 admin admin] RBAC: Authorizing `identity:get_user(user_id=f126ecc3e0554a38839d919cf3fec6e7)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:20:59.100038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70116f4-3e50-4556-aa2a-cf82fa073af9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:20:59.101455 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:20:59 2021] GET /identity/v3/users/f126ecc3e0554a38839d919cf3fec6e7 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:01.046685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb08ec-21d2-446d-8879-9bebd3a133f2 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:01.047224 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb08ec-21d2-446d-8879-9bebd3a133f2 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:01.047313 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb08ec-21d2-446d-8879-9bebd3a133f2 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:01.048949 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:01.054550 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6ed35-8297-4365-8872-9dc4ddcf9254 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:01.054934 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6ed35-8297-4365-8872-9dc4ddcf9254 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:01.055118 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6ed35-8297-4365-8872-9dc4ddcf9254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:01.077067 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-65b6ed35-8297-4365-8872-9dc4ddcf9254 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:01.078196 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-65b6ed35-8297-4365-8872-9dc4ddcf9254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:01.084744 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 6/11] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:21:01.106850 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb08ec-21d2-446d-8879-9bebd3a133f2 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:01.118775 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb08ec-21d2-446d-8879-9bebd3a133f2 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:01.122554 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268d67c-b687-4080-8e2b-73685ab18692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:01.123257 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268d67c-b687-4080-8e2b-73685ab18692 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:01.123546 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268d67c-b687-4080-8e2b-73685ab18692 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:01.123828 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268d67c-b687-4080-8e2b-73685ab18692 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:01.136260 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268d67c-b687-4080-8e2b-73685ab18692 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:21:01.142505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-8268d67c-b687-4080-8e2b-73685ab18692 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:21:01.143591 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 6/12] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:21:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:21:01.148996 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6ed35-8297-4365-8872-9dc4ddcf9254 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:01.157567 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6ed35-8297-4365-8872-9dc4ddcf9254 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:01.162177 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43198e6e-815d-4429-926e-5c7a674a3de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:01.162765 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43198e6e-815d-4429-926e-5c7a674a3de4 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:01.163058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43198e6e-815d-4429-926e-5c7a674a3de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:01.163344 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43198e6e-815d-4429-926e-5c7a674a3de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:01.164058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43198e6e-815d-4429-926e-5c7a674a3de4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:01.164362 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43198e6e-815d-4429-926e-5c7a674a3de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:01.189789 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-43198e6e-815d-4429-926e-5c7a674a3de4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:21:01.189789 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:21:01.189789 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:21:01.190689 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43198e6e-815d-4429-926e-5c7a674a3de4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:01.201846 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 7/13] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:21:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:21:01.206803 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268d67c-b687-4080-8e2b-73685ab18692 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:01.216173 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268d67c-b687-4080-8e2b-73685ab18692 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:01.220077 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da68e5-d2fc-4bd3-b3c5-ccc704af902d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:01.220874 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da68e5-d2fc-4bd3-b3c5-ccc704af902d admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:01.221167 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da68e5-d2fc-4bd3-b3c5-ccc704af902d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:01.221450 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da68e5-d2fc-4bd3-b3c5-ccc704af902d admin admin] PATH_INFO: `/v3/users/f126ecc3e0554a38839d919cf3fec6e7` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:01.222952 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da68e5-d2fc-4bd3-b3c5-ccc704af902d admin admin] RBAC: Authorizing `identity:get_user(user_id=f126ecc3e0554a38839d919cf3fec6e7)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:01.248450 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da68e5-d2fc-4bd3-b3c5-ccc704af902d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:01.249870 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:21:01 2021] GET /identity/v3/users/f126ecc3e0554a38839d919cf3fec6e7 => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:01.255139 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43198e6e-815d-4429-926e-5c7a674a3de4 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:01.264268 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43198e6e-815d-4429-926e-5c7a674a3de4 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:01.268281 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569490f-9d98-4eac-81c0-8b509a73a790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:01.269007 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569490f-9d98-4eac-81c0-8b509a73a790 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:01.269326 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569490f-9d98-4eac-81c0-8b509a73a790 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:01.269610 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569490f-9d98-4eac-81c0-8b509a73a790 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:01.270751 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569490f-9d98-4eac-81c0-8b509a73a790 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:01.295978 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569490f-9d98-4eac-81c0-8b509a73a790 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:01.297413 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:21:01 2021] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:01.302408 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da68e5-d2fc-4bd3-b3c5-ccc704af902d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:01.311210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da68e5-d2fc-4bd3-b3c5-ccc704af902d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:01.315102 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ff619-1dba-4a33-98ea-9246d15eeb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:01.315650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ff619-1dba-4a33-98ea-9246d15eeb4d admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:01.315938 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ff619-1dba-4a33-98ea-9246d15eeb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:01.316222 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ff619-1dba-4a33-98ea-9246d15eeb4d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:01.317016 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ff619-1dba-4a33-98ea-9246d15eeb4d admin admin] RBAC: Adding query filter params (role.id=56d36413cf4047229b6f9d36a3990b0d, scope.domain.id=default, user.id=f126ecc3e0554a38839d919cf3fec6e7) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:01.317808 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ff619-1dba-4a33-98ea-9246d15eeb4d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:01.342878 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-759ff619-1dba-4a33-98ea-9246d15eeb4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:21:01.342878 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:21:01.342878 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:21:01.344036 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ff619-1dba-4a33-98ea-9246d15eeb4d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:01.350836 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 8/16] 10.222.0.20 () {56 vars in 1344 bytes} [Mon Aug 23 01:21:01 2021] GET /identity/v3/role_assignments?user.id=f126ecc3e0554a38839d919cf3fec6e7&scope.domain.id=default&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 233 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:03.250488 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fce59-ea67-4d32-a88d-9791a94fcd35 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:03.251053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fce59-ea67-4d32-a88d-9791a94fcd35 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:03.251053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fce59-ea67-4d32-a88d-9791a94fcd35 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:03.253057 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 9/17] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 01:21:03.258622 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f73b7-4b51-43cf-aa10-e4295b4380d2 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:03.259051 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f73b7-4b51-43cf-aa10-e4295b4380d2 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:03.259195 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f73b7-4b51-43cf-aa10-e4295b4380d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:03.291101 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG passlib.handlers.bcrypt [None req-481f73b7-4b51-43cf-aa10-e4295b4380d2 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=60176) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:567}} Aug 23 01:21:03.291540 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG passlib.handlers.bcrypt [None req-481f73b7-4b51-43cf-aa10-e4295b4380d2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=60176) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:382}} Aug 23 01:21:03.337829 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-481f73b7-4b51-43cf-aa10-e4295b4380d2 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:03.339362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-481f73b7-4b51-43cf-aa10-e4295b4380d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:03.346271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 9/18] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:03.369394 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fce59-ea67-4d32-a88d-9791a94fcd35 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:03.380745 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fce59-ea67-4d32-a88d-9791a94fcd35 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:03.384478 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b5ce7-2714-4ce8-b57e-5105e4be88bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:03.385207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b5ce7-2714-4ce8-b57e-5105e4be88bd admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:03.385495 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b5ce7-2714-4ce8-b57e-5105e4be88bd admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:03.385776 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b5ce7-2714-4ce8-b57e-5105e4be88bd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:03.396673 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b5ce7-2714-4ce8-b57e-5105e4be88bd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:21:03.402949 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-088b5ce7-2714-4ce8-b57e-5105e4be88bd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:21:03.404028 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:21:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:21:03.409450 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f73b7-4b51-43cf-aa10-e4295b4380d2 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:03.418669 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f73b7-4b51-43cf-aa10-e4295b4380d2 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:03.422543 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a635a-8f05-468f-83d7-8ebc03634baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:03.423128 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a635a-8f05-468f-83d7-8ebc03634baf admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:03.423414 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a635a-8f05-468f-83d7-8ebc03634baf admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:03.423696 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a635a-8f05-468f-83d7-8ebc03634baf admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:03.424392 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a635a-8f05-468f-83d7-8ebc03634baf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:03.424722 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a635a-8f05-468f-83d7-8ebc03634baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:03.449187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-b91a635a-8f05-468f-83d7-8ebc03634baf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:21:03.449187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:21:03.449187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:21:03.450078 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a635a-8f05-468f-83d7-8ebc03634baf admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:03.459484 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 10/20] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:21:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:03.464626 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b5ce7-2714-4ce8-b57e-5105e4be88bd admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:03.475184 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b5ce7-2714-4ce8-b57e-5105e4be88bd admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:03.479091 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e8b95-c0e5-48e9-a11b-b64e801350c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:03.479932 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e8b95-c0e5-48e9-a11b-b64e801350c1 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:03.480148 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e8b95-c0e5-48e9-a11b-b64e801350c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:03.480429 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e8b95-c0e5-48e9-a11b-b64e801350c1 admin admin] PATH_INFO: `/v3/users/f126ecc3e0554a38839d919cf3fec6e7` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:03.481536 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e8b95-c0e5-48e9-a11b-b64e801350c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=f126ecc3e0554a38839d919cf3fec6e7)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:03.507059 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e8b95-c0e5-48e9-a11b-b64e801350c1 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:03.508394 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 11/21] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:21:03 2021] GET /identity/v3/users/f126ecc3e0554a38839d919cf3fec6e7 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:03.513546 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a635a-8f05-468f-83d7-8ebc03634baf admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:03.522644 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a635a-8f05-468f-83d7-8ebc03634baf admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:03.526486 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d4a19-9daf-43e9-8b62-7c265e9d9059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:03.527183 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d4a19-9daf-43e9-8b62-7c265e9d9059 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:03.527467 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d4a19-9daf-43e9-8b62-7c265e9d9059 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:03.527746 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d4a19-9daf-43e9-8b62-7c265e9d9059 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:03.528932 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d4a19-9daf-43e9-8b62-7c265e9d9059 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:03.554735 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d4a19-9daf-43e9-8b62-7c265e9d9059 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:03.556095 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 11/22] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:21:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:21:03.561030 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e8b95-c0e5-48e9-a11b-b64e801350c1 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:03.570063 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e8b95-c0e5-48e9-a11b-b64e801350c1 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:03.573965 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a00488-a20a-4f26-8d6c-f127ba2451fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:03.574724 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a00488-a20a-4f26-8d6c-f127ba2451fe admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:03.575011 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a00488-a20a-4f26-8d6c-f127ba2451fe admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:03.575296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a00488-a20a-4f26-8d6c-f127ba2451fe admin admin] PATH_INFO: `/v3/domains/default/users/f126ecc3e0554a38839d919cf3fec6e7/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:03.577049 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a00488-a20a-4f26-8d6c-f127ba2451fe admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f126ecc3e0554a38839d919cf3fec6e7, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:03.601812 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-c0a00488-a20a-4f26-8d6c-f127ba2451fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:21:03.601812 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:21:03.601812 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:21:03.603747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a00488-a20a-4f26-8d6c-f127ba2451fe admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:03.876249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 12/23] 10.222.0.20 () {58 vars in 1383 bytes} [Mon Aug 23 01:21:03 2021] PUT /identity/v3/domains/default/users/f126ecc3e0554a38839d919cf3fec6e7/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:21:05.780520 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa13bb4-9cc3-435f-bd93-6b72a7e8f790 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:05.781024 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa13bb4-9cc3-435f-bd93-6b72a7e8f790 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:05.781024 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa13bb4-9cc3-435f-bd93-6b72a7e8f790 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:05.782670 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:05.788555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f60566-3236-4499-b3cd-f3fba26b7eff None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:05.788929 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f60566-3236-4499-b3cd-f3fba26b7eff None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:05.789173 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f60566-3236-4499-b3cd-f3fba26b7eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:05.812243 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-79f60566-3236-4499-b3cd-f3fba26b7eff None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:05.813724 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-79f60566-3236-4499-b3cd-f3fba26b7eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:05.875960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 13/25] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:05.898630 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa13bb4-9cc3-435f-bd93-6b72a7e8f790 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:05.909962 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa13bb4-9cc3-435f-bd93-6b72a7e8f790 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:05.913769 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228effa-53a1-4307-8521-eb836e57f2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:05.914472 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228effa-53a1-4307-8521-eb836e57f2fa admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:05.914761 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228effa-53a1-4307-8521-eb836e57f2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:05.915044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228effa-53a1-4307-8521-eb836e57f2fa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:05.926671 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228effa-53a1-4307-8521-eb836e57f2fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:21:05.932880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-2228effa-53a1-4307-8521-eb836e57f2fa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:21:05.934128 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 13/26] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:21:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:21:05.939498 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f60566-3236-4499-b3cd-f3fba26b7eff None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:05.948432 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f60566-3236-4499-b3cd-f3fba26b7eff None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:05.952345 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af7d06-4cdd-4789-aff7-8bdc8db7e131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:05.952957 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af7d06-4cdd-4789-aff7-8bdc8db7e131 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:05.953250 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af7d06-4cdd-4789-aff7-8bdc8db7e131 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:05.953531 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af7d06-4cdd-4789-aff7-8bdc8db7e131 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:05.954231 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af7d06-4cdd-4789-aff7-8bdc8db7e131 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:05.954529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af7d06-4cdd-4789-aff7-8bdc8db7e131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:05.980510 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af7d06-4cdd-4789-aff7-8bdc8db7e131 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:05.992174 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 14/27] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:21:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:05.997170 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228effa-53a1-4307-8521-eb836e57f2fa admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:06.006718 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228effa-53a1-4307-8521-eb836e57f2fa admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:06.010551 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45501e-734f-48ad-8c57-28bd1e5f4d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:06.011308 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45501e-734f-48ad-8c57-28bd1e5f4d04 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:06.011597 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45501e-734f-48ad-8c57-28bd1e5f4d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:06.011874 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45501e-734f-48ad-8c57-28bd1e5f4d04 admin admin] PATH_INFO: `/v3/users/f126ecc3e0554a38839d919cf3fec6e7` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:06.012976 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45501e-734f-48ad-8c57-28bd1e5f4d04 admin admin] RBAC: Authorizing `identity:get_user(user_id=f126ecc3e0554a38839d919cf3fec6e7)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:06.037650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45501e-734f-48ad-8c57-28bd1e5f4d04 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:06.038990 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 14/28] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:21:05 2021] GET /identity/v3/users/f126ecc3e0554a38839d919cf3fec6e7 => generated 247 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:06.043503 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af7d06-4cdd-4789-aff7-8bdc8db7e131 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:06.052784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af7d06-4cdd-4789-aff7-8bdc8db7e131 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:06.056642 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9f3d2-05c0-4ad9-b00e-e23826777d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:06.057335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9f3d2-05c0-4ad9-b00e-e23826777d3d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:06.057623 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9f3d2-05c0-4ad9-b00e-e23826777d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:06.057906 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9f3d2-05c0-4ad9-b00e-e23826777d3d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:06.059108 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9f3d2-05c0-4ad9-b00e-e23826777d3d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:06.084331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9f3d2-05c0-4ad9-b00e-e23826777d3d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:06.085720 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 15/29] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:21:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:06.090766 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45501e-734f-48ad-8c57-28bd1e5f4d04 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:06.099902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45501e-734f-48ad-8c57-28bd1e5f4d04 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:06.103779 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513e324-dc6b-446e-adbb-ae8229b8a1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:06.104323 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513e324-dc6b-446e-adbb-ae8229b8a1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:06.104647 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513e324-dc6b-446e-adbb-ae8229b8a1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:06.104935 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513e324-dc6b-446e-adbb-ae8229b8a1d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:06.105685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513e324-dc6b-446e-adbb-ae8229b8a1d2 admin admin] RBAC: Adding query filter params (role.id=56d36413cf4047229b6f9d36a3990b0d, scope.domain.id=default, user.id=f126ecc3e0554a38839d919cf3fec6e7) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:06.105988 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513e324-dc6b-446e-adbb-ae8229b8a1d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:06.131815 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513e324-dc6b-446e-adbb-ae8229b8a1d2 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:06.137308 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 15/30] 10.222.0.20 () {56 vars in 1344 bytes} [Mon Aug 23 01:21:06 2021] GET /identity/v3/role_assignments?user.id=f126ecc3e0554a38839d919cf3fec6e7&scope.domain.id=default&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 530 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:08.123865 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63709-68e4-4fed-92af-0e5803a53925 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:08.124399 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63709-68e4-4fed-92af-0e5803a53925 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:08.124495 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63709-68e4-4fed-92af-0e5803a53925 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:08.126143 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 16/31] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:08.131817 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dd087-f45c-4b33-bdd9-161b83c73544 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:08.132238 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dd087-f45c-4b33-bdd9-161b83c73544 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:08.132386 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dd087-f45c-4b33-bdd9-161b83c73544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:08.155045 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-6b6dd087-f45c-4b33-bdd9-161b83c73544 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:08.156206 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-6b6dd087-f45c-4b33-bdd9-161b83c73544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:08.162761 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 16/32] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:08.183666 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b63709-68e4-4fed-92af-0e5803a53925 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:08.195576 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b63709-68e4-4fed-92af-0e5803a53925 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:08.199341 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b700095-4362-4d8e-96ac-afe00d8317a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:08.199899 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b700095-4362-4d8e-96ac-afe00d8317a0 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:08.200190 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b700095-4362-4d8e-96ac-afe00d8317a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:08.200474 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b700095-4362-4d8e-96ac-afe00d8317a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:08.207948 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b700095-4362-4d8e-96ac-afe00d8317a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:08.233338 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b700095-4362-4d8e-96ac-afe00d8317a0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:08.242094 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 17/33] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:21:08 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:21:08.247276 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dd087-f45c-4b33-bdd9-161b83c73544 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:08.255531 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dd087-f45c-4b33-bdd9-161b83c73544 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:08.259568 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65988239-8a3c-478d-8440-97782ddb960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:08.260275 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65988239-8a3c-478d-8440-97782ddb960a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:08.260579 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65988239-8a3c-478d-8440-97782ddb960a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:08.260871 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65988239-8a3c-478d-8440-97782ddb960a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:08.261957 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65988239-8a3c-478d-8440-97782ddb960a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:08.287737 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65988239-8a3c-478d-8440-97782ddb960a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:08.289145 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 17/34] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:21:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:21:10.231769 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526f8e9-a21b-4b94-9430-2bb06ea0fbed None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:10.232284 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526f8e9-a21b-4b94-9430-2bb06ea0fbed None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:10.232385 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526f8e9-a21b-4b94-9430-2bb06ea0fbed None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:10.234051 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 18/35] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:10.239523 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0f004-4837-4836-a1a9-24e47b730abc None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:10.239885 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0f004-4837-4836-a1a9-24e47b730abc None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:10.240090 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0f004-4837-4836-a1a9-24e47b730abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:10.261981 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-dfd0f004-4837-4836-a1a9-24e47b730abc None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:10.263102 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-dfd0f004-4837-4836-a1a9-24e47b730abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:10.269973 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 18/36] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:10.295118 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526f8e9-a21b-4b94-9430-2bb06ea0fbed None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:10.307246 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526f8e9-a21b-4b94-9430-2bb06ea0fbed None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:10.311041 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd152294-0fbc-4af9-a6a4-4ed47c3741e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:10.311752 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd152294-0fbc-4af9-a6a4-4ed47c3741e4 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:10.312047 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd152294-0fbc-4af9-a6a4-4ed47c3741e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:10.312332 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd152294-0fbc-4af9-a6a4-4ed47c3741e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:10.324093 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd152294-0fbc-4af9-a6a4-4ed47c3741e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:10.349581 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd152294-0fbc-4af9-a6a4-4ed47c3741e4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:10.366502 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-dd152294-0fbc-4af9-a6a4-4ed47c3741e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:21:10.367555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 19/37] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:21:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:21:10.372994 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0f004-4837-4836-a1a9-24e47b730abc None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:10.381416 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0f004-4837-4836-a1a9-24e47b730abc None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:10.385329 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de97a7-490b-4668-a305-7552bc3c0ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:10.385911 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de97a7-490b-4668-a305-7552bc3c0ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:10.386199 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de97a7-490b-4668-a305-7552bc3c0ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:10.386479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de97a7-490b-4668-a305-7552bc3c0ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:10.387152 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de97a7-490b-4668-a305-7552bc3c0ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:10.387449 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de97a7-490b-4668-a305-7552bc3c0ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:10.411771 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-38de97a7-490b-4668-a305-7552bc3c0ee5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:21:10.411771 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:21:10.411771 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:21:10.412692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de97a7-490b-4668-a305-7552bc3c0ee5 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:10.428650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 19/38] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:21:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:10.434053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd152294-0fbc-4af9-a6a4-4ed47c3741e4 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:10.443223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd152294-0fbc-4af9-a6a4-4ed47c3741e4 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:10.447189 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21727f56-42a2-4888-9496-33f97a740958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:10.447768 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21727f56-42a2-4888-9496-33f97a740958 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:10.448061 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21727f56-42a2-4888-9496-33f97a740958 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:10.448347 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21727f56-42a2-4888-9496-33f97a740958 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:10.449042 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21727f56-42a2-4888-9496-33f97a740958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:10.473563 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-21727f56-42a2-4888-9496-33f97a740958 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:21:10.473563 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:21:10.473563 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:21:10.475022 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21727f56-42a2-4888-9496-33f97a740958 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:10.604251 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 20/39] 10.222.0.20 () {60 vars in 1163 bytes} [Mon Aug 23 01:21:10 2021] POST /identity/v3/projects => generated 301 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:21:12.525826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56ac1e-d138-4be2-8c1c-e499ec73d7ef None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:12.526318 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56ac1e-d138-4be2-8c1c-e499ec73d7ef None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:12.526425 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56ac1e-d138-4be2-8c1c-e499ec73d7ef None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:12.528045 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 20/40] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:12.533183 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f46f0-8236-473d-8f36-b674ecad3e49 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:12.533588 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f46f0-8236-473d-8f36-b674ecad3e49 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:12.533771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f46f0-8236-473d-8f36-b674ecad3e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:12.555491 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-d61f46f0-8236-473d-8f36-b674ecad3e49 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:12.556678 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d61f46f0-8236-473d-8f36-b674ecad3e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:12.619609 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 21/41] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:21:12.641298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56ac1e-d138-4be2-8c1c-e499ec73d7ef None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:12.653189 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56ac1e-d138-4be2-8c1c-e499ec73d7ef None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:12.656976 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf542dca-c782-4f47-8d80-7e281cbc3373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:12.657552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf542dca-c782-4f47-8d80-7e281cbc3373 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:12.657843 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf542dca-c782-4f47-8d80-7e281cbc3373 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:12.658125 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf542dca-c782-4f47-8d80-7e281cbc3373 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:12.658821 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf542dca-c782-4f47-8d80-7e281cbc3373 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:12.682850 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-bf542dca-c782-4f47-8d80-7e281cbc3373 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:21:12.682850 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:21:12.682850 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:21:12.683693 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf542dca-c782-4f47-8d80-7e281cbc3373 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:12.948890 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 21/42] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:21:12 2021] POST /identity/v3/roles => generated 219 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:21:14.886648 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea39c1-0888-431c-bbaf-972ec929f6cb None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:14.887131 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea39c1-0888-431c-bbaf-972ec929f6cb None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:14.887241 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea39c1-0888-431c-bbaf-972ec929f6cb None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:14.888996 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 22/43] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:14.894439 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b5937-12e9-4dba-8c58-be2529737c37 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:14.895406 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b5937-12e9-4dba-8c58-be2529737c37 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:14.895586 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b5937-12e9-4dba-8c58-be2529737c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:14.918002 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-023b5937-12e9-4dba-8c58-be2529737c37 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:14.919427 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-023b5937-12e9-4dba-8c58-be2529737c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:14.926312 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 22/44] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:14.947929 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea39c1-0888-431c-bbaf-972ec929f6cb None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:14.959838 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea39c1-0888-431c-bbaf-972ec929f6cb None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:14.963660 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584907f-2790-44ab-afe8-d3153f02dac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:14.964240 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584907f-2790-44ab-afe8-d3153f02dac7 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:14.964534 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584907f-2790-44ab-afe8-d3153f02dac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:14.964848 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584907f-2790-44ab-afe8-d3153f02dac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:14.965547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584907f-2790-44ab-afe8-d3153f02dac7 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:14.990427 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-0584907f-2790-44ab-afe8-d3153f02dac7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:21:14.990427 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:21:14.990427 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:21:14.991340 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584907f-2790-44ab-afe8-d3153f02dac7 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:15.099683 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:21:14 2021] POST /identity/v3/roles => generated 225 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:21:17.038460 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d61b52-9247-4cab-ae1e-dfc6d59e7588 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:17.039082 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d61b52-9247-4cab-ae1e-dfc6d59e7588 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:17.039082 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d61b52-9247-4cab-ae1e-dfc6d59e7588 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:17.040744 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 23/46] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:17.045677 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72637068-b177-4ac4-941b-3ea31f124742 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:17.046064 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72637068-b177-4ac4-941b-3ea31f124742 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:17.046254 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72637068-b177-4ac4-941b-3ea31f124742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:17.068746 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-72637068-b177-4ac4-941b-3ea31f124742 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:17.069870 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-72637068-b177-4ac4-941b-3ea31f124742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:17.076447 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 24/47] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:17.097441 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d61b52-9247-4cab-ae1e-dfc6d59e7588 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:17.109539 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d61b52-9247-4cab-ae1e-dfc6d59e7588 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:17.113376 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f739fc-59eb-4bc3-a9b7-a4cb7f3c3224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:17.114013 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f739fc-59eb-4bc3-a9b7-a4cb7f3c3224 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:17.114332 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f739fc-59eb-4bc3-a9b7-a4cb7f3c3224 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:17.114615 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f739fc-59eb-4bc3-a9b7-a4cb7f3c3224 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:17.115314 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f739fc-59eb-4bc3-a9b7-a4cb7f3c3224 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:17.140746 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f739fc-59eb-4bc3-a9b7-a4cb7f3c3224 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:17.213683 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 24/48] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:21:17 2021] POST /identity/v3/roles => generated 223 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:21:19.144880 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b1419-7636-4c6a-b762-e37f37bea62d None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:19.145465 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b1419-7636-4c6a-b762-e37f37bea62d None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:19.145465 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b1419-7636-4c6a-b762-e37f37bea62d None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:19.147135 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 25/49] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:19.152193 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90bf11-5666-417f-9c4e-7f4322b024af None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:19.152552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90bf11-5666-417f-9c4e-7f4322b024af None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:19.152814 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90bf11-5666-417f-9c4e-7f4322b024af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:19.175281 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-8b90bf11-5666-417f-9c4e-7f4322b024af None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:19.177026 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-8b90bf11-5666-417f-9c4e-7f4322b024af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:19.183552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 25/50] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:19.205352 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b1419-7636-4c6a-b762-e37f37bea62d None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:19.216894 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b1419-7636-4c6a-b762-e37f37bea62d None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:19.220795 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4a8f5-31d4-411f-a9d9-c4936a29a94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:19.221500 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4a8f5-31d4-411f-a9d9-c4936a29a94b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:19.221794 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4a8f5-31d4-411f-a9d9-c4936a29a94b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:19.222082 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4a8f5-31d4-411f-a9d9-c4936a29a94b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:19.223642 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4a8f5-31d4-411f-a9d9-c4936a29a94b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:19.249602 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4a8f5-31d4-411f-a9d9-c4936a29a94b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:19.251012 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 26/51] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:21:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:19.256137 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90bf11-5666-417f-9c4e-7f4322b024af None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:19.264415 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90bf11-5666-417f-9c4e-7f4322b024af None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:19.268327 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5a11a-a49f-4059-9d42-9cf899031b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:19.268929 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5a11a-a49f-4059-9d42-9cf899031b73 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:19.269219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5a11a-a49f-4059-9d42-9cf899031b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:19.269500 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5a11a-a49f-4059-9d42-9cf899031b73 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:19.270298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5a11a-a49f-4059-9d42-9cf899031b73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:19.294732 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-c1c5a11a-a49f-4059-9d42-9cf899031b73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:21:19.294732 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:21:19.294732 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:21:19.295912 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5a11a-a49f-4059-9d42-9cf899031b73 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:19.416842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 26/52] 10.222.0.20 () {60 vars in 1163 bytes} [Mon Aug 23 01:21:19 2021] POST /identity/v3/projects => generated 312 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:21:21.356871 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9084a82-efa2-4232-b5bf-28d0e2d0478d None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:21.357405 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9084a82-efa2-4232-b5bf-28d0e2d0478d None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:21.357495 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9084a82-efa2-4232-b5bf-28d0e2d0478d None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:21.359116 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 27/53] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:21.364198 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd494d-e0d2-4880-8aaf-7cd119ab8938 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:21.364625 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd494d-e0d2-4880-8aaf-7cd119ab8938 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:21.364798 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd494d-e0d2-4880-8aaf-7cd119ab8938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:21.386859 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-cfcd494d-e0d2-4880-8aaf-7cd119ab8938 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:21.387980 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-cfcd494d-e0d2-4880-8aaf-7cd119ab8938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:21.452228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 27/54] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:21.475349 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9084a82-efa2-4232-b5bf-28d0e2d0478d None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:21.486840 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9084a82-efa2-4232-b5bf-28d0e2d0478d None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:21.491253 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7412cd9-dfff-481d-b8d4-3aada043096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:21.491962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7412cd9-dfff-481d-b8d4-3aada043096a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:21.492255 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7412cd9-dfff-481d-b8d4-3aada043096a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:21.492542 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7412cd9-dfff-481d-b8d4-3aada043096a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:21.493665 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7412cd9-dfff-481d-b8d4-3aada043096a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:21.518682 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7412cd9-dfff-481d-b8d4-3aada043096a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:21.520130 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:21:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:21.525227 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd494d-e0d2-4880-8aaf-7cd119ab8938 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:21.533580 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd494d-e0d2-4880-8aaf-7cd119ab8938 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:21.537996 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572f149-cdfd-4462-802d-4b7015028aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:21.538570 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572f149-cdfd-4462-802d-4b7015028aeb admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:21.538864 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572f149-cdfd-4462-802d-4b7015028aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:21.539151 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572f149-cdfd-4462-802d-4b7015028aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:21.539806 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572f149-cdfd-4462-802d-4b7015028aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:21.565381 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572f149-cdfd-4462-802d-4b7015028aeb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:21.639290 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 28/56] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Aug 23 01:21:21 2021] POST /identity/v3/projects => generated 298 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:21:23.581448 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782834be-c5bb-4846-bfe4-b3b5dc39f2c0 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:23.582454 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782834be-c5bb-4846-bfe4-b3b5dc39f2c0 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:23.582557 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782834be-c5bb-4846-bfe4-b3b5dc39f2c0 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:23.584212 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 29/57] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:23.589320 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709d01b-858f-4447-bf76-a50df2485961 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:23.589724 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709d01b-858f-4447-bf76-a50df2485961 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:23.589897 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709d01b-858f-4447-bf76-a50df2485961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:23.612519 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-6709d01b-858f-4447-bf76-a50df2485961 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:23.613678 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-6709d01b-858f-4447-bf76-a50df2485961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:23.675384 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 29/58] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:23.698827 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782834be-c5bb-4846-bfe4-b3b5dc39f2c0 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:23.711052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782834be-c5bb-4846-bfe4-b3b5dc39f2c0 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:23.715082 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e33db-ca80-4f00-9a92-b5609395435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:23.715797 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e33db-ca80-4f00-9a92-b5609395435a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:23.716090 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e33db-ca80-4f00-9a92-b5609395435a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:23.716379 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e33db-ca80-4f00-9a92-b5609395435a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:23.717494 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e33db-ca80-4f00-9a92-b5609395435a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:23.742656 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e33db-ca80-4f00-9a92-b5609395435a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:23.744091 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 30/59] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:21:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:21:23.749121 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709d01b-858f-4447-bf76-a50df2485961 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:23.758121 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709d01b-858f-4447-bf76-a50df2485961 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:23.762066 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ca41d-4974-499a-afe8-700fa9ffc4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:23.762656 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ca41d-4974-499a-afe8-700fa9ffc4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:23.762949 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ca41d-4974-499a-afe8-700fa9ffc4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:23.763237 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ca41d-4974-499a-afe8-700fa9ffc4b7 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:23.763891 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ca41d-4974-499a-afe8-700fa9ffc4b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:23.788618 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-ca3ca41d-4974-499a-afe8-700fa9ffc4b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:21:23.788618 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:21:23.788618 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:21:23.789842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ca41d-4974-499a-afe8-700fa9ffc4b7 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:23.895574 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 30/60] 10.222.0.20 () {60 vars in 1154 bytes} [Mon Aug 23 01:21:23 2021] POST /identity/v3/users => generated 275 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:21:25.891114 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658bfcd-f4cd-4d5c-954a-0a176451cc3d None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:25.891627 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658bfcd-f4cd-4d5c-954a-0a176451cc3d None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:25.891718 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658bfcd-f4cd-4d5c-954a-0a176451cc3d None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:25.893421 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 31/61] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:25.899194 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5921d7e-dd65-4613-add9-e8fad7fe94ff None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:25.899630 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5921d7e-dd65-4613-add9-e8fad7fe94ff None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:25.899832 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5921d7e-dd65-4613-add9-e8fad7fe94ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:25.922116 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-d5921d7e-dd65-4613-add9-e8fad7fe94ff None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:25.923246 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-d5921d7e-dd65-4613-add9-e8fad7fe94ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:25.929829 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 31/62] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:25.951627 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658bfcd-f4cd-4d5c-954a-0a176451cc3d None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:25.963639 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658bfcd-f4cd-4d5c-954a-0a176451cc3d None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:25.967523 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9c3c7-25b0-4eb3-a80e-f0422bc652c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:25.968226 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9c3c7-25b0-4eb3-a80e-f0422bc652c5 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:25.968522 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9c3c7-25b0-4eb3-a80e-f0422bc652c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:25.968861 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9c3c7-25b0-4eb3-a80e-f0422bc652c5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:25.980067 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9c3c7-25b0-4eb3-a80e-f0422bc652c5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:21:25.986398 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-7ac9c3c7-25b0-4eb3-a80e-f0422bc652c5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 01:21:25.987459 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 32/63] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:21:25 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:21:25.992758 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5921d7e-dd65-4613-add9-e8fad7fe94ff None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:26.001127 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5921d7e-dd65-4613-add9-e8fad7fe94ff None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:26.005552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8b5e4-9a6e-4de0-9bd1-f0d756437dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:26.006141 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8b5e4-9a6e-4de0-9bd1-f0d756437dfd admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:26.006437 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8b5e4-9a6e-4de0-9bd1-f0d756437dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:26.006727 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8b5e4-9a6e-4de0-9bd1-f0d756437dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:26.007438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8b5e4-9a6e-4de0-9bd1-f0d756437dfd admin admin] RBAC: Adding query filter params (name=member) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:26.007749 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8b5e4-9a6e-4de0-9bd1-f0d756437dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:26.033431 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8b5e4-9a6e-4de0-9bd1-f0d756437dfd admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:26.042529 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 32/64] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Aug 23 01:21:25 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:26.048017 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9c3c7-25b0-4eb3-a80e-f0422bc652c5 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:26.058092 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9c3c7-25b0-4eb3-a80e-f0422bc652c5 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:26.062086 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb702f-87d7-40a1-bff3-4956b7a3a70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:26.062867 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb702f-87d7-40a1-bff3-4956b7a3a70b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:26.063162 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb702f-87d7-40a1-bff3-4956b7a3a70b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:26.063449 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb702f-87d7-40a1-bff3-4956b7a3a70b admin admin] PATH_INFO: `/v3/users/dc2016d1d16043ccbcc1e69278abf4b4` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:26.082012 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb702f-87d7-40a1-bff3-4956b7a3a70b admin admin] RBAC: Authorizing `identity:get_user(user_id=dc2016d1d16043ccbcc1e69278abf4b4)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:26.109148 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb702f-87d7-40a1-bff3-4956b7a3a70b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:26.110606 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 33/65] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:21:26 2021] GET /identity/v3/users/dc2016d1d16043ccbcc1e69278abf4b4 => generated 275 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:26.116246 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8b5e4-9a6e-4de0-9bd1-f0d756437dfd admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:26.125348 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8b5e4-9a6e-4de0-9bd1-f0d756437dfd admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:26.129348 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a16bc3-1b8d-4386-96d4-083bfd56ae54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:26.129913 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a16bc3-1b8d-4386-96d4-083bfd56ae54 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:26.130203 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a16bc3-1b8d-4386-96d4-083bfd56ae54 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:26.130490 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a16bc3-1b8d-4386-96d4-083bfd56ae54 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:26.137959 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a16bc3-1b8d-4386-96d4-083bfd56ae54 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:26.163268 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a16bc3-1b8d-4386-96d4-083bfd56ae54 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:26.171414 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 33/66] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:21:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:21:26.177014 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb702f-87d7-40a1-bff3-4956b7a3a70b admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:26.186038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb702f-87d7-40a1-bff3-4956b7a3a70b admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:26.190080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8c0f6-c466-4a46-a42e-9d384ab2d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:26.190846 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8c0f6-c466-4a46-a42e-9d384ab2d0be admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:26.191161 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8c0f6-c466-4a46-a42e-9d384ab2d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:26.191447 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8c0f6-c466-4a46-a42e-9d384ab2d0be admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:26.192546 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8c0f6-c466-4a46-a42e-9d384ab2d0be admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:26.217783 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8c0f6-c466-4a46-a42e-9d384ab2d0be admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:26.219253 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 34/67] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:21:26 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:26.225177 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a16bc3-1b8d-4386-96d4-083bfd56ae54 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:26.233224 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a16bc3-1b8d-4386-96d4-083bfd56ae54 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:26.237212 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f52533-73b1-490e-866d-8818b7360f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:26.237763 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f52533-73b1-490e-866d-8818b7360f7f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:26.238059 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f52533-73b1-490e-866d-8818b7360f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:26.238921 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f52533-73b1-490e-866d-8818b7360f7f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:26.239677 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f52533-73b1-490e-866d-8818b7360f7f admin admin] RBAC: Adding query filter params (role.id=fafc5ecb5c074178be50f3c8d8006db2, scope.project.id=fa4552970c8f438c8319be7d42c1811a, user.id=dc2016d1d16043ccbcc1e69278abf4b4) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:26.239982 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f52533-73b1-490e-866d-8818b7360f7f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:26.264909 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f52533-73b1-490e-866d-8818b7360f7f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:26.270495 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 34/68] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:21:26 2021] GET /identity/v3/role_assignments?user.id=dc2016d1d16043ccbcc1e69278abf4b4&scope.project.id=fa4552970c8f438c8319be7d42c1811a&role.id=fafc5ecb5c074178be50f3c8d8006db2 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:21:28.187450 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abda800-8f5c-4fa4-85ed-35946f3cd773 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:28.187963 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abda800-8f5c-4fa4-85ed-35946f3cd773 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:28.188052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abda800-8f5c-4fa4-85ed-35946f3cd773 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:28.189751 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 35/69] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:28.195360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11243953-11d6-4ab6-909f-4368d5154d8c None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:28.195787 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11243953-11d6-4ab6-909f-4368d5154d8c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:28.195934 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11243953-11d6-4ab6-909f-4368d5154d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:28.218454 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-11243953-11d6-4ab6-909f-4368d5154d8c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:28.219584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-11243953-11d6-4ab6-909f-4368d5154d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:28.226462 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 35/70] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:28.247686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abda800-8f5c-4fa4-85ed-35946f3cd773 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:28.259587 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abda800-8f5c-4fa4-85ed-35946f3cd773 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:28.263468 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4697d-065c-4ab2-b341-e820b4a6180d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:28.264173 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4697d-065c-4ab2-b341-e820b4a6180d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:28.264465 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4697d-065c-4ab2-b341-e820b4a6180d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:28.264785 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4697d-065c-4ab2-b341-e820b4a6180d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:28.275849 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4697d-065c-4ab2-b341-e820b4a6180d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:21:28.282210 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-6dd4697d-065c-4ab2-b341-e820b4a6180d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 01:21:28.283267 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:21:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:21:28.288966 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11243953-11d6-4ab6-909f-4368d5154d8c None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:28.297286 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11243953-11d6-4ab6-909f-4368d5154d8c None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:28.301875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6004c-32ff-4acc-9474-3346da3750b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:28.302456 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6004c-32ff-4acc-9474-3346da3750b1 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:28.302752 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6004c-32ff-4acc-9474-3346da3750b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:28.303039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6004c-32ff-4acc-9474-3346da3750b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:28.303740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6004c-32ff-4acc-9474-3346da3750b1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:28.304043 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6004c-32ff-4acc-9474-3346da3750b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:28.328890 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6004c-32ff-4acc-9474-3346da3750b1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:28.337135 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 36/72] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Aug 23 01:21:28 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:28.342030 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4697d-065c-4ab2-b341-e820b4a6180d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:28.354109 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4697d-065c-4ab2-b341-e820b4a6180d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:28.358087 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c45efb-49d0-4645-b7de-0f219fdf839f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:28.358849 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c45efb-49d0-4645-b7de-0f219fdf839f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:28.359142 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c45efb-49d0-4645-b7de-0f219fdf839f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:28.359429 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c45efb-49d0-4645-b7de-0f219fdf839f admin admin] PATH_INFO: `/v3/users/dc2016d1d16043ccbcc1e69278abf4b4` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:28.360512 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c45efb-49d0-4645-b7de-0f219fdf839f admin admin] RBAC: Authorizing `identity:get_user(user_id=dc2016d1d16043ccbcc1e69278abf4b4)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:28.386614 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c45efb-49d0-4645-b7de-0f219fdf839f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:28.388065 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 37/73] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:21:28 2021] GET /identity/v3/users/dc2016d1d16043ccbcc1e69278abf4b4 => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:28.392993 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6004c-32ff-4acc-9474-3346da3750b1 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:28.402134 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6004c-32ff-4acc-9474-3346da3750b1 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:28.406081 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ff2cb-fa29-4feb-a71d-ce581905f56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:28.406842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ff2cb-fa29-4feb-a71d-ce581905f56d admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:28.407131 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ff2cb-fa29-4feb-a71d-ce581905f56d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:28.407413 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ff2cb-fa29-4feb-a71d-ce581905f56d admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:28.408497 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ff2cb-fa29-4feb-a71d-ce581905f56d admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:28.434869 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ff2cb-fa29-4feb-a71d-ce581905f56d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:28.436375 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 37/74] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:21:28 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:28.441646 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c45efb-49d0-4645-b7de-0f219fdf839f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:28.450747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c45efb-49d0-4645-b7de-0f219fdf839f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:28.454670 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e2346-f149-4ede-813d-670c4891d7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:28.455462 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e2346-f149-4ede-813d-670c4891d7d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:28.455756 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e2346-f149-4ede-813d-670c4891d7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:28.456038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e2346-f149-4ede-813d-670c4891d7d4 admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a/users/dc2016d1d16043ccbcc1e69278abf4b4/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:28.457819 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e2346-f149-4ede-813d-670c4891d7d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4552970c8f438c8319be7d42c1811a, user_id=dc2016d1d16043ccbcc1e69278abf4b4, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:28.484625 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e2346-f149-4ede-813d-670c4891d7d4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:28.597245 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 38/75] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:21:28 2021] PUT /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a/users/dc2016d1d16043ccbcc1e69278abf4b4/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:21:30.533647 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40e6d3-a7a8-445b-bbdf-5875b73561d2 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:30.534115 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40e6d3-a7a8-445b-bbdf-5875b73561d2 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:30.534196 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40e6d3-a7a8-445b-bbdf-5875b73561d2 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:30.536367 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 38/76] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:30.541464 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c947d9a-8837-4fb4-b7ee-1caeca74e950 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:30.541820 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c947d9a-8837-4fb4-b7ee-1caeca74e950 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:30.542039 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c947d9a-8837-4fb4-b7ee-1caeca74e950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:30.564232 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-4c947d9a-8837-4fb4-b7ee-1caeca74e950 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:30.565387 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4c947d9a-8837-4fb4-b7ee-1caeca74e950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:30.627001 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 39/77] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:30.648964 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40e6d3-a7a8-445b-bbdf-5875b73561d2 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:30.660711 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40e6d3-a7a8-445b-bbdf-5875b73561d2 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:30.664491 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb7a8b-6f4a-4aa9-9b6a-76b2bf1361ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:30.665221 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb7a8b-6f4a-4aa9-9b6a-76b2bf1361ca admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:30.665505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb7a8b-6f4a-4aa9-9b6a-76b2bf1361ca admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:30.665783 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb7a8b-6f4a-4aa9-9b6a-76b2bf1361ca admin admin] PATH_INFO: `/v3/roles/member` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:30.677747 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb7a8b-6f4a-4aa9-9b6a-76b2bf1361ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:21:30.683976 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-41bb7a8b-6f4a-4aa9-9b6a-76b2bf1361ca admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 01:21:30.685061 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 39/78] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:21:30 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:21:30.690230 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c947d9a-8837-4fb4-b7ee-1caeca74e950 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:30.698523 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c947d9a-8837-4fb4-b7ee-1caeca74e950 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:30.702400 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c73abc-32f2-4136-bc38-fd8aa6280f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:30.702976 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c73abc-32f2-4136-bc38-fd8aa6280f06 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:30.703265 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c73abc-32f2-4136-bc38-fd8aa6280f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:30.703548 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c73abc-32f2-4136-bc38-fd8aa6280f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:30.704244 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c73abc-32f2-4136-bc38-fd8aa6280f06 admin admin] RBAC: Adding query filter params (name=member) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:30.704543 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c73abc-32f2-4136-bc38-fd8aa6280f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:30.730096 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c73abc-32f2-4136-bc38-fd8aa6280f06 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:30.738899 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 40/79] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Aug 23 01:21:30 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:30.743938 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb7a8b-6f4a-4aa9-9b6a-76b2bf1361ca admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:30.752789 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb7a8b-6f4a-4aa9-9b6a-76b2bf1361ca admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:30.756634 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857024fa-3095-436a-bb37-34453a5aed58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:30.757387 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857024fa-3095-436a-bb37-34453a5aed58 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:30.757677 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857024fa-3095-436a-bb37-34453a5aed58 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:30.757957 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857024fa-3095-436a-bb37-34453a5aed58 admin admin] PATH_INFO: `/v3/users/dc2016d1d16043ccbcc1e69278abf4b4` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:30.759218 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857024fa-3095-436a-bb37-34453a5aed58 admin admin] RBAC: Authorizing `identity:get_user(user_id=dc2016d1d16043ccbcc1e69278abf4b4)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:30.784760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857024fa-3095-436a-bb37-34453a5aed58 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:30.786699 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 40/80] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:21:30 2021] GET /identity/v3/users/dc2016d1d16043ccbcc1e69278abf4b4 => generated 275 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:30.791573 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c73abc-32f2-4136-bc38-fd8aa6280f06 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:30.800431 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c73abc-32f2-4136-bc38-fd8aa6280f06 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:30.804365 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dba76-0131-4bf6-9f67-b88a0fad69bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:30.804960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dba76-0131-4bf6-9f67-b88a0fad69bd admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:30.805257 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dba76-0131-4bf6-9f67-b88a0fad69bd admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:30.805547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dba76-0131-4bf6-9f67-b88a0fad69bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:30.813027 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dba76-0131-4bf6-9f67-b88a0fad69bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:30.838395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dba76-0131-4bf6-9f67-b88a0fad69bd admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:30.846583 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 41/81] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:21:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:21:30.852399 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857024fa-3095-436a-bb37-34453a5aed58 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:30.861247 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857024fa-3095-436a-bb37-34453a5aed58 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:30.865201 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9820998-d758-4c48-b98e-dbfd211357e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:30.865952 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9820998-d758-4c48-b98e-dbfd211357e8 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:30.866241 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9820998-d758-4c48-b98e-dbfd211357e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:30.866524 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9820998-d758-4c48-b98e-dbfd211357e8 admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:30.867563 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9820998-d758-4c48-b98e-dbfd211357e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:30.892556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9820998-d758-4c48-b98e-dbfd211357e8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:30.894011 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 41/82] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:21:30 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:30.899730 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dba76-0131-4bf6-9f67-b88a0fad69bd admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:30.907800 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dba76-0131-4bf6-9f67-b88a0fad69bd admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:30.912379 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418bc3f-1272-4e75-8b49-eed590345cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:30.912962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418bc3f-1272-4e75-8b49-eed590345cfb admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:30.913254 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418bc3f-1272-4e75-8b49-eed590345cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:30.913537 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418bc3f-1272-4e75-8b49-eed590345cfb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:30.914295 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418bc3f-1272-4e75-8b49-eed590345cfb admin admin] RBAC: Adding query filter params (role.id=fafc5ecb5c074178be50f3c8d8006db2, scope.project.id=fa4552970c8f438c8319be7d42c1811a, user.id=dc2016d1d16043ccbcc1e69278abf4b4) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:30.914645 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418bc3f-1272-4e75-8b49-eed590345cfb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:30.938908 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-f418bc3f-1272-4e75-8b49-eed590345cfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:21:30.938908 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:21:30.938908 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:21:30.940026 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418bc3f-1272-4e75-8b49-eed590345cfb admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:30.945649 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 42/83] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:21:30 2021] GET /identity/v3/role_assignments?user.id=dc2016d1d16043ccbcc1e69278abf4b4&scope.project.id=fa4552970c8f438c8319be7d42c1811a&role.id=fafc5ecb5c074178be50f3c8d8006db2 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:21:32.911222 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37c485-f225-4070-8af3-1817830ebca6 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:32.911719 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37c485-f225-4070-8af3-1817830ebca6 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:32.911827 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37c485-f225-4070-8af3-1817830ebca6 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:32.913542 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 42/84] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:32.918618 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51ed67-98b3-4bdf-8a43-dd001b4ce110 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:32.918977 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51ed67-98b3-4bdf-8a43-dd001b4ce110 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:32.919191 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51ed67-98b3-4bdf-8a43-dd001b4ce110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:32.941911 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-cd51ed67-98b3-4bdf-8a43-dd001b4ce110 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:32.943028 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-cd51ed67-98b3-4bdf-8a43-dd001b4ce110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:32.949619 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 43/85] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:32.970931 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37c485-f225-4070-8af3-1817830ebca6 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:32.983116 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37c485-f225-4070-8af3-1817830ebca6 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:32.986956 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fcfb1-9fe5-47ac-ad45-33704c79e878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:32.987660 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fcfb1-9fe5-47ac-ad45-33704c79e878 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:32.988594 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fcfb1-9fe5-47ac-ad45-33704c79e878 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:32.988891 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fcfb1-9fe5-47ac-ad45-33704c79e878 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:33.002253 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7fcfb1-9fe5-47ac-ad45-33704c79e878 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:21:33.008522 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-1c7fcfb1-9fe5-47ac-ad45-33704c79e878 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:21:33.009606 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 43/86] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:21:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:21:33.014820 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51ed67-98b3-4bdf-8a43-dd001b4ce110 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:33.023648 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51ed67-98b3-4bdf-8a43-dd001b4ce110 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:33.027566 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09d462-6e8c-43f4-93fe-594040d424c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:33.028146 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09d462-6e8c-43f4-93fe-594040d424c5 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:33.028437 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09d462-6e8c-43f4-93fe-594040d424c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:33.028758 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09d462-6e8c-43f4-93fe-594040d424c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:33.029466 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09d462-6e8c-43f4-93fe-594040d424c5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:33.029769 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09d462-6e8c-43f4-93fe-594040d424c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:33.055177 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09d462-6e8c-43f4-93fe-594040d424c5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:33.063432 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 44/87] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:21:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:33.068951 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fcfb1-9fe5-47ac-ad45-33704c79e878 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:33.077832 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fcfb1-9fe5-47ac-ad45-33704c79e878 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:33.081808 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fda1a-4625-4b4c-be31-04e138d8d446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:33.082578 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fda1a-4625-4b4c-be31-04e138d8d446 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:33.082872 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fda1a-4625-4b4c-be31-04e138d8d446 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:33.083158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fda1a-4625-4b4c-be31-04e138d8d446 admin admin] PATH_INFO: `/v3/users/f126ecc3e0554a38839d919cf3fec6e7` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:33.084218 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fda1a-4625-4b4c-be31-04e138d8d446 admin admin] RBAC: Authorizing `identity:get_user(user_id=f126ecc3e0554a38839d919cf3fec6e7)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:33.109675 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fda1a-4625-4b4c-be31-04e138d8d446 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:33.111087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 44/88] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:21:33 2021] GET /identity/v3/users/f126ecc3e0554a38839d919cf3fec6e7 => generated 247 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:33.116381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09d462-6e8c-43f4-93fe-594040d424c5 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:33.125123 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09d462-6e8c-43f4-93fe-594040d424c5 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:33.129547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bbc4f-d4c8-4c51-8997-e01e039bf84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:33.130093 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bbc4f-d4c8-4c51-8997-e01e039bf84c admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:33.130385 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bbc4f-d4c8-4c51-8997-e01e039bf84c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:33.130670 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bbc4f-d4c8-4c51-8997-e01e039bf84c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:33.138110 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bbc4f-d4c8-4c51-8997-e01e039bf84c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:33.162979 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bbc4f-d4c8-4c51-8997-e01e039bf84c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:33.171089 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 45/89] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:21:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:21:33.176588 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fda1a-4625-4b4c-be31-04e138d8d446 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:33.185448 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fda1a-4625-4b4c-be31-04e138d8d446 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:33.189314 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bb7ab-9fe2-4079-93e3-ca6b34f69ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:33.190063 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bb7ab-9fe2-4079-93e3-ca6b34f69ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:33.190351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bb7ab-9fe2-4079-93e3-ca6b34f69ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:33.190635 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bb7ab-9fe2-4079-93e3-ca6b34f69ae2 admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:33.192294 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bb7ab-9fe2-4079-93e3-ca6b34f69ae2 admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:33.217396 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bb7ab-9fe2-4079-93e3-ca6b34f69ae2 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:33.218847 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 45/90] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:21:33 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:21:33.224166 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bbc4f-d4c8-4c51-8997-e01e039bf84c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:33.232231 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bbc4f-d4c8-4c51-8997-e01e039bf84c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:33.236129 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510d070-621d-48d7-9b90-0d1a1bb228c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:33.236712 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510d070-621d-48d7-9b90-0d1a1bb228c1 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:33.237007 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510d070-621d-48d7-9b90-0d1a1bb228c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:33.237293 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510d070-621d-48d7-9b90-0d1a1bb228c1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:33.238551 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510d070-621d-48d7-9b90-0d1a1bb228c1 admin admin] RBAC: Adding query filter params (role.id=56d36413cf4047229b6f9d36a3990b0d, scope.project.id=fa4552970c8f438c8319be7d42c1811a, user.id=f126ecc3e0554a38839d919cf3fec6e7) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:33.238857 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510d070-621d-48d7-9b90-0d1a1bb228c1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:33.264440 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510d070-621d-48d7-9b90-0d1a1bb228c1 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:33.269598 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 46/91] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:21:33 2021] GET /identity/v3/role_assignments?user.id=f126ecc3e0554a38839d919cf3fec6e7&scope.project.id=fa4552970c8f438c8319be7d42c1811a&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:35.154129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f0ffb-1d1f-4010-bc97-9b65c742ea47 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:35.154693 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f0ffb-1d1f-4010-bc97-9b65c742ea47 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:35.154693 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f0ffb-1d1f-4010-bc97-9b65c742ea47 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:35.156362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 46/92] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:35.162793 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c24896-485c-406d-8083-14d2554e9172 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:35.163221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c24896-485c-406d-8083-14d2554e9172 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:35.163364 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c24896-485c-406d-8083-14d2554e9172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:35.185872 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-e9c24896-485c-406d-8083-14d2554e9172 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:35.186989 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-e9c24896-485c-406d-8083-14d2554e9172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:35.193615 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 47/93] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:21:35.214933 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f0ffb-1d1f-4010-bc97-9b65c742ea47 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:35.226920 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f0ffb-1d1f-4010-bc97-9b65c742ea47 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:35.230709 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751c1e8-408c-40c5-bfb2-357bac9e6093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:35.231413 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751c1e8-408c-40c5-bfb2-357bac9e6093 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:35.231711 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751c1e8-408c-40c5-bfb2-357bac9e6093 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:35.231994 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751c1e8-408c-40c5-bfb2-357bac9e6093 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:35.243336 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751c1e8-408c-40c5-bfb2-357bac9e6093 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:21:35.249655 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-7751c1e8-408c-40c5-bfb2-357bac9e6093 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:21:35.250706 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 47/94] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:21:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:21:35.255819 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c24896-485c-406d-8083-14d2554e9172 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:35.264214 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c24896-485c-406d-8083-14d2554e9172 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:35.268255 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc41b2-6eea-4dbc-84c1-5895e3a85ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:35.268871 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc41b2-6eea-4dbc-84c1-5895e3a85ebe admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:35.269679 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc41b2-6eea-4dbc-84c1-5895e3a85ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:35.269961 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc41b2-6eea-4dbc-84c1-5895e3a85ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:35.270665 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc41b2-6eea-4dbc-84c1-5895e3a85ebe admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:35.270964 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc41b2-6eea-4dbc-84c1-5895e3a85ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:35.296211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc41b2-6eea-4dbc-84c1-5895e3a85ebe admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:35.304538 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 48/95] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:21:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:35.309577 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751c1e8-408c-40c5-bfb2-357bac9e6093 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:35.319337 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751c1e8-408c-40c5-bfb2-357bac9e6093 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:35.323163 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4aa544-39f3-4675-9531-aa06fa810c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:35.323928 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4aa544-39f3-4675-9531-aa06fa810c8e admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:35.324220 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4aa544-39f3-4675-9531-aa06fa810c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:35.324501 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4aa544-39f3-4675-9531-aa06fa810c8e admin admin] PATH_INFO: `/v3/users/f126ecc3e0554a38839d919cf3fec6e7` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:35.325601 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4aa544-39f3-4675-9531-aa06fa810c8e admin admin] RBAC: Authorizing `identity:get_user(user_id=f126ecc3e0554a38839d919cf3fec6e7)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:35.351739 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4aa544-39f3-4675-9531-aa06fa810c8e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:35.353161 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 48/96] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:21:35 2021] GET /identity/v3/users/f126ecc3e0554a38839d919cf3fec6e7 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:35.357940 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc41b2-6eea-4dbc-84c1-5895e3a85ebe admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:35.366667 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc41b2-6eea-4dbc-84c1-5895e3a85ebe admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:35.370500 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a9e9f-8dda-41ef-b6b9-00a7105b0990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:35.371256 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a9e9f-8dda-41ef-b6b9-00a7105b0990 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:35.371548 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a9e9f-8dda-41ef-b6b9-00a7105b0990 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:35.371832 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a9e9f-8dda-41ef-b6b9-00a7105b0990 admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:35.372911 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a9e9f-8dda-41ef-b6b9-00a7105b0990 admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:35.398473 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a9e9f-8dda-41ef-b6b9-00a7105b0990 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:35.399944 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 49/97] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:21:35 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:35.405113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4aa544-39f3-4675-9531-aa06fa810c8e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:35.414980 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4aa544-39f3-4675-9531-aa06fa810c8e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:35.418848 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1af7f-854d-4d9e-a765-5ccc7126b68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:35.419640 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1af7f-854d-4d9e-a765-5ccc7126b68e admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:35.419928 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1af7f-854d-4d9e-a765-5ccc7126b68e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:35.420209 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1af7f-854d-4d9e-a765-5ccc7126b68e admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a/users/f126ecc3e0554a38839d919cf3fec6e7/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:35.421923 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1af7f-854d-4d9e-a765-5ccc7126b68e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4552970c8f438c8319be7d42c1811a, user_id=f126ecc3e0554a38839d919cf3fec6e7, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:35.446236 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-ddc1af7f-854d-4d9e-a765-5ccc7126b68e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:21:35.446236 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:21:35.446236 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:21:35.448152 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1af7f-854d-4d9e-a765-5ccc7126b68e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:35.586213 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 49/98] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:21:35 2021] PUT /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a/users/f126ecc3e0554a38839d919cf3fec6e7/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:21:37.511939 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc7634-c951-4270-9234-165ecb28ffc7 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:37.512417 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc7634-c951-4270-9234-165ecb28ffc7 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:37.512524 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc7634-c951-4270-9234-165ecb28ffc7 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:37.514210 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 50/99] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:37.519749 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f981c-0af9-4b13-99e3-206e6e7dcc4f None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:37.520151 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f981c-0af9-4b13-99e3-206e6e7dcc4f None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:37.520323 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f981c-0af9-4b13-99e3-206e6e7dcc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:37.542802 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-671f981c-0af9-4b13-99e3-206e6e7dcc4f None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:37.543921 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-671f981c-0af9-4b13-99e3-206e6e7dcc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:37.604942 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 50/100] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:37.626680 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc7634-c951-4270-9234-165ecb28ffc7 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:37.637905 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc7634-c951-4270-9234-165ecb28ffc7 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:37.641661 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d05b94-0221-4f43-975a-6f4fc92f64a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:37.642361 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d05b94-0221-4f43-975a-6f4fc92f64a8 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:37.642650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d05b94-0221-4f43-975a-6f4fc92f64a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:37.642929 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d05b94-0221-4f43-975a-6f4fc92f64a8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:37.654927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d05b94-0221-4f43-975a-6f4fc92f64a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:21:37.661726 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-01d05b94-0221-4f43-975a-6f4fc92f64a8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:21:37.662777 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 51/101] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:21:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:21:37.667964 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f981c-0af9-4b13-99e3-206e6e7dcc4f None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:37.676108 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f981c-0af9-4b13-99e3-206e6e7dcc4f None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:37.679899 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d4678-c772-4405-92e3-a389accb5239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:37.680476 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d4678-c772-4405-92e3-a389accb5239 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:37.680798 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d4678-c772-4405-92e3-a389accb5239 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:37.681079 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d4678-c772-4405-92e3-a389accb5239 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:37.681774 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d4678-c772-4405-92e3-a389accb5239 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:37.682071 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d4678-c772-4405-92e3-a389accb5239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:37.707178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d4678-c772-4405-92e3-a389accb5239 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:37.715344 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 51/102] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:21:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:37.720352 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d05b94-0221-4f43-975a-6f4fc92f64a8 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:37.730248 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d05b94-0221-4f43-975a-6f4fc92f64a8 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:37.734570 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cceddf-9377-4942-bed3-a4f2fbd42c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:37.735337 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cceddf-9377-4942-bed3-a4f2fbd42c73 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:37.735623 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cceddf-9377-4942-bed3-a4f2fbd42c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:37.735902 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cceddf-9377-4942-bed3-a4f2fbd42c73 admin admin] PATH_INFO: `/v3/users/f126ecc3e0554a38839d919cf3fec6e7` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:37.736989 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cceddf-9377-4942-bed3-a4f2fbd42c73 admin admin] RBAC: Authorizing `identity:get_user(user_id=f126ecc3e0554a38839d919cf3fec6e7)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:37.762016 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cceddf-9377-4942-bed3-a4f2fbd42c73 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:37.763410 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 52/103] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:21:37 2021] GET /identity/v3/users/f126ecc3e0554a38839d919cf3fec6e7 => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:37.768114 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d4678-c772-4405-92e3-a389accb5239 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:37.777309 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d4678-c772-4405-92e3-a389accb5239 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:37.781101 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47ccdb-28e9-401f-9cc1-e961ecbf2766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:37.781649 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47ccdb-28e9-401f-9cc1-e961ecbf2766 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:37.781936 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47ccdb-28e9-401f-9cc1-e961ecbf2766 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:37.782218 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47ccdb-28e9-401f-9cc1-e961ecbf2766 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:37.790271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47ccdb-28e9-401f-9cc1-e961ecbf2766 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:37.814925 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47ccdb-28e9-401f-9cc1-e961ecbf2766 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:37.823046 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 52/104] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:21:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:21:37.827940 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cceddf-9377-4942-bed3-a4f2fbd42c73 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:37.837282 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cceddf-9377-4942-bed3-a4f2fbd42c73 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:37.841181 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622ed46-4cd1-4083-a614-e9c4abf20243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:37.841929 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622ed46-4cd1-4083-a614-e9c4abf20243 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:37.842223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622ed46-4cd1-4083-a614-e9c4abf20243 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:37.842511 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622ed46-4cd1-4083-a614-e9c4abf20243 admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:37.843558 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622ed46-4cd1-4083-a614-e9c4abf20243 admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:37.869204 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622ed46-4cd1-4083-a614-e9c4abf20243 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:37.870665 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 53/105] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:21:37 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:37.875953 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47ccdb-28e9-401f-9cc1-e961ecbf2766 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:37.884484 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47ccdb-28e9-401f-9cc1-e961ecbf2766 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:37.888336 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba01bf-a90e-4cb2-b61c-4749a44b60f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:37.888925 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba01bf-a90e-4cb2-b61c-4749a44b60f4 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:37.889218 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba01bf-a90e-4cb2-b61c-4749a44b60f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:37.889508 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba01bf-a90e-4cb2-b61c-4749a44b60f4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:37.890260 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba01bf-a90e-4cb2-b61c-4749a44b60f4 admin admin] RBAC: Adding query filter params (role.id=56d36413cf4047229b6f9d36a3990b0d, scope.project.id=fa4552970c8f438c8319be7d42c1811a, user.id=f126ecc3e0554a38839d919cf3fec6e7) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:37.890561 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba01bf-a90e-4cb2-b61c-4749a44b60f4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:37.916216 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba01bf-a90e-4cb2-b61c-4749a44b60f4 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:37.921830 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 53/106] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:21:37 2021] GET /identity/v3/role_assignments?user.id=f126ecc3e0554a38839d919cf3fec6e7&scope.project.id=fa4552970c8f438c8319be7d42c1811a&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:39.880384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e9bf9-dff0-477c-b419-02a67fdb485f None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:39.880904 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e9bf9-dff0-477c-b419-02a67fdb485f None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:39.880904 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e9bf9-dff0-477c-b419-02a67fdb485f None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:39.882588 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 54/107] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:39.887545 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490869e-bf1f-459d-b08e-bf43a2f3502f None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:39.887899 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490869e-bf1f-459d-b08e-bf43a2f3502f None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:39.888133 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490869e-bf1f-459d-b08e-bf43a2f3502f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:39.911137 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-2490869e-bf1f-459d-b08e-bf43a2f3502f None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:39.912265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-2490869e-bf1f-459d-b08e-bf43a2f3502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:39.918858 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 54/108] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:39.940186 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e9bf9-dff0-477c-b419-02a67fdb485f None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:39.951654 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e9bf9-dff0-477c-b419-02a67fdb485f None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:39.955484 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40059cd5-558c-4dc7-96d2-b45d1930b59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:39.956197 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40059cd5-558c-4dc7-96d2-b45d1930b59b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:39.957022 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40059cd5-558c-4dc7-96d2-b45d1930b59b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:39.957308 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40059cd5-558c-4dc7-96d2-b45d1930b59b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:39.968158 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40059cd5-558c-4dc7-96d2-b45d1930b59b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:21:39.975641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-40059cd5-558c-4dc7-96d2-b45d1930b59b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 01:21:39.976720 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 55/109] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:21:39 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:21:39.982049 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490869e-bf1f-459d-b08e-bf43a2f3502f None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:39.990356 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490869e-bf1f-459d-b08e-bf43a2f3502f None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:39.994234 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acad89e-becb-49a5-ab0e-14aebc4c746c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:39.994816 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acad89e-becb-49a5-ab0e-14aebc4c746c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:39.995111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acad89e-becb-49a5-ab0e-14aebc4c746c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:39.995398 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acad89e-becb-49a5-ab0e-14aebc4c746c admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:39.996097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acad89e-becb-49a5-ab0e-14aebc4c746c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:39.996402 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acad89e-becb-49a5-ab0e-14aebc4c746c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:40.021715 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acad89e-becb-49a5-ab0e-14aebc4c746c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:40.029825 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 55/110] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:21:39 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:40.034811 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40059cd5-558c-4dc7-96d2-b45d1930b59b admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:40.044715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40059cd5-558c-4dc7-96d2-b45d1930b59b admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:40.048534 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954633b2-31ad-4af3-a736-b52821ac9910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:40.049332 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954633b2-31ad-4af3-a736-b52821ac9910 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:40.049621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954633b2-31ad-4af3-a736-b52821ac9910 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:40.049902 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954633b2-31ad-4af3-a736-b52821ac9910 admin admin] PATH_INFO: `/v3/users/dc2016d1d16043ccbcc1e69278abf4b4` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:40.051454 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954633b2-31ad-4af3-a736-b52821ac9910 admin admin] RBAC: Authorizing `identity:get_user(user_id=dc2016d1d16043ccbcc1e69278abf4b4)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:40.085282 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954633b2-31ad-4af3-a736-b52821ac9910 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:40.086869 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 56/111] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:21:40 2021] GET /identity/v3/users/dc2016d1d16043ccbcc1e69278abf4b4 => generated 275 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:21:40.092434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acad89e-becb-49a5-ab0e-14aebc4c746c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:40.102530 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acad89e-becb-49a5-ab0e-14aebc4c746c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:40.106440 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd60e6-1586-412d-8881-90a92c1ec77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:40.107044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd60e6-1586-412d-8881-90a92c1ec77c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:40.107335 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd60e6-1586-412d-8881-90a92c1ec77c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:40.107624 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd60e6-1586-412d-8881-90a92c1ec77c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:40.115799 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd60e6-1586-412d-8881-90a92c1ec77c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:40.140724 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd60e6-1586-412d-8881-90a92c1ec77c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:40.148994 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 56/112] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:21:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:21:40.154111 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954633b2-31ad-4af3-a736-b52821ac9910 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:40.163922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954633b2-31ad-4af3-a736-b52821ac9910 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:40.167783 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3ad7f-e1b5-4a05-a746-5facf9606f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:40.168545 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3ad7f-e1b5-4a05-a746-5facf9606f28 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:40.168866 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3ad7f-e1b5-4a05-a746-5facf9606f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:40.169149 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3ad7f-e1b5-4a05-a746-5facf9606f28 admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:40.170197 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3ad7f-e1b5-4a05-a746-5facf9606f28 admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:40.195958 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3ad7f-e1b5-4a05-a746-5facf9606f28 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:40.197467 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 57/113] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:21:40 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:40.202834 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd60e6-1586-412d-8881-90a92c1ec77c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:40.211631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd60e6-1586-412d-8881-90a92c1ec77c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:40.215581 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135caedd-d79e-400e-9b5d-f14d4252e3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:40.216143 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135caedd-d79e-400e-9b5d-f14d4252e3eb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:40.216434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135caedd-d79e-400e-9b5d-f14d4252e3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:40.216759 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135caedd-d79e-400e-9b5d-f14d4252e3eb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:40.217526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135caedd-d79e-400e-9b5d-f14d4252e3eb admin admin] RBAC: Adding query filter params (role.id=1d347df28134487288d9c4a0c6451cb3, scope.project.id=fa4552970c8f438c8319be7d42c1811a, user.id=dc2016d1d16043ccbcc1e69278abf4b4) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:40.217834 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135caedd-d79e-400e-9b5d-f14d4252e3eb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:40.244158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135caedd-d79e-400e-9b5d-f14d4252e3eb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:40.249325 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 57/114] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:21:40 2021] GET /identity/v3/role_assignments?user.id=dc2016d1d16043ccbcc1e69278abf4b4&scope.project.id=fa4552970c8f438c8319be7d42c1811a&role.id=1d347df28134487288d9c4a0c6451cb3 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:42.142091 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb803c7-8a23-42b5-a5c2-c368e895d553 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:42.142605 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb803c7-8a23-42b5-a5c2-c368e895d553 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:42.142707 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb803c7-8a23-42b5-a5c2-c368e895d553 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:42.144342 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 58/115] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:42.149317 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45753ab6-9d0a-486e-83d5-c4e7a8130979 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:42.149704 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45753ab6-9d0a-486e-83d5-c4e7a8130979 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:42.149894 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45753ab6-9d0a-486e-83d5-c4e7a8130979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:42.171604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-45753ab6-9d0a-486e-83d5-c4e7a8130979 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:42.172746 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-45753ab6-9d0a-486e-83d5-c4e7a8130979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:42.179765 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 58/116] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:42.201279 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb803c7-8a23-42b5-a5c2-c368e895d553 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:42.212615 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb803c7-8a23-42b5-a5c2-c368e895d553 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:42.216439 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6834b-8e20-41ca-b122-24255dbfcc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:42.217191 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6834b-8e20-41ca-b122-24255dbfcc5f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:42.217485 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6834b-8e20-41ca-b122-24255dbfcc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:42.217771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6834b-8e20-41ca-b122-24255dbfcc5f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:42.229370 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6834b-8e20-41ca-b122-24255dbfcc5f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:21:42.235889 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-f8f6834b-8e20-41ca-b122-24255dbfcc5f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 01:21:42.236971 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 59/117] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:21:42 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:21:42.242738 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45753ab6-9d0a-486e-83d5-c4e7a8130979 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:42.251110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45753ab6-9d0a-486e-83d5-c4e7a8130979 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:42.255630 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b355e55-2b03-455d-adcd-fd4c6fd553ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:42.256214 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b355e55-2b03-455d-adcd-fd4c6fd553ea admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:42.256507 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b355e55-2b03-455d-adcd-fd4c6fd553ea admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:42.256821 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b355e55-2b03-455d-adcd-fd4c6fd553ea admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:42.257522 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b355e55-2b03-455d-adcd-fd4c6fd553ea admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:42.257826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b355e55-2b03-455d-adcd-fd4c6fd553ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:42.282926 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b355e55-2b03-455d-adcd-fd4c6fd553ea admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:42.291118 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 59/118] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:21:42 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:42.296064 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6834b-8e20-41ca-b122-24255dbfcc5f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:42.306423 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6834b-8e20-41ca-b122-24255dbfcc5f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:42.310324 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b28db0-b08d-4082-9c67-88cc0a8b0989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:42.311085 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b28db0-b08d-4082-9c67-88cc0a8b0989 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:42.311377 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b28db0-b08d-4082-9c67-88cc0a8b0989 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:42.311663 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b28db0-b08d-4082-9c67-88cc0a8b0989 admin admin] PATH_INFO: `/v3/users/dc2016d1d16043ccbcc1e69278abf4b4` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:42.312763 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b28db0-b08d-4082-9c67-88cc0a8b0989 admin admin] RBAC: Authorizing `identity:get_user(user_id=dc2016d1d16043ccbcc1e69278abf4b4)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:42.338722 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b28db0-b08d-4082-9c67-88cc0a8b0989 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:42.340125 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 60/119] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:21:42 2021] GET /identity/v3/users/dc2016d1d16043ccbcc1e69278abf4b4 => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:42.344917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b355e55-2b03-455d-adcd-fd4c6fd553ea admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:42.354443 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b355e55-2b03-455d-adcd-fd4c6fd553ea admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:42.358334 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db3e82-1a56-456c-bedc-af0db577ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:42.359082 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db3e82-1a56-456c-bedc-af0db577ee6b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:42.359374 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db3e82-1a56-456c-bedc-af0db577ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:42.359661 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db3e82-1a56-456c-bedc-af0db577ee6b admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:42.360757 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db3e82-1a56-456c-bedc-af0db577ee6b admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:42.386692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db3e82-1a56-456c-bedc-af0db577ee6b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:42.388177 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 60/120] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:21:42 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:42.393198 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b28db0-b08d-4082-9c67-88cc0a8b0989 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:42.402799 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b28db0-b08d-4082-9c67-88cc0a8b0989 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:42.406694 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a6aee-b4f7-436a-aa28-7c1afad3a065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:42.407476 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a6aee-b4f7-436a-aa28-7c1afad3a065 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:42.407766 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a6aee-b4f7-436a-aa28-7c1afad3a065 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:42.408051 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a6aee-b4f7-436a-aa28-7c1afad3a065 admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a/users/dc2016d1d16043ccbcc1e69278abf4b4/roles/1d347df28134487288d9c4a0c6451cb3` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:42.410005 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a6aee-b4f7-436a-aa28-7c1afad3a065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4552970c8f438c8319be7d42c1811a, user_id=dc2016d1d16043ccbcc1e69278abf4b4, role_id=1d347df28134487288d9c4a0c6451cb3)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:42.435976 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a6aee-b4f7-436a-aa28-7c1afad3a065 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:42.499864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 61/121] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:21:42 2021] PUT /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a/users/dc2016d1d16043ccbcc1e69278abf4b4/roles/1d347df28134487288d9c4a0c6451cb3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:21:44.399096 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3730b-de17-4aa6-816f-7c0c415f2c1a None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:44.399695 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3730b-de17-4aa6-816f-7c0c415f2c1a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:44.399695 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3730b-de17-4aa6-816f-7c0c415f2c1a None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:44.401365 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 61/122] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:44.406524 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa39175-47ca-4617-bd85-c9b4bb4b18f3 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:44.406917 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa39175-47ca-4617-bd85-c9b4bb4b18f3 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:44.407098 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa39175-47ca-4617-bd85-c9b4bb4b18f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:44.430368 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-cfa39175-47ca-4617-bd85-c9b4bb4b18f3 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:44.431823 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-cfa39175-47ca-4617-bd85-c9b4bb4b18f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:44.494066 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 62/123] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:44.515561 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3730b-de17-4aa6-816f-7c0c415f2c1a None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:44.527427 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3730b-de17-4aa6-816f-7c0c415f2c1a None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:44.531187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4222-7d20-450b-9f82-4cd13e27dd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:44.531904 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4222-7d20-450b-9f82-4cd13e27dd83 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:44.532193 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4222-7d20-450b-9f82-4cd13e27dd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:44.532475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4222-7d20-450b-9f82-4cd13e27dd83 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:44.544693 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd4222-7d20-450b-9f82-4cd13e27dd83 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:21:44.551217 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-e6bd4222-7d20-450b-9f82-4cd13e27dd83 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 01:21:44.552282 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 62/124] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:21:44 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:21:44.557606 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa39175-47ca-4617-bd85-c9b4bb4b18f3 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:44.565947 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa39175-47ca-4617-bd85-c9b4bb4b18f3 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:44.569800 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21002ab7-355f-48c0-9634-b531b6b41974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:44.570381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21002ab7-355f-48c0-9634-b531b6b41974 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:44.570673 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21002ab7-355f-48c0-9634-b531b6b41974 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:44.570960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21002ab7-355f-48c0-9634-b531b6b41974 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:44.571665 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21002ab7-355f-48c0-9634-b531b6b41974 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:44.572027 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21002ab7-355f-48c0-9634-b531b6b41974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:44.597992 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21002ab7-355f-48c0-9634-b531b6b41974 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:44.606343 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 63/125] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:21:44 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:44.611310 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4222-7d20-450b-9f82-4cd13e27dd83 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:44.620196 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4222-7d20-450b-9f82-4cd13e27dd83 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:44.624090 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2789b-2114-4926-885e-4dd6e3799fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:44.624883 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2789b-2114-4926-885e-4dd6e3799fab admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:44.625177 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2789b-2114-4926-885e-4dd6e3799fab admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:44.625463 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2789b-2114-4926-885e-4dd6e3799fab admin admin] PATH_INFO: `/v3/users/dc2016d1d16043ccbcc1e69278abf4b4` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:44.626528 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2789b-2114-4926-885e-4dd6e3799fab admin admin] RBAC: Authorizing `identity:get_user(user_id=dc2016d1d16043ccbcc1e69278abf4b4)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:44.652935 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2789b-2114-4926-885e-4dd6e3799fab admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:44.654270 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 63/126] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:21:44 2021] GET /identity/v3/users/dc2016d1d16043ccbcc1e69278abf4b4 => generated 275 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:44.659072 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21002ab7-355f-48c0-9634-b531b6b41974 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:44.667939 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21002ab7-355f-48c0-9634-b531b6b41974 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:44.671779 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ee0f0-204d-45be-9c2a-8410afc26fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:44.672327 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ee0f0-204d-45be-9c2a-8410afc26fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:44.672654 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ee0f0-204d-45be-9c2a-8410afc26fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:44.672945 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ee0f0-204d-45be-9c2a-8410afc26fd3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:44.680329 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ee0f0-204d-45be-9c2a-8410afc26fd3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:44.713539 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ee0f0-204d-45be-9c2a-8410afc26fd3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:44.722426 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 64/127] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:21:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:21:44.728359 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2789b-2114-4926-885e-4dd6e3799fab admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:44.737522 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2789b-2114-4926-885e-4dd6e3799fab admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:44.741413 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af74226-90f5-47e1-96c0-86fb3256dc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:44.742186 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af74226-90f5-47e1-96c0-86fb3256dc94 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:44.742479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af74226-90f5-47e1-96c0-86fb3256dc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:44.742765 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af74226-90f5-47e1-96c0-86fb3256dc94 admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:44.743825 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af74226-90f5-47e1-96c0-86fb3256dc94 admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:44.770171 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af74226-90f5-47e1-96c0-86fb3256dc94 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:44.771662 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 64/128] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:21:44 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:44.777223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ee0f0-204d-45be-9c2a-8410afc26fd3 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:44.785662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ee0f0-204d-45be-9c2a-8410afc26fd3 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:44.789645 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b778dc-a60b-4c5d-9b25-c9fed4c4c87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:44.790212 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b778dc-a60b-4c5d-9b25-c9fed4c4c87f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:44.790503 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b778dc-a60b-4c5d-9b25-c9fed4c4c87f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:44.790849 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b778dc-a60b-4c5d-9b25-c9fed4c4c87f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:44.791624 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b778dc-a60b-4c5d-9b25-c9fed4c4c87f admin admin] RBAC: Adding query filter params (role.id=1d347df28134487288d9c4a0c6451cb3, scope.project.id=fa4552970c8f438c8319be7d42c1811a, user.id=dc2016d1d16043ccbcc1e69278abf4b4) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:44.791929 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b778dc-a60b-4c5d-9b25-c9fed4c4c87f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:44.817511 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b778dc-a60b-4c5d-9b25-c9fed4c4c87f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:44.823104 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 65/129] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:21:44 2021] GET /identity/v3/role_assignments?user.id=dc2016d1d16043ccbcc1e69278abf4b4&scope.project.id=fa4552970c8f438c8319be7d42c1811a&role.id=1d347df28134487288d9c4a0c6451cb3 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:46.782157 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3d615-238e-49c1-ba77-1378535c7752 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:46.782653 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3d615-238e-49c1-ba77-1378535c7752 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:46.782653 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3d615-238e-49c1-ba77-1378535c7752 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:46.784317 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 65/130] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:46.789236 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc664d-d1d0-4781-803c-8819e7e13126 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:46.789641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc664d-d1d0-4781-803c-8819e7e13126 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:46.789809 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc664d-d1d0-4781-803c-8819e7e13126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:46.813182 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-6bdc664d-d1d0-4781-803c-8819e7e13126 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:46.814296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-6bdc664d-d1d0-4781-803c-8819e7e13126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:46.821435 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 66/131] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:46.843482 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3d615-238e-49c1-ba77-1378535c7752 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:46.855429 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3d615-238e-49c1-ba77-1378535c7752 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:46.859133 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79b24a-e5c5-4098-a4d1-0fa377811b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:46.859833 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79b24a-e5c5-4098-a4d1-0fa377811b45 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:46.860120 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79b24a-e5c5-4098-a4d1-0fa377811b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:46.860401 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79b24a-e5c5-4098-a4d1-0fa377811b45 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:46.872268 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79b24a-e5c5-4098-a4d1-0fa377811b45 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:21:46.878584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-0f79b24a-e5c5-4098-a4d1-0fa377811b45 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 01:21:46.886534 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 66/132] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:21:46 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:21:46.886804 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc664d-d1d0-4781-803c-8819e7e13126 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:46.893514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc664d-d1d0-4781-803c-8819e7e13126 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:46.897477 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c145d3-b820-4458-a029-1b7e3777e56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:46.898186 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c145d3-b820-4458-a029-1b7e3777e56c admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:46.898478 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c145d3-b820-4458-a029-1b7e3777e56c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:46.898762 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c145d3-b820-4458-a029-1b7e3777e56c admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:46.899468 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c145d3-b820-4458-a029-1b7e3777e56c admin admin] RBAC: Adding query filter params (name=member) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:46.899771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c145d3-b820-4458-a029-1b7e3777e56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:46.926045 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c145d3-b820-4458-a029-1b7e3777e56c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:46.935269 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 67/133] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Aug 23 01:21:46 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:21:46.940695 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79b24a-e5c5-4098-a4d1-0fa377811b45 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:46.950677 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79b24a-e5c5-4098-a4d1-0fa377811b45 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:46.954534 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110b62a-3d85-4a50-8b1e-70379c0f2e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:46.955307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110b62a-3d85-4a50-8b1e-70379c0f2e6a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:46.955597 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110b62a-3d85-4a50-8b1e-70379c0f2e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:46.955880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110b62a-3d85-4a50-8b1e-70379c0f2e6a admin admin] PATH_INFO: `/v3/users/dc2016d1d16043ccbcc1e69278abf4b4` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:46.957040 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110b62a-3d85-4a50-8b1e-70379c0f2e6a admin admin] RBAC: Authorizing `identity:get_user(user_id=dc2016d1d16043ccbcc1e69278abf4b4)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:46.982835 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110b62a-3d85-4a50-8b1e-70379c0f2e6a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:46.984232 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 67/134] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:21:46 2021] GET /identity/v3/users/dc2016d1d16043ccbcc1e69278abf4b4 => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:46.989793 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c145d3-b820-4458-a029-1b7e3777e56c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:46.998768 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c145d3-b820-4458-a029-1b7e3777e56c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:47.002684 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76266df-27b4-4f6c-a981-3a1dbb8b50ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:47.003245 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76266df-27b4-4f6c-a981-3a1dbb8b50ec admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:47.003538 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76266df-27b4-4f6c-a981-3a1dbb8b50ec admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:47.003825 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76266df-27b4-4f6c-a981-3a1dbb8b50ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:47.011291 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76266df-27b4-4f6c-a981-3a1dbb8b50ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:47.036821 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76266df-27b4-4f6c-a981-3a1dbb8b50ec admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:47.044966 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 68/135] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:21:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:21:47.050685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110b62a-3d85-4a50-8b1e-70379c0f2e6a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:47.059654 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110b62a-3d85-4a50-8b1e-70379c0f2e6a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:47.063520 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8efde-d4d9-41a7-afae-6f1760f5aab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:47.064266 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8efde-d4d9-41a7-afae-6f1760f5aab4 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:47.064556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8efde-d4d9-41a7-afae-6f1760f5aab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:47.064867 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8efde-d4d9-41a7-afae-6f1760f5aab4 admin admin] PATH_INFO: `/v3/projects/18b6a01d26b441fbbbbd3d111d05c77b` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:47.065943 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8efde-d4d9-41a7-afae-6f1760f5aab4 admin admin] RBAC: Authorizing `identity:get_project(project_id=18b6a01d26b441fbbbbd3d111d05c77b)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:47.091123 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8efde-d4d9-41a7-afae-6f1760f5aab4 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:47.092586 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 68/136] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:21:47 2021] GET /identity/v3/projects/18b6a01d26b441fbbbbd3d111d05c77b => generated 312 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:47.098216 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76266df-27b4-4f6c-a981-3a1dbb8b50ec admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:47.106459 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76266df-27b4-4f6c-a981-3a1dbb8b50ec admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:47.110339 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760699e-ff73-42f3-8509-202afea667d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:47.110886 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760699e-ff73-42f3-8509-202afea667d7 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:47.111177 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760699e-ff73-42f3-8509-202afea667d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:47.111465 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760699e-ff73-42f3-8509-202afea667d7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:47.112843 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760699e-ff73-42f3-8509-202afea667d7 admin admin] RBAC: Adding query filter params (role.id=fafc5ecb5c074178be50f3c8d8006db2, scope.project.id=18b6a01d26b441fbbbbd3d111d05c77b, user.id=dc2016d1d16043ccbcc1e69278abf4b4) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:47.113168 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760699e-ff73-42f3-8509-202afea667d7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:47.138156 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760699e-ff73-42f3-8509-202afea667d7 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:47.143286 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 69/137] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:21:47 2021] GET /identity/v3/role_assignments?user.id=dc2016d1d16043ccbcc1e69278abf4b4&scope.project.id=18b6a01d26b441fbbbbd3d111d05c77b&role.id=fafc5ecb5c074178be50f3c8d8006db2 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:49.026340 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d0e4d-1676-48f7-8b75-6382bc388b66 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:49.026873 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d0e4d-1676-48f7-8b75-6382bc388b66 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:49.026964 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d0e4d-1676-48f7-8b75-6382bc388b66 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:49.028611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 69/138] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:49.033662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97ba8e-1263-4dbb-a6a0-5075cf129ed8 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:49.034077 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97ba8e-1263-4dbb-a6a0-5075cf129ed8 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:49.034834 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97ba8e-1263-4dbb-a6a0-5075cf129ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:49.056548 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-8f97ba8e-1263-4dbb-a6a0-5075cf129ed8 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:49.057727 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-8f97ba8e-1263-4dbb-a6a0-5075cf129ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:49.064224 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 70/139] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:49.085822 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d0e4d-1676-48f7-8b75-6382bc388b66 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:49.097647 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d0e4d-1676-48f7-8b75-6382bc388b66 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:49.101727 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4d158-89ba-47b7-b8f5-d94d92f2fd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:49.102433 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4d158-89ba-47b7-b8f5-d94d92f2fd33 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:49.102726 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4d158-89ba-47b7-b8f5-d94d92f2fd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:49.103014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4d158-89ba-47b7-b8f5-d94d92f2fd33 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:49.113881 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4d158-89ba-47b7-b8f5-d94d92f2fd33 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:21:49.120257 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-d6a4d158-89ba-47b7-b8f5-d94d92f2fd33 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 01:21:49.121330 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 70/140] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:21:49 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:21:49.126401 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97ba8e-1263-4dbb-a6a0-5075cf129ed8 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:49.135240 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97ba8e-1263-4dbb-a6a0-5075cf129ed8 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:49.139090 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41a607-c87d-45be-9485-244c613fc64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:49.139667 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41a607-c87d-45be-9485-244c613fc64e admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:49.139961 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41a607-c87d-45be-9485-244c613fc64e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:49.140247 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41a607-c87d-45be-9485-244c613fc64e admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:49.140988 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41a607-c87d-45be-9485-244c613fc64e admin admin] RBAC: Adding query filter params (name=member) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:49.141291 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41a607-c87d-45be-9485-244c613fc64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:49.166743 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41a607-c87d-45be-9485-244c613fc64e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:49.175560 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 71/141] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Aug 23 01:21:49 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:49.180579 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4d158-89ba-47b7-b8f5-d94d92f2fd33 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:49.190426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4d158-89ba-47b7-b8f5-d94d92f2fd33 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:49.194375 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ebeeb-a10b-4346-9ca4-c64d9f6faf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:49.195134 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ebeeb-a10b-4346-9ca4-c64d9f6faf5e admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:49.195430 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ebeeb-a10b-4346-9ca4-c64d9f6faf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:49.195720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ebeeb-a10b-4346-9ca4-c64d9f6faf5e admin admin] PATH_INFO: `/v3/users/dc2016d1d16043ccbcc1e69278abf4b4` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:49.196841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ebeeb-a10b-4346-9ca4-c64d9f6faf5e admin admin] RBAC: Authorizing `identity:get_user(user_id=dc2016d1d16043ccbcc1e69278abf4b4)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:49.222715 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ebeeb-a10b-4346-9ca4-c64d9f6faf5e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:49.224370 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 71/142] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:21:49 2021] GET /identity/v3/users/dc2016d1d16043ccbcc1e69278abf4b4 => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:49.229119 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41a607-c87d-45be-9485-244c613fc64e admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:49.238500 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41a607-c87d-45be-9485-244c613fc64e admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:49.242492 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb97f1-9f99-4b46-9e8c-ba221594fec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:49.243248 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb97f1-9f99-4b46-9e8c-ba221594fec1 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:49.243540 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb97f1-9f99-4b46-9e8c-ba221594fec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:49.243823 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb97f1-9f99-4b46-9e8c-ba221594fec1 admin admin] PATH_INFO: `/v3/projects/18b6a01d26b441fbbbbd3d111d05c77b` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:49.244905 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb97f1-9f99-4b46-9e8c-ba221594fec1 admin admin] RBAC: Authorizing `identity:get_project(project_id=18b6a01d26b441fbbbbd3d111d05c77b)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:49.270098 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb97f1-9f99-4b46-9e8c-ba221594fec1 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:49.271565 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 72/143] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:21:49 2021] GET /identity/v3/projects/18b6a01d26b441fbbbbd3d111d05c77b => generated 312 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:21:49.276531 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ebeeb-a10b-4346-9ca4-c64d9f6faf5e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:49.285878 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ebeeb-a10b-4346-9ca4-c64d9f6faf5e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:49.289757 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecb920-0745-4cd8-8004-e3702b5dcd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:49.290530 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecb920-0745-4cd8-8004-e3702b5dcd54 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:49.290822 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecb920-0745-4cd8-8004-e3702b5dcd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:49.291110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecb920-0745-4cd8-8004-e3702b5dcd54 admin admin] PATH_INFO: `/v3/projects/18b6a01d26b441fbbbbd3d111d05c77b/users/dc2016d1d16043ccbcc1e69278abf4b4/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:49.293061 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ecb920-0745-4cd8-8004-e3702b5dcd54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b6a01d26b441fbbbbd3d111d05c77b, user_id=dc2016d1d16043ccbcc1e69278abf4b4, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:49.319623 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ecb920-0745-4cd8-8004-e3702b5dcd54 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:49.420190 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 72/144] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:21:49 2021] PUT /identity/v3/projects/18b6a01d26b441fbbbbd3d111d05c77b/users/dc2016d1d16043ccbcc1e69278abf4b4/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:21:51.306991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d9c20-2144-4ff8-ae15-bfa4598a9996 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:51.307503 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d9c20-2144-4ff8-ae15-bfa4598a9996 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:51.307609 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d9c20-2144-4ff8-ae15-bfa4598a9996 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:51.309271 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 73/145] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:51.314343 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27f869-5c29-4c75-b4fb-7d4edff61aa7 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:51.314738 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27f869-5c29-4c75-b4fb-7d4edff61aa7 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:51.314914 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27f869-5c29-4c75-b4fb-7d4edff61aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:51.337102 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-4c27f869-5c29-4c75-b4fb-7d4edff61aa7 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:51.338217 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-4c27f869-5c29-4c75-b4fb-7d4edff61aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:51.401034 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 73/146] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:51.422929 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d9c20-2144-4ff8-ae15-bfa4598a9996 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:51.434922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d9c20-2144-4ff8-ae15-bfa4598a9996 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:51.438782 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72c7d7-b904-4f31-a38c-48dc4a3de77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:51.439488 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72c7d7-b904-4f31-a38c-48dc4a3de77d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:51.439781 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72c7d7-b904-4f31-a38c-48dc4a3de77d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:51.440068 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72c7d7-b904-4f31-a38c-48dc4a3de77d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:51.451639 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72c7d7-b904-4f31-a38c-48dc4a3de77d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:21:51.457981 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-8c72c7d7-b904-4f31-a38c-48dc4a3de77d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 01:21:51.459050 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 74/147] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:21:51 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:21:51.464288 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27f869-5c29-4c75-b4fb-7d4edff61aa7 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:51.473128 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27f869-5c29-4c75-b4fb-7d4edff61aa7 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:51.477220 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628311d-de6d-44ea-8abe-2e3ec47ad606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:51.477799 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628311d-de6d-44ea-8abe-2e3ec47ad606 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:51.478084 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628311d-de6d-44ea-8abe-2e3ec47ad606 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:51.478360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628311d-de6d-44ea-8abe-2e3ec47ad606 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:51.479051 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628311d-de6d-44ea-8abe-2e3ec47ad606 admin admin] RBAC: Adding query filter params (name=member) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:51.479345 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628311d-de6d-44ea-8abe-2e3ec47ad606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:51.504785 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628311d-de6d-44ea-8abe-2e3ec47ad606 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:51.512948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 74/148] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Aug 23 01:21:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:51.517957 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72c7d7-b904-4f31-a38c-48dc4a3de77d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:51.526858 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72c7d7-b904-4f31-a38c-48dc4a3de77d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:51.530941 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a221eac-809f-4916-967b-767545a7fd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:51.531722 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a221eac-809f-4916-967b-767545a7fd38 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:51.532018 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a221eac-809f-4916-967b-767545a7fd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:51.532304 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a221eac-809f-4916-967b-767545a7fd38 admin admin] PATH_INFO: `/v3/users/dc2016d1d16043ccbcc1e69278abf4b4` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:51.533422 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a221eac-809f-4916-967b-767545a7fd38 admin admin] RBAC: Authorizing `identity:get_user(user_id=dc2016d1d16043ccbcc1e69278abf4b4)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:51.559495 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a221eac-809f-4916-967b-767545a7fd38 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:51.560893 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 75/149] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:21:51 2021] GET /identity/v3/users/dc2016d1d16043ccbcc1e69278abf4b4 => generated 275 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:51.566296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628311d-de6d-44ea-8abe-2e3ec47ad606 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:51.574941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628311d-de6d-44ea-8abe-2e3ec47ad606 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:51.578758 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8939b76-b4ff-4926-b41e-725cf1b896f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:51.579309 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8939b76-b4ff-4926-b41e-725cf1b896f3 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:51.579598 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8939b76-b4ff-4926-b41e-725cf1b896f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:51.579882 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8939b76-b4ff-4926-b41e-725cf1b896f3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:51.587769 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8939b76-b4ff-4926-b41e-725cf1b896f3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:51.612676 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8939b76-b4ff-4926-b41e-725cf1b896f3 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:51.620719 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 75/150] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:21:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:21:51.625648 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a221eac-809f-4916-967b-767545a7fd38 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:51.635110 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a221eac-809f-4916-967b-767545a7fd38 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:51.638946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1043bd1-58db-4852-b414-67ffd6f511f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:51.639694 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1043bd1-58db-4852-b414-67ffd6f511f5 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:51.639983 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1043bd1-58db-4852-b414-67ffd6f511f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:51.640267 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1043bd1-58db-4852-b414-67ffd6f511f5 admin admin] PATH_INFO: `/v3/projects/18b6a01d26b441fbbbbd3d111d05c77b` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:51.641350 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1043bd1-58db-4852-b414-67ffd6f511f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=18b6a01d26b441fbbbbd3d111d05c77b)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:51.667164 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1043bd1-58db-4852-b414-67ffd6f511f5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:51.668641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 76/151] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:21:51 2021] GET /identity/v3/projects/18b6a01d26b441fbbbbd3d111d05c77b => generated 312 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:51.673864 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8939b76-b4ff-4926-b41e-725cf1b896f3 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:51.681831 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8939b76-b4ff-4926-b41e-725cf1b896f3 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:51.685674 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7821986-b434-4cf2-a53d-714d09b9bf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:51.686222 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7821986-b434-4cf2-a53d-714d09b9bf28 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:51.686508 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7821986-b434-4cf2-a53d-714d09b9bf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:51.686786 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7821986-b434-4cf2-a53d-714d09b9bf28 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:51.687532 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7821986-b434-4cf2-a53d-714d09b9bf28 admin admin] RBAC: Adding query filter params (role.id=fafc5ecb5c074178be50f3c8d8006db2, scope.project.id=18b6a01d26b441fbbbbd3d111d05c77b, user.id=dc2016d1d16043ccbcc1e69278abf4b4) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:51.687833 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7821986-b434-4cf2-a53d-714d09b9bf28 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:51.713815 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7821986-b434-4cf2-a53d-714d09b9bf28 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:51.719206 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 76/152] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:21:51 2021] GET /identity/v3/role_assignments?user.id=dc2016d1d16043ccbcc1e69278abf4b4&scope.project.id=18b6a01d26b441fbbbbd3d111d05c77b&role.id=fafc5ecb5c074178be50f3c8d8006db2 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:53.661109 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90a74-dcd8-4794-bd2d-e24b6a8591fc None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:53.661610 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90a74-dcd8-4794-bd2d-e24b6a8591fc None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:53.661723 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90a74-dcd8-4794-bd2d-e24b6a8591fc None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:53.663364 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 77/153] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:53.668350 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4ad58-bfca-4db3-87e3-00a5f654f075 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:53.668737 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4ad58-bfca-4db3-87e3-00a5f654f075 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:53.668914 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4ad58-bfca-4db3-87e3-00a5f654f075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:53.691227 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-d9a4ad58-bfca-4db3-87e3-00a5f654f075 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:53.692356 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-d9a4ad58-bfca-4db3-87e3-00a5f654f075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:53.698825 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 77/154] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:53.720125 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca90a74-dcd8-4794-bd2d-e24b6a8591fc None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:53.732261 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca90a74-dcd8-4794-bd2d-e24b6a8591fc None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:53.736062 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d664e1-b318-445c-8e75-75a76d5c52a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:53.736791 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d664e1-b318-445c-8e75-75a76d5c52a2 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:53.737712 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d664e1-b318-445c-8e75-75a76d5c52a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:53.737999 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d664e1-b318-445c-8e75-75a76d5c52a2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:53.739036 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d664e1-b318-445c-8e75-75a76d5c52a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:53.763991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d664e1-b318-445c-8e75-75a76d5c52a2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:53.765402 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 78/155] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:21:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:21:53.770343 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4ad58-bfca-4db3-87e3-00a5f654f075 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:53.778626 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4ad58-bfca-4db3-87e3-00a5f654f075 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:53.782479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6d1b7-9463-4475-8cd9-47ed243f2e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:53.783047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6d1b7-9463-4475-8cd9-47ed243f2e35 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:53.783338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6d1b7-9463-4475-8cd9-47ed243f2e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:53.783623 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6d1b7-9463-4475-8cd9-47ed243f2e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:53.784823 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6d1b7-9463-4475-8cd9-47ed243f2e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:53.810430 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6d1b7-9463-4475-8cd9-47ed243f2e35 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:53.902805 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 78/156] 10.222.0.20 () {60 vars in 1163 bytes} [Mon Aug 23 01:21:53 2021] POST /identity/v3/projects => generated 302 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:21:55.918411 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a527ca-dfa0-4bba-a665-a1b9109238f2 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:55.918930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a527ca-dfa0-4bba-a665-a1b9109238f2 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:55.919038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a527ca-dfa0-4bba-a665-a1b9109238f2 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:55.920674 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 79/157] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:55.926353 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c57dcf-20fc-4f4d-8903-9015fe684f4b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:55.926756 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c57dcf-20fc-4f4d-8903-9015fe684f4b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:55.926921 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c57dcf-20fc-4f4d-8903-9015fe684f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:55.948061 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-75c57dcf-20fc-4f4d-8903-9015fe684f4b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:55.949219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-75c57dcf-20fc-4f4d-8903-9015fe684f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:56.010091 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 79/158] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:56.032877 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a527ca-dfa0-4bba-a665-a1b9109238f2 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:56.044749 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a527ca-dfa0-4bba-a665-a1b9109238f2 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:56.048512 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787416d6-a6bc-4f14-9593-277e296e7078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:56.049246 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787416d6-a6bc-4f14-9593-277e296e7078 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:56.050160 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787416d6-a6bc-4f14-9593-277e296e7078 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:56.050444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787416d6-a6bc-4f14-9593-277e296e7078 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:56.051491 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787416d6-a6bc-4f14-9593-277e296e7078 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:56.076525 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787416d6-a6bc-4f14-9593-277e296e7078 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:56.077961 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 80/159] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:21:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:56.082805 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c57dcf-20fc-4f4d-8903-9015fe684f4b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:56.090989 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c57dcf-20fc-4f4d-8903-9015fe684f4b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:56.094818 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bf218-6ff3-42be-81fc-b64914cb7f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:56.095392 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bf218-6ff3-42be-81fc-b64914cb7f1f admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:56.095676 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bf218-6ff3-42be-81fc-b64914cb7f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:56.095951 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bf218-6ff3-42be-81fc-b64914cb7f1f admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:56.097122 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bf218-6ff3-42be-81fc-b64914cb7f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:56.122927 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bf218-6ff3-42be-81fc-b64914cb7f1f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:56.224475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 80/160] 10.222.0.20 () {60 vars in 1154 bytes} [Mon Aug 23 01:21:56 2021] POST /identity/v3/users => generated 283 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:21:58.170926 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5ce87-f702-46ff-9aa4-7bba3479cf0b None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:58.171419 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5ce87-f702-46ff-9aa4-7bba3479cf0b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:58.171506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5ce87-f702-46ff-9aa4-7bba3479cf0b None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:58.173182 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 81/161] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:21:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:21:58.178229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1ca33-de98-42d0-a00a-5949cade780e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:58.178595 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1ca33-de98-42d0-a00a-5949cade780e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:58.178793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1ca33-de98-42d0-a00a-5949cade780e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:58.200934 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-5eb1ca33-de98-42d0-a00a-5949cade780e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:21:58.202038 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-5eb1ca33-de98-42d0-a00a-5949cade780e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:21:58.209079 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 81/162] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:21:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:21:58.230661 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5ce87-f702-46ff-9aa4-7bba3479cf0b None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:58.241920 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5ce87-f702-46ff-9aa4-7bba3479cf0b None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:58.245717 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a380bf-ac7e-4379-a0e9-e61aa81337aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:58.246422 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a380bf-ac7e-4379-a0e9-e61aa81337aa admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:58.246704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a380bf-ac7e-4379-a0e9-e61aa81337aa admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:58.246981 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a380bf-ac7e-4379-a0e9-e61aa81337aa admin admin] PATH_INFO: `/v3/roles/member` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:58.259071 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a380bf-ac7e-4379-a0e9-e61aa81337aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:21:58.265283 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-c4a380bf-ac7e-4379-a0e9-e61aa81337aa admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 01:21:58.266318 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 82/163] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:21:58 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:21:58.272067 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1ca33-de98-42d0-a00a-5949cade780e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:58.280270 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1ca33-de98-42d0-a00a-5949cade780e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:58.284058 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072fd17-8f2d-48fd-b793-e8a6525a12f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:58.284665 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072fd17-8f2d-48fd-b793-e8a6525a12f3 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:58.284954 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072fd17-8f2d-48fd-b793-e8a6525a12f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:58.285231 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072fd17-8f2d-48fd-b793-e8a6525a12f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:58.285925 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072fd17-8f2d-48fd-b793-e8a6525a12f3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:58.286219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072fd17-8f2d-48fd-b793-e8a6525a12f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:58.310850 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072fd17-8f2d-48fd-b793-e8a6525a12f3 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:58.319521 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 82/164] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Aug 23 01:21:58 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:58.324475 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a380bf-ac7e-4379-a0e9-e61aa81337aa admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:58.334012 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a380bf-ac7e-4379-a0e9-e61aa81337aa admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:58.337922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ebb7f-ec74-4c27-9247-05974f3df83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:58.338676 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ebb7f-ec74-4c27-9247-05974f3df83c admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:58.338964 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ebb7f-ec74-4c27-9247-05974f3df83c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:58.339246 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ebb7f-ec74-4c27-9247-05974f3df83c admin admin] PATH_INFO: `/v3/users/6703011d24c7402bb8c2d3b4c9279b5b` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:58.357773 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ebb7f-ec74-4c27-9247-05974f3df83c admin admin] RBAC: Authorizing `identity:get_user(user_id=6703011d24c7402bb8c2d3b4c9279b5b)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:58.383804 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ebb7f-ec74-4c27-9247-05974f3df83c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:58.385312 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 83/165] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:21:58 2021] GET /identity/v3/users/6703011d24c7402bb8c2d3b4c9279b5b => generated 283 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:58.390498 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072fd17-8f2d-48fd-b793-e8a6525a12f3 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:58.400138 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072fd17-8f2d-48fd-b793-e8a6525a12f3 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:58.403978 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a901ed-83f9-487f-be7a-50df1312e0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:58.404543 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a901ed-83f9-487f-be7a-50df1312e0cb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:58.404860 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a901ed-83f9-487f-be7a-50df1312e0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:58.405146 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a901ed-83f9-487f-be7a-50df1312e0cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:58.412526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a901ed-83f9-487f-be7a-50df1312e0cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:58.437482 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a901ed-83f9-487f-be7a-50df1312e0cb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:58.446264 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 83/166] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:21:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:21:58.451620 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ebb7f-ec74-4c27-9247-05974f3df83c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:58.461234 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ebb7f-ec74-4c27-9247-05974f3df83c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:58.465065 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b968d2b-0a8f-482f-b831-5e70c14d076f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:58.465832 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b968d2b-0a8f-482f-b831-5e70c14d076f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:58.466122 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b968d2b-0a8f-482f-b831-5e70c14d076f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:58.466405 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b968d2b-0a8f-482f-b831-5e70c14d076f admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:58.467463 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b968d2b-0a8f-482f-b831-5e70c14d076f admin admin] RBAC: Authorizing `identity:get_project(project_id=d95c944d92ef4aebaa584978535338d1)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:58.493898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b968d2b-0a8f-482f-b831-5e70c14d076f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:58.495400 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 84/167] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:21:58 2021] GET /identity/v3/projects/d95c944d92ef4aebaa584978535338d1 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:21:58.501115 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a901ed-83f9-487f-be7a-50df1312e0cb admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:21:58.513262 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a901ed-83f9-487f-be7a-50df1312e0cb admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:21:58.517092 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb6480-30d8-4c59-ba7b-00a4842ab8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:21:58.517657 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb6480-30d8-4c59-ba7b-00a4842ab8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:21:58.517947 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb6480-30d8-4c59-ba7b-00a4842ab8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:21:58.518226 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb6480-30d8-4c59-ba7b-00a4842ab8d8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:21:58.518986 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb6480-30d8-4c59-ba7b-00a4842ab8d8 admin admin] RBAC: Adding query filter params (role.id=fafc5ecb5c074178be50f3c8d8006db2, scope.project.id=d95c944d92ef4aebaa584978535338d1, user.id=6703011d24c7402bb8c2d3b4c9279b5b) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:21:58.519284 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb6480-30d8-4c59-ba7b-00a4842ab8d8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:21:58.544268 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb6480-30d8-4c59-ba7b-00a4842ab8d8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:21:58.549908 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 84/168] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:21:58 2021] GET /identity/v3/role_assignments?user.id=6703011d24c7402bb8c2d3b4c9279b5b&scope.project.id=d95c944d92ef4aebaa584978535338d1&role.id=fafc5ecb5c074178be50f3c8d8006db2 => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:00.470091 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd39e1e-66ce-4b77-9bce-e57e8a03db1b None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:00.470586 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd39e1e-66ce-4b77-9bce-e57e8a03db1b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:00.470669 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd39e1e-66ce-4b77-9bce-e57e8a03db1b None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:00.472371 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 85/169] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:00.477602 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cf398-a8fb-40f7-a4e7-00a3f3d94a56 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:00.477969 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cf398-a8fb-40f7-a4e7-00a3f3d94a56 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:00.478166 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cf398-a8fb-40f7-a4e7-00a3f3d94a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:00.499951 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-dc9cf398-a8fb-40f7-a4e7-00a3f3d94a56 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:00.501085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-dc9cf398-a8fb-40f7-a4e7-00a3f3d94a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:00.507980 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 85/170] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:00.529872 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd39e1e-66ce-4b77-9bce-e57e8a03db1b None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:00.541369 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd39e1e-66ce-4b77-9bce-e57e8a03db1b None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:00.545207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a8c41-1768-4339-b4c3-72ced5966f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:00.545908 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a8c41-1768-4339-b4c3-72ced5966f93 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:00.546198 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a8c41-1768-4339-b4c3-72ced5966f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:00.546481 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a8c41-1768-4339-b4c3-72ced5966f93 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:00.557456 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a8c41-1768-4339-b4c3-72ced5966f93 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:00.563794 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-952a8c41-1768-4339-b4c3-72ced5966f93 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 01:22:00.565420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 86/171] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:22:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:00.570570 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cf398-a8fb-40f7-a4e7-00a3f3d94a56 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:00.578885 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cf398-a8fb-40f7-a4e7-00a3f3d94a56 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:00.583408 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b0ff3-5c51-4d0a-805d-b4e2b01d9103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:00.583988 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b0ff3-5c51-4d0a-805d-b4e2b01d9103 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:00.584278 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b0ff3-5c51-4d0a-805d-b4e2b01d9103 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:00.584557 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b0ff3-5c51-4d0a-805d-b4e2b01d9103 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:00.585281 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b0ff3-5c51-4d0a-805d-b4e2b01d9103 admin admin] RBAC: Adding query filter params (name=member) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:00.585578 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b0ff3-5c51-4d0a-805d-b4e2b01d9103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:00.610754 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b0ff3-5c51-4d0a-805d-b4e2b01d9103 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:00.619056 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 86/172] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Aug 23 01:22:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:22:00.623975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a8c41-1768-4339-b4c3-72ced5966f93 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:00.634204 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a8c41-1768-4339-b4c3-72ced5966f93 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:00.638303 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ade2b-9b06-49c6-93c7-020c082ae1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:00.639073 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ade2b-9b06-49c6-93c7-020c082ae1cc admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:00.639360 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ade2b-9b06-49c6-93c7-020c082ae1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:00.639641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ade2b-9b06-49c6-93c7-020c082ae1cc admin admin] PATH_INFO: `/v3/users/6703011d24c7402bb8c2d3b4c9279b5b` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:00.640736 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ade2b-9b06-49c6-93c7-020c082ae1cc admin admin] RBAC: Authorizing `identity:get_user(user_id=6703011d24c7402bb8c2d3b4c9279b5b)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:00.666699 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ade2b-9b06-49c6-93c7-020c082ae1cc admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:00.668063 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 87/173] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:22:00 2021] GET /identity/v3/users/6703011d24c7402bb8c2d3b4c9279b5b => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:22:00.672894 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b0ff3-5c51-4d0a-805d-b4e2b01d9103 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:00.681732 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b0ff3-5c51-4d0a-805d-b4e2b01d9103 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:00.685619 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a499362-02c6-4994-8fd4-f1ba8b171dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:00.686370 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a499362-02c6-4994-8fd4-f1ba8b171dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:00.686659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a499362-02c6-4994-8fd4-f1ba8b171dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:00.686943 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a499362-02c6-4994-8fd4-f1ba8b171dc9 admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:00.687986 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a499362-02c6-4994-8fd4-f1ba8b171dc9 admin admin] RBAC: Authorizing `identity:get_project(project_id=d95c944d92ef4aebaa584978535338d1)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:00.714296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a499362-02c6-4994-8fd4-f1ba8b171dc9 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:00.715753 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 87/174] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:00 2021] GET /identity/v3/projects/d95c944d92ef4aebaa584978535338d1 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:00.720494 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ade2b-9b06-49c6-93c7-020c082ae1cc admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:00.729752 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ade2b-9b06-49c6-93c7-020c082ae1cc admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:00.733774 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f9c73-edbd-4277-b219-542752600132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:00.734577 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f9c73-edbd-4277-b219-542752600132 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:00.734862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f9c73-edbd-4277-b219-542752600132 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:00.735144 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f9c73-edbd-4277-b219-542752600132 admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1/users/6703011d24c7402bb8c2d3b4c9279b5b/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:00.737458 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f9c73-edbd-4277-b219-542752600132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95c944d92ef4aebaa584978535338d1, user_id=6703011d24c7402bb8c2d3b4c9279b5b, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:00.764070 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f9c73-edbd-4277-b219-542752600132 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:00.846899 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 88/175] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:22:00 2021] PUT /identity/v3/projects/d95c944d92ef4aebaa584978535338d1/users/6703011d24c7402bb8c2d3b4c9279b5b/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:22:02.766087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3981c7f-8eb8-42d4-bce3-2475499ab98e None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:02.766569 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3981c7f-8eb8-42d4-bce3-2475499ab98e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:02.766569 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3981c7f-8eb8-42d4-bce3-2475499ab98e None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:02.768271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 88/176] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:02.773462 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3f31c-a454-47d5-85fd-df7121be5362 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:02.773886 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3f31c-a454-47d5-85fd-df7121be5362 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:02.774018 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3f31c-a454-47d5-85fd-df7121be5362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:02.796207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-29d3f31c-a454-47d5-85fd-df7121be5362 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:02.797348 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-29d3f31c-a454-47d5-85fd-df7121be5362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:02.858616 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 89/177] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:02.881060 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3981c7f-8eb8-42d4-bce3-2475499ab98e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:02.892387 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3981c7f-8eb8-42d4-bce3-2475499ab98e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:02.896170 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97862c23-494c-4c4d-89f0-3de3d07dc0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:02.896897 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97862c23-494c-4c4d-89f0-3de3d07dc0eb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:02.897184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97862c23-494c-4c4d-89f0-3de3d07dc0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:02.897463 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97862c23-494c-4c4d-89f0-3de3d07dc0eb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:02.909478 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97862c23-494c-4c4d-89f0-3de3d07dc0eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:02.915865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-97862c23-494c-4c4d-89f0-3de3d07dc0eb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 01:22:02.916954 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 89/178] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:22:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:02.922137 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3f31c-a454-47d5-85fd-df7121be5362 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:02.931062 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3f31c-a454-47d5-85fd-df7121be5362 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:02.934904 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd18b4-db24-4037-853f-be2e67628116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:02.935473 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd18b4-db24-4037-853f-be2e67628116 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:02.935757 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd18b4-db24-4037-853f-be2e67628116 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:02.936037 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd18b4-db24-4037-853f-be2e67628116 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:02.936771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd18b4-db24-4037-853f-be2e67628116 admin admin] RBAC: Adding query filter params (name=member) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:02.937070 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd18b4-db24-4037-853f-be2e67628116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:02.961976 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd18b4-db24-4037-853f-be2e67628116 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:02.970190 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 90/179] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Aug 23 01:22:02 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:02.975987 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97862c23-494c-4c4d-89f0-3de3d07dc0eb admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:02.984897 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97862c23-494c-4c4d-89f0-3de3d07dc0eb admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:02.989320 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66389632-4f02-4d96-89b2-89be446aaa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:02.990083 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66389632-4f02-4d96-89b2-89be446aaa58 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:02.990369 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66389632-4f02-4d96-89b2-89be446aaa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:02.990647 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66389632-4f02-4d96-89b2-89be446aaa58 admin admin] PATH_INFO: `/v3/users/6703011d24c7402bb8c2d3b4c9279b5b` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:02.991693 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66389632-4f02-4d96-89b2-89be446aaa58 admin admin] RBAC: Authorizing `identity:get_user(user_id=6703011d24c7402bb8c2d3b4c9279b5b)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:03.017479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66389632-4f02-4d96-89b2-89be446aaa58 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:03.019343 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 90/180] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:22:02 2021] GET /identity/v3/users/6703011d24c7402bb8c2d3b4c9279b5b => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:03.024260 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd18b4-db24-4037-853f-be2e67628116 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:03.033305 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd18b4-db24-4037-853f-be2e67628116 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:03.037776 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739e8d0-1426-4627-9888-eb683bcfe2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:03.038329 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739e8d0-1426-4627-9888-eb683bcfe2ba admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:03.038623 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739e8d0-1426-4627-9888-eb683bcfe2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:03.038922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739e8d0-1426-4627-9888-eb683bcfe2ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:03.046381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739e8d0-1426-4627-9888-eb683bcfe2ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:03.071344 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739e8d0-1426-4627-9888-eb683bcfe2ba admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:03.079522 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 91/181] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:22:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:22:03.084985 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66389632-4f02-4d96-89b2-89be446aaa58 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:03.093733 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66389632-4f02-4d96-89b2-89be446aaa58 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:03.098397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82153e97-9f44-4945-904f-f7d11a318a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:03.099134 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82153e97-9f44-4945-904f-f7d11a318a8b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:03.099414 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82153e97-9f44-4945-904f-f7d11a318a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:03.099686 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82153e97-9f44-4945-904f-f7d11a318a8b admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:03.100760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82153e97-9f44-4945-904f-f7d11a318a8b admin admin] RBAC: Authorizing `identity:get_project(project_id=d95c944d92ef4aebaa584978535338d1)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:03.125855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82153e97-9f44-4945-904f-f7d11a318a8b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:03.127309 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 91/182] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:03 2021] GET /identity/v3/projects/d95c944d92ef4aebaa584978535338d1 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:03.132632 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739e8d0-1426-4627-9888-eb683bcfe2ba admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:03.140701 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739e8d0-1426-4627-9888-eb683bcfe2ba admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:03.145085 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97489ab4-39c8-44ae-b387-ddfd7016e79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:03.145631 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97489ab4-39c8-44ae-b387-ddfd7016e79b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:03.145922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97489ab4-39c8-44ae-b387-ddfd7016e79b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:03.146206 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97489ab4-39c8-44ae-b387-ddfd7016e79b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:03.146962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97489ab4-39c8-44ae-b387-ddfd7016e79b admin admin] RBAC: Adding query filter params (role.id=fafc5ecb5c074178be50f3c8d8006db2, scope.project.id=d95c944d92ef4aebaa584978535338d1, user.id=6703011d24c7402bb8c2d3b4c9279b5b) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:03.147266 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97489ab4-39c8-44ae-b387-ddfd7016e79b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:03.172383 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97489ab4-39c8-44ae-b387-ddfd7016e79b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:03.178429 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 92/183] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:22:03 2021] GET /identity/v3/role_assignments?user.id=6703011d24c7402bb8c2d3b4c9279b5b&scope.project.id=d95c944d92ef4aebaa584978535338d1&role.id=fafc5ecb5c074178be50f3c8d8006db2 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:05.136541 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340204b7-3ea3-4801-a271-33a11287fdad None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:05.137184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340204b7-3ea3-4801-a271-33a11287fdad None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:05.137184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340204b7-3ea3-4801-a271-33a11287fdad None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:05.138794 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 92/184] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:05.143756 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca810046-eaa3-42bc-b7ec-27e89253b165 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:05.144181 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca810046-eaa3-42bc-b7ec-27e89253b165 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:05.144325 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca810046-eaa3-42bc-b7ec-27e89253b165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:05.166747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-ca810046-eaa3-42bc-b7ec-27e89253b165 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:05.167896 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-ca810046-eaa3-42bc-b7ec-27e89253b165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:05.175025 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 93/185] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:05.196612 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340204b7-3ea3-4801-a271-33a11287fdad None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:05.207972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340204b7-3ea3-4801-a271-33a11287fdad None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:05.211727 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4d239-5d18-4286-93d0-4531d433e707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:05.212427 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d239-5d18-4286-93d0-4531d433e707 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:05.212751 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d239-5d18-4286-93d0-4531d433e707 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:05.213036 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d239-5d18-4286-93d0-4531d433e707 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:05.224760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4d239-5d18-4286-93d0-4531d433e707 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:05.230947 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-a5d4d239-5d18-4286-93d0-4531d433e707 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:22:05.232000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 93/186] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:22:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:05.237715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca810046-eaa3-42bc-b7ec-27e89253b165 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:05.246044 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca810046-eaa3-42bc-b7ec-27e89253b165 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:05.250104 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828288a0-f7a8-48af-b4ad-e98f71ce7735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:05.250696 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828288a0-f7a8-48af-b4ad-e98f71ce7735 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:05.250983 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828288a0-f7a8-48af-b4ad-e98f71ce7735 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:05.251263 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828288a0-f7a8-48af-b4ad-e98f71ce7735 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:05.251967 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828288a0-f7a8-48af-b4ad-e98f71ce7735 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:05.252265 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828288a0-f7a8-48af-b4ad-e98f71ce7735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:05.277757 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828288a0-f7a8-48af-b4ad-e98f71ce7735 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:05.286733 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 94/187] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:22:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:05.291657 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4d239-5d18-4286-93d0-4531d433e707 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:05.301546 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4d239-5d18-4286-93d0-4531d433e707 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:05.305328 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027ecb0-9ae9-4b31-b9e1-d75a0a0fa11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:05.306078 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027ecb0-9ae9-4b31-b9e1-d75a0a0fa11b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:05.306362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027ecb0-9ae9-4b31-b9e1-d75a0a0fa11b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:05.306640 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027ecb0-9ae9-4b31-b9e1-d75a0a0fa11b admin admin] PATH_INFO: `/v3/users/f126ecc3e0554a38839d919cf3fec6e7` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:05.307686 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027ecb0-9ae9-4b31-b9e1-d75a0a0fa11b admin admin] RBAC: Authorizing `identity:get_user(user_id=f126ecc3e0554a38839d919cf3fec6e7)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:05.335155 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027ecb0-9ae9-4b31-b9e1-d75a0a0fa11b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:05.336606 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 94/188] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:22:05 2021] GET /identity/v3/users/f126ecc3e0554a38839d919cf3fec6e7 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:05.341647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828288a0-f7a8-48af-b4ad-e98f71ce7735 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:05.351453 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828288a0-f7a8-48af-b4ad-e98f71ce7735 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:05.355220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a42c1-2758-4a82-a5dd-a38876495c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:05.355770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a42c1-2758-4a82-a5dd-a38876495c4f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:05.356054 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a42c1-2758-4a82-a5dd-a38876495c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:05.356327 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a42c1-2758-4a82-a5dd-a38876495c4f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:05.363751 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a42c1-2758-4a82-a5dd-a38876495c4f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:05.388802 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a42c1-2758-4a82-a5dd-a38876495c4f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:05.398172 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 95/189] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:22:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:22:05.403277 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027ecb0-9ae9-4b31-b9e1-d75a0a0fa11b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:05.412935 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027ecb0-9ae9-4b31-b9e1-d75a0a0fa11b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:05.416694 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c843ead-40bd-4a0e-b1d1-0eb4f01a0416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:05.417478 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c843ead-40bd-4a0e-b1d1-0eb4f01a0416 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:05.417733 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c843ead-40bd-4a0e-b1d1-0eb4f01a0416 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:05.418010 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c843ead-40bd-4a0e-b1d1-0eb4f01a0416 admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:05.419054 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c843ead-40bd-4a0e-b1d1-0eb4f01a0416 admin admin] RBAC: Authorizing `identity:get_project(project_id=d95c944d92ef4aebaa584978535338d1)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:05.444363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c843ead-40bd-4a0e-b1d1-0eb4f01a0416 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:05.445908 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 95/190] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:05 2021] GET /identity/v3/projects/d95c944d92ef4aebaa584978535338d1 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:05.451540 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a42c1-2758-4a82-a5dd-a38876495c4f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:05.460510 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a42c1-2758-4a82-a5dd-a38876495c4f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:05.464418 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0bb4d-dd61-4f9e-9003-bae8432579e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:05.465017 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0bb4d-dd61-4f9e-9003-bae8432579e5 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:05.465306 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0bb4d-dd61-4f9e-9003-bae8432579e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:05.465584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0bb4d-dd61-4f9e-9003-bae8432579e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:05.466347 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0bb4d-dd61-4f9e-9003-bae8432579e5 admin admin] RBAC: Adding query filter params (role.id=56d36413cf4047229b6f9d36a3990b0d, scope.project.id=d95c944d92ef4aebaa584978535338d1, user.id=f126ecc3e0554a38839d919cf3fec6e7) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:05.466647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0bb4d-dd61-4f9e-9003-bae8432579e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:05.492730 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0bb4d-dd61-4f9e-9003-bae8432579e5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:05.497877 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 96/191] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:22:05 2021] GET /identity/v3/role_assignments?user.id=f126ecc3e0554a38839d919cf3fec6e7&scope.project.id=d95c944d92ef4aebaa584978535338d1&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:07.414145 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e4d42-73df-4316-9bab-db82fa971eb5 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:07.414526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e4d42-73df-4316-9bab-db82fa971eb5 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:07.414652 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e4d42-73df-4316-9bab-db82fa971eb5 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:07.416317 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 96/192] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:07.421394 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f98a7-1430-4017-97d0-37a2e8823566 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:07.423305 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f98a7-1430-4017-97d0-37a2e8823566 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:07.423305 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f98a7-1430-4017-97d0-37a2e8823566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:07.444739 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-a02f98a7-1430-4017-97d0-37a2e8823566 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:07.445880 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a02f98a7-1430-4017-97d0-37a2e8823566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:07.452512 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 97/193] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:07.474770 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e4d42-73df-4316-9bab-db82fa971eb5 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:07.486084 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e4d42-73df-4316-9bab-db82fa971eb5 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:07.490477 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f30f0f-08e9-4590-b5b4-51500443c53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:07.491178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f30f0f-08e9-4590-b5b4-51500443c53f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:07.491470 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f30f0f-08e9-4590-b5b4-51500443c53f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:07.491752 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f30f0f-08e9-4590-b5b4-51500443c53f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:07.503272 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f30f0f-08e9-4590-b5b4-51500443c53f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:07.509483 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-70f30f0f-08e9-4590-b5b4-51500443c53f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:22:07.510542 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 97/194] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:22:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:07.515738 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f98a7-1430-4017-97d0-37a2e8823566 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:07.524058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f98a7-1430-4017-97d0-37a2e8823566 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:07.527882 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3d78e-36c3-4c18-9188-28eead1b92b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:07.528457 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3d78e-36c3-4c18-9188-28eead1b92b8 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:07.528771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3d78e-36c3-4c18-9188-28eead1b92b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:07.529052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3d78e-36c3-4c18-9188-28eead1b92b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:07.529754 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3d78e-36c3-4c18-9188-28eead1b92b8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:07.530058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3d78e-36c3-4c18-9188-28eead1b92b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:07.555719 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3d78e-36c3-4c18-9188-28eead1b92b8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:07.564037 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 98/195] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:22:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:07.569732 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f30f0f-08e9-4590-b5b4-51500443c53f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:07.579562 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f30f0f-08e9-4590-b5b4-51500443c53f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:07.583419 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8b51b-94c7-4fa3-a07f-b3991c961d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:07.584183 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8b51b-94c7-4fa3-a07f-b3991c961d6a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:07.584471 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8b51b-94c7-4fa3-a07f-b3991c961d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:07.584790 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8b51b-94c7-4fa3-a07f-b3991c961d6a admin admin] PATH_INFO: `/v3/users/f126ecc3e0554a38839d919cf3fec6e7` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:07.585850 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8b51b-94c7-4fa3-a07f-b3991c961d6a admin admin] RBAC: Authorizing `identity:get_user(user_id=f126ecc3e0554a38839d919cf3fec6e7)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:07.611037 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8b51b-94c7-4fa3-a07f-b3991c961d6a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:07.612993 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 98/196] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:22:07 2021] GET /identity/v3/users/f126ecc3e0554a38839d919cf3fec6e7 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:07.617669 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3d78e-36c3-4c18-9188-28eead1b92b8 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:07.626414 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3d78e-36c3-4c18-9188-28eead1b92b8 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:07.630340 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d34ed-49ac-4cd4-b747-a855c0c87c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:07.631093 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d34ed-49ac-4cd4-b747-a855c0c87c2a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:07.631380 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d34ed-49ac-4cd4-b747-a855c0c87c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:07.631662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d34ed-49ac-4cd4-b747-a855c0c87c2a admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:07.632738 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d34ed-49ac-4cd4-b747-a855c0c87c2a admin admin] RBAC: Authorizing `identity:get_project(project_id=d95c944d92ef4aebaa584978535338d1)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:07.659164 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d34ed-49ac-4cd4-b747-a855c0c87c2a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:07.660637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 99/197] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:07 2021] GET /identity/v3/projects/d95c944d92ef4aebaa584978535338d1 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:22:07.665564 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8b51b-94c7-4fa3-a07f-b3991c961d6a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:07.674424 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8b51b-94c7-4fa3-a07f-b3991c961d6a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:07.678236 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105fe63-a5fc-477c-ac0a-b3f532d5799c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:07.679017 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105fe63-a5fc-477c-ac0a-b3f532d5799c admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:07.679304 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105fe63-a5fc-477c-ac0a-b3f532d5799c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:07.679584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105fe63-a5fc-477c-ac0a-b3f532d5799c admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1/users/f126ecc3e0554a38839d919cf3fec6e7/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:07.681277 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105fe63-a5fc-477c-ac0a-b3f532d5799c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95c944d92ef4aebaa584978535338d1, user_id=f126ecc3e0554a38839d919cf3fec6e7, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:07.707773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105fe63-a5fc-477c-ac0a-b3f532d5799c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:07.794414 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 99/198] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:22:07 2021] PUT /identity/v3/projects/d95c944d92ef4aebaa584978535338d1/users/f126ecc3e0554a38839d919cf3fec6e7/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:22:09.733263 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaacd3-3492-4aa1-9f4c-207e8a7fc615 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:09.733758 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaacd3-3492-4aa1-9f4c-207e8a7fc615 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:09.733758 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaacd3-3492-4aa1-9f4c-207e8a7fc615 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:09.735414 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 100/199] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:09.741107 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a519f1-afa3-41e4-b4db-04bec55c0c0e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:09.741468 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a519f1-afa3-41e4-b4db-04bec55c0c0e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:09.741682 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a519f1-afa3-41e4-b4db-04bec55c0c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:09.763498 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-09a519f1-afa3-41e4-b4db-04bec55c0c0e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:09.764648 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-09a519f1-afa3-41e4-b4db-04bec55c0c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:09.827899 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 100/200] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:09.851163 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaacd3-3492-4aa1-9f4c-207e8a7fc615 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:09.862552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaacd3-3492-4aa1-9f4c-207e8a7fc615 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:09.866338 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72673d5-b1d2-4f1b-95ac-c332c173b298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:09.867038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72673d5-b1d2-4f1b-95ac-c332c173b298 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:09.867323 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72673d5-b1d2-4f1b-95ac-c332c173b298 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:09.867599 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72673d5-b1d2-4f1b-95ac-c332c173b298 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:09.879217 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72673d5-b1d2-4f1b-95ac-c332c173b298 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:09.885377 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-a72673d5-b1d2-4f1b-95ac-c332c173b298 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:22:09.886431 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 101/201] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:22:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:09.891822 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a519f1-afa3-41e4-b4db-04bec55c0c0e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:09.900813 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a519f1-afa3-41e4-b4db-04bec55c0c0e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:09.904732 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3919c-5031-4d23-b58c-d79d70f143c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:09.905318 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3919c-5031-4d23-b58c-d79d70f143c8 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:09.905607 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3919c-5031-4d23-b58c-d79d70f143c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:09.905887 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3919c-5031-4d23-b58c-d79d70f143c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:09.906592 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3919c-5031-4d23-b58c-d79d70f143c8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:09.906893 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3919c-5031-4d23-b58c-d79d70f143c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:09.932399 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3919c-5031-4d23-b58c-d79d70f143c8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:09.940724 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 101/202] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:22:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:09.945765 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72673d5-b1d2-4f1b-95ac-c332c173b298 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:09.954768 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72673d5-b1d2-4f1b-95ac-c332c173b298 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:09.959162 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204256f-55d8-413d-aba0-0eea214da10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:09.959921 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204256f-55d8-413d-aba0-0eea214da10c admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:09.960209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204256f-55d8-413d-aba0-0eea214da10c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:09.960486 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204256f-55d8-413d-aba0-0eea214da10c admin admin] PATH_INFO: `/v3/users/f126ecc3e0554a38839d919cf3fec6e7` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:09.961578 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204256f-55d8-413d-aba0-0eea214da10c admin admin] RBAC: Authorizing `identity:get_user(user_id=f126ecc3e0554a38839d919cf3fec6e7)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:09.987751 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204256f-55d8-413d-aba0-0eea214da10c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:09.989190 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 102/203] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:22:09 2021] GET /identity/v3/users/f126ecc3e0554a38839d919cf3fec6e7 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:09.994190 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3919c-5031-4d23-b58c-d79d70f143c8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:10.003149 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3919c-5031-4d23-b58c-d79d70f143c8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:10.007016 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095972ae-bd19-4491-9425-70e539f09f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:10.007581 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095972ae-bd19-4491-9425-70e539f09f35 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:10.007873 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095972ae-bd19-4491-9425-70e539f09f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:10.008156 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095972ae-bd19-4491-9425-70e539f09f35 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:10.015621 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095972ae-bd19-4491-9425-70e539f09f35 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:10.041609 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095972ae-bd19-4491-9425-70e539f09f35 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:10.049829 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 102/204] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:22:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:22:10.054976 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204256f-55d8-413d-aba0-0eea214da10c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:10.063926 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204256f-55d8-413d-aba0-0eea214da10c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:10.067756 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85638271-3718-41e5-9f48-5a2c6521b999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:10.068489 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85638271-3718-41e5-9f48-5a2c6521b999 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:10.068808 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85638271-3718-41e5-9f48-5a2c6521b999 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:10.069084 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85638271-3718-41e5-9f48-5a2c6521b999 admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:10.070109 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85638271-3718-41e5-9f48-5a2c6521b999 admin admin] RBAC: Authorizing `identity:get_project(project_id=d95c944d92ef4aebaa584978535338d1)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:10.096792 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85638271-3718-41e5-9f48-5a2c6521b999 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:10.098483 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 103/205] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:10 2021] GET /identity/v3/projects/d95c944d92ef4aebaa584978535338d1 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:22:10.103615 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095972ae-bd19-4491-9425-70e539f09f35 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:10.111752 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095972ae-bd19-4491-9425-70e539f09f35 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:10.115604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad01ac5-15c7-4773-abda-aaadb848ea0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:10.116156 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad01ac5-15c7-4773-abda-aaadb848ea0f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:10.116443 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad01ac5-15c7-4773-abda-aaadb848ea0f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:10.116760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad01ac5-15c7-4773-abda-aaadb848ea0f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:10.117515 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad01ac5-15c7-4773-abda-aaadb848ea0f admin admin] RBAC: Adding query filter params (role.id=56d36413cf4047229b6f9d36a3990b0d, scope.project.id=d95c944d92ef4aebaa584978535338d1, user.id=f126ecc3e0554a38839d919cf3fec6e7) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:10.117815 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad01ac5-15c7-4773-abda-aaadb848ea0f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:10.154509 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad01ac5-15c7-4773-abda-aaadb848ea0f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:10.163757 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 103/206] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:22:10 2021] GET /identity/v3/role_assignments?user.id=f126ecc3e0554a38839d919cf3fec6e7&scope.project.id=d95c944d92ef4aebaa584978535338d1&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 608 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:12.149850 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e7665-6173-461e-9b1f-e26d23f9c52a None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:12.150355 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e7665-6173-461e-9b1f-e26d23f9c52a None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:12.150437 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e7665-6173-461e-9b1f-e26d23f9c52a None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:12.152087 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 104/207] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:12.157285 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74524179-d065-4355-8cc3-1597f0ed7718 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:12.157648 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74524179-d065-4355-8cc3-1597f0ed7718 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:12.157855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74524179-d065-4355-8cc3-1597f0ed7718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:12.180265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-74524179-d065-4355-8cc3-1597f0ed7718 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:12.181441 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-74524179-d065-4355-8cc3-1597f0ed7718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:12.187934 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 104/208] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:12.210475 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e7665-6173-461e-9b1f-e26d23f9c52a None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:12.222489 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e7665-6173-461e-9b1f-e26d23f9c52a None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:12.226544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f27597-a52f-4911-83bb-8aa52cbac94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:12.227254 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f27597-a52f-4911-83bb-8aa52cbac94c admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:12.227544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f27597-a52f-4911-83bb-8aa52cbac94c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:12.227827 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f27597-a52f-4911-83bb-8aa52cbac94c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:12.238861 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f27597-a52f-4911-83bb-8aa52cbac94c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:12.245516 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-37f27597-a52f-4911-83bb-8aa52cbac94c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 01:22:12.246579 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 105/209] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:22:12 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:12.251764 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74524179-d065-4355-8cc3-1597f0ed7718 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:12.260097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74524179-d065-4355-8cc3-1597f0ed7718 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:12.263983 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0840d-3eba-4f7e-bb7e-fe22f6b46a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:12.264581 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0840d-3eba-4f7e-bb7e-fe22f6b46a2e admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:12.264889 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0840d-3eba-4f7e-bb7e-fe22f6b46a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:12.265176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0840d-3eba-4f7e-bb7e-fe22f6b46a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:12.265876 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0840d-3eba-4f7e-bb7e-fe22f6b46a2e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:12.266175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0840d-3eba-4f7e-bb7e-fe22f6b46a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:12.292207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0840d-3eba-4f7e-bb7e-fe22f6b46a2e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:12.300348 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 105/210] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:22:12 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:22:12.305357 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f27597-a52f-4911-83bb-8aa52cbac94c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:12.316754 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f27597-a52f-4911-83bb-8aa52cbac94c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:12.320606 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f0287-f0b8-42cb-9f3c-dc5182b61b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:12.321373 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f0287-f0b8-42cb-9f3c-dc5182b61b7b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:12.321660 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f0287-f0b8-42cb-9f3c-dc5182b61b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:12.321937 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f0287-f0b8-42cb-9f3c-dc5182b61b7b admin admin] PATH_INFO: `/v3/users/6703011d24c7402bb8c2d3b4c9279b5b` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:12.322990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f0287-f0b8-42cb-9f3c-dc5182b61b7b admin admin] RBAC: Authorizing `identity:get_user(user_id=6703011d24c7402bb8c2d3b4c9279b5b)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:12.349556 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f0287-f0b8-42cb-9f3c-dc5182b61b7b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:12.350975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 106/211] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:22:12 2021] GET /identity/v3/users/6703011d24c7402bb8c2d3b4c9279b5b => generated 283 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:12.355800 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0840d-3eba-4f7e-bb7e-fe22f6b46a2e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:12.364617 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0840d-3eba-4f7e-bb7e-fe22f6b46a2e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:12.368486 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acb3f3-3973-4ceb-995d-b698187109a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:12.369069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acb3f3-3973-4ceb-995d-b698187109a1 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:12.369360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acb3f3-3973-4ceb-995d-b698187109a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:12.369645 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acb3f3-3973-4ceb-995d-b698187109a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:12.377688 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acb3f3-3973-4ceb-995d-b698187109a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:12.403217 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acb3f3-3973-4ceb-995d-b698187109a1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:12.412039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 106/212] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:22:12 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:22:12.417969 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f0287-f0b8-42cb-9f3c-dc5182b61b7b admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:12.426892 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f0287-f0b8-42cb-9f3c-dc5182b61b7b admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:12.430723 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc3a0b-3c6f-488d-9117-65ffb2a63b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:12.431486 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc3a0b-3c6f-488d-9117-65ffb2a63b87 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:12.431771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc3a0b-3c6f-488d-9117-65ffb2a63b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:12.432047 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc3a0b-3c6f-488d-9117-65ffb2a63b87 admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:12.433108 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc3a0b-3c6f-488d-9117-65ffb2a63b87 admin admin] RBAC: Authorizing `identity:get_project(project_id=d95c944d92ef4aebaa584978535338d1)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:12.459508 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc3a0b-3c6f-488d-9117-65ffb2a63b87 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:12.461044 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 107/213] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:12 2021] GET /identity/v3/projects/d95c944d92ef4aebaa584978535338d1 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:12.467727 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acb3f3-3973-4ceb-995d-b698187109a1 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:12.476963 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acb3f3-3973-4ceb-995d-b698187109a1 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:12.480994 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62a3bf-67a7-43f6-9081-fa596cc8f53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:12.481721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62a3bf-67a7-43f6-9081-fa596cc8f53d admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:12.482011 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62a3bf-67a7-43f6-9081-fa596cc8f53d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:12.482295 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62a3bf-67a7-43f6-9081-fa596cc8f53d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:12.483063 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62a3bf-67a7-43f6-9081-fa596cc8f53d admin admin] RBAC: Adding query filter params (role.id=1d347df28134487288d9c4a0c6451cb3, scope.project.id=d95c944d92ef4aebaa584978535338d1, user.id=6703011d24c7402bb8c2d3b4c9279b5b) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:12.483366 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62a3bf-67a7-43f6-9081-fa596cc8f53d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:12.509315 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62a3bf-67a7-43f6-9081-fa596cc8f53d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:12.514577 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 107/214] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:22:12 2021] GET /identity/v3/role_assignments?user.id=6703011d24c7402bb8c2d3b4c9279b5b&scope.project.id=d95c944d92ef4aebaa584978535338d1&role.id=1d347df28134487288d9c4a0c6451cb3 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:22:14.439548 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161ab18-89e2-4b91-9b60-d5dbcbc874ec None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:14.439968 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161ab18-89e2-4b91-9b60-d5dbcbc874ec None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:14.448555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161ab18-89e2-4b91-9b60-d5dbcbc874ec None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:14.448555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 108/215] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:14.448757 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a614c4b-b01d-477c-9f98-4276503f655c None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:14.448757 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a614c4b-b01d-477c-9f98-4276503f655c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:14.448757 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a614c4b-b01d-477c-9f98-4276503f655c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:14.469855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-7a614c4b-b01d-477c-9f98-4276503f655c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:14.471633 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-7a614c4b-b01d-477c-9f98-4276503f655c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:14.478338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 108/216] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:14.499644 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161ab18-89e2-4b91-9b60-d5dbcbc874ec None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:14.510870 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161ab18-89e2-4b91-9b60-d5dbcbc874ec None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:14.514855 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf62f6-0132-47b8-8d5b-cc199433e20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:14.515579 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf62f6-0132-47b8-8d5b-cc199433e20a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:14.515866 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf62f6-0132-47b8-8d5b-cc199433e20a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:14.516147 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf62f6-0132-47b8-8d5b-cc199433e20a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:14.528038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf62f6-0132-47b8-8d5b-cc199433e20a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:14.535335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-0bbf62f6-0132-47b8-8d5b-cc199433e20a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 01:22:14.536387 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 109/217] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:22:14 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:14.541490 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a614c4b-b01d-477c-9f98-4276503f655c None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:14.549902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a614c4b-b01d-477c-9f98-4276503f655c None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:14.553827 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb4156-2b27-4392-bcfa-be9ea0e511b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:14.554430 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb4156-2b27-4392-bcfa-be9ea0e511b0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:14.554720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb4156-2b27-4392-bcfa-be9ea0e511b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:14.555000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb4156-2b27-4392-bcfa-be9ea0e511b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:14.555730 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb4156-2b27-4392-bcfa-be9ea0e511b0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:14.556027 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb4156-2b27-4392-bcfa-be9ea0e511b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:14.581461 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb4156-2b27-4392-bcfa-be9ea0e511b0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:14.589575 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 109/218] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:22:14 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:22:14.594766 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf62f6-0132-47b8-8d5b-cc199433e20a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:14.605395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf62f6-0132-47b8-8d5b-cc199433e20a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:14.609231 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78222a83-7580-4eb3-991d-498879418326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:14.609987 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78222a83-7580-4eb3-991d-498879418326 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:14.610269 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78222a83-7580-4eb3-991d-498879418326 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:14.610545 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78222a83-7580-4eb3-991d-498879418326 admin admin] PATH_INFO: `/v3/users/6703011d24c7402bb8c2d3b4c9279b5b` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:14.611589 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78222a83-7580-4eb3-991d-498879418326 admin admin] RBAC: Authorizing `identity:get_user(user_id=6703011d24c7402bb8c2d3b4c9279b5b)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:14.637413 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78222a83-7580-4eb3-991d-498879418326 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:14.638815 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 110/219] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:22:14 2021] GET /identity/v3/users/6703011d24c7402bb8c2d3b4c9279b5b => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:14.644249 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb4156-2b27-4392-bcfa-be9ea0e511b0 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:14.653034 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb4156-2b27-4392-bcfa-be9ea0e511b0 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:14.656918 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b86f42-a286-4ed3-ab14-2455b5d4d703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:14.657671 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b86f42-a286-4ed3-ab14-2455b5d4d703 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:14.657959 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b86f42-a286-4ed3-ab14-2455b5d4d703 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:14.658240 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b86f42-a286-4ed3-ab14-2455b5d4d703 admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:14.659293 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b86f42-a286-4ed3-ab14-2455b5d4d703 admin admin] RBAC: Authorizing `identity:get_project(project_id=d95c944d92ef4aebaa584978535338d1)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:14.684438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b86f42-a286-4ed3-ab14-2455b5d4d703 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:14.685863 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 110/220] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:14 2021] GET /identity/v3/projects/d95c944d92ef4aebaa584978535338d1 => generated 302 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:14.691121 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78222a83-7580-4eb3-991d-498879418326 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:14.699896 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78222a83-7580-4eb3-991d-498879418326 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:14.703668 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bebe0-f12b-4dce-88d2-c337f41db053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:14.704429 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bebe0-f12b-4dce-88d2-c337f41db053 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:14.704754 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bebe0-f12b-4dce-88d2-c337f41db053 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:14.705644 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bebe0-f12b-4dce-88d2-c337f41db053 admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1/users/6703011d24c7402bb8c2d3b4c9279b5b/roles/1d347df28134487288d9c4a0c6451cb3` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:14.707530 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bebe0-f12b-4dce-88d2-c337f41db053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95c944d92ef4aebaa584978535338d1, user_id=6703011d24c7402bb8c2d3b4c9279b5b, role_id=1d347df28134487288d9c4a0c6451cb3)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:14.733636 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bebe0-f12b-4dce-88d2-c337f41db053 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:14.794349 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 111/221] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:22:14 2021] PUT /identity/v3/projects/d95c944d92ef4aebaa584978535338d1/users/6703011d24c7402bb8c2d3b4c9279b5b/roles/1d347df28134487288d9c4a0c6451cb3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:22:16.693736 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92622649-d8c2-4189-ad09-3c835a9ca082 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:16.694220 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92622649-d8c2-4189-ad09-3c835a9ca082 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:16.694220 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92622649-d8c2-4189-ad09-3c835a9ca082 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:16.695892 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 111/222] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:16.701008 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acb065-db82-489e-a898-55cc2ba20c69 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:16.701380 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acb065-db82-489e-a898-55cc2ba20c69 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:16.701578 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acb065-db82-489e-a898-55cc2ba20c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:16.724686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-34acb065-db82-489e-a898-55cc2ba20c69 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:16.725814 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-34acb065-db82-489e-a898-55cc2ba20c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:16.787429 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 112/223] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:16.809416 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92622649-d8c2-4189-ad09-3c835a9ca082 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:16.820716 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92622649-d8c2-4189-ad09-3c835a9ca082 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:16.824520 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5b2d4-ef4f-4c1d-a57d-45cc28dcd148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:16.825262 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5b2d4-ef4f-4c1d-a57d-45cc28dcd148 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:16.825552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5b2d4-ef4f-4c1d-a57d-45cc28dcd148 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:16.825834 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5b2d4-ef4f-4c1d-a57d-45cc28dcd148 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:16.837993 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5b2d4-ef4f-4c1d-a57d-45cc28dcd148 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:16.844712 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-22d5b2d4-ef4f-4c1d-a57d-45cc28dcd148 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 01:22:16.846407 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 112/224] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:22:16 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:16.851798 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acb065-db82-489e-a898-55cc2ba20c69 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:16.860067 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acb065-db82-489e-a898-55cc2ba20c69 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:16.864019 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f77e26-8296-4f8e-86f4-cdc5963030f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:16.864619 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f77e26-8296-4f8e-86f4-cdc5963030f3 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:16.864912 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f77e26-8296-4f8e-86f4-cdc5963030f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:16.865203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f77e26-8296-4f8e-86f4-cdc5963030f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:16.865904 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f77e26-8296-4f8e-86f4-cdc5963030f3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:16.866204 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f77e26-8296-4f8e-86f4-cdc5963030f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:16.891644 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f77e26-8296-4f8e-86f4-cdc5963030f3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:16.900362 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 113/225] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:22:16 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:16.905276 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5b2d4-ef4f-4c1d-a57d-45cc28dcd148 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:16.914481 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5b2d4-ef4f-4c1d-a57d-45cc28dcd148 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:16.918352 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6440f-ffd4-4722-825b-daeaec1a83e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:16.919118 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6440f-ffd4-4722-825b-daeaec1a83e0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:16.919406 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6440f-ffd4-4722-825b-daeaec1a83e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:16.919689 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6440f-ffd4-4722-825b-daeaec1a83e0 admin admin] PATH_INFO: `/v3/users/6703011d24c7402bb8c2d3b4c9279b5b` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:16.920786 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6440f-ffd4-4722-825b-daeaec1a83e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=6703011d24c7402bb8c2d3b4c9279b5b)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:16.946603 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6440f-ffd4-4722-825b-daeaec1a83e0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:16.947963 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 113/226] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:22:16 2021] GET /identity/v3/users/6703011d24c7402bb8c2d3b4c9279b5b => generated 283 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:22:16.953028 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f77e26-8296-4f8e-86f4-cdc5963030f3 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:16.962686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f77e26-8296-4f8e-86f4-cdc5963030f3 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:16.966603 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13cbea-8939-4af9-8d39-b43cc43880ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:16.967155 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13cbea-8939-4af9-8d39-b43cc43880ef admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:16.967443 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13cbea-8939-4af9-8d39-b43cc43880ef admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:16.967728 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13cbea-8939-4af9-8d39-b43cc43880ef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:16.975495 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13cbea-8939-4af9-8d39-b43cc43880ef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:17.000469 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13cbea-8939-4af9-8d39-b43cc43880ef admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:17.009310 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 114/227] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:22:16 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:22:17.014301 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6440f-ffd4-4722-825b-daeaec1a83e0 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:17.023671 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6440f-ffd4-4722-825b-daeaec1a83e0 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:17.027517 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823e0b1-f6c9-424c-bc27-5ff8bc63288e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:17.028267 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823e0b1-f6c9-424c-bc27-5ff8bc63288e admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:17.028578 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823e0b1-f6c9-424c-bc27-5ff8bc63288e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:17.028869 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823e0b1-f6c9-424c-bc27-5ff8bc63288e admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:17.029918 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823e0b1-f6c9-424c-bc27-5ff8bc63288e admin admin] RBAC: Authorizing `identity:get_project(project_id=d95c944d92ef4aebaa584978535338d1)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:17.055027 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823e0b1-f6c9-424c-bc27-5ff8bc63288e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:17.056497 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 114/228] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:17 2021] GET /identity/v3/projects/d95c944d92ef4aebaa584978535338d1 => generated 302 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:17.061757 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13cbea-8939-4af9-8d39-b43cc43880ef admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:17.070420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13cbea-8939-4af9-8d39-b43cc43880ef admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:17.074288 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0a9da-0c8c-40da-8ba1-2a5a8be8e070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:17.074834 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0a9da-0c8c-40da-8ba1-2a5a8be8e070 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:17.075117 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0a9da-0c8c-40da-8ba1-2a5a8be8e070 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:17.075391 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0a9da-0c8c-40da-8ba1-2a5a8be8e070 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:17.076135 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0a9da-0c8c-40da-8ba1-2a5a8be8e070 admin admin] RBAC: Adding query filter params (role.id=1d347df28134487288d9c4a0c6451cb3, scope.project.id=d95c944d92ef4aebaa584978535338d1, user.id=6703011d24c7402bb8c2d3b4c9279b5b) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:17.076431 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0a9da-0c8c-40da-8ba1-2a5a8be8e070 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:17.102430 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0a9da-0c8c-40da-8ba1-2a5a8be8e070 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:17.107899 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 115/229] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:22:17 2021] GET /identity/v3/role_assignments?user.id=6703011d24c7402bb8c2d3b4c9279b5b&scope.project.id=d95c944d92ef4aebaa584978535338d1&role.id=1d347df28134487288d9c4a0c6451cb3 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:19.039693 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dc0a3-db1f-4b7c-b9ed-a59ce796f860 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:19.040225 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dc0a3-db1f-4b7c-b9ed-a59ce796f860 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:19.040334 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dc0a3-db1f-4b7c-b9ed-a59ce796f860 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:19.041968 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 115/230] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:19.047017 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee12f1a-58c2-4aa2-a2fe-b46397cf9cfa None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:19.047415 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee12f1a-58c2-4aa2-a2fe-b46397cf9cfa None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:19.047578 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee12f1a-58c2-4aa2-a2fe-b46397cf9cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:19.069222 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-bee12f1a-58c2-4aa2-a2fe-b46397cf9cfa None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:19.070338 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-bee12f1a-58c2-4aa2-a2fe-b46397cf9cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:19.076846 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 116/231] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:19.099477 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dc0a3-db1f-4b7c-b9ed-a59ce796f860 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:19.110843 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dc0a3-db1f-4b7c-b9ed-a59ce796f860 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:19.114680 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a80fd6-361d-4f1e-83c1-93d450402e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:19.115376 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a80fd6-361d-4f1e-83c1-93d450402e8b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:19.115663 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a80fd6-361d-4f1e-83c1-93d450402e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:19.115942 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a80fd6-361d-4f1e-83c1-93d450402e8b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:19.117018 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a80fd6-361d-4f1e-83c1-93d450402e8b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:19.142921 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a80fd6-361d-4f1e-83c1-93d450402e8b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:19.144324 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 116/232] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:22:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:19.149209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee12f1a-58c2-4aa2-a2fe-b46397cf9cfa None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:19.157434 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee12f1a-58c2-4aa2-a2fe-b46397cf9cfa None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:19.161295 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad2965-8e94-4c17-a32c-6888bdf96783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:19.161862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2965-8e94-4c17-a32c-6888bdf96783 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:19.162148 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2965-8e94-4c17-a32c-6888bdf96783 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:19.162426 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2965-8e94-4c17-a32c-6888bdf96783 admin admin] PATH_INFO: `/v3/groups` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:19.163050 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad2965-8e94-4c17-a32c-6888bdf96783 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:19.187117 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-15ad2965-8e94-4c17-a32c-6888bdf96783 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:22:19.187117 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:22:19.187117 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:22:19.188267 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad2965-8e94-4c17-a32c-6888bdf96783 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:19.253975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 117/233] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Aug 23 01:22:19 2021] POST /identity/v3/groups => generated 229 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:22:21.199577 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abed5ab-222b-4713-a6a0-b0074e2bf760 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:21.200119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abed5ab-222b-4713-a6a0-b0074e2bf760 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:21.200119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abed5ab-222b-4713-a6a0-b0074e2bf760 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:21.201843 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 117/234] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:21.207451 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a77b1-3083-475b-9841-6e74da62b1b9 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:21.207851 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a77b1-3083-475b-9841-6e74da62b1b9 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:21.208021 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a77b1-3083-475b-9841-6e74da62b1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:21.230632 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-5c7a77b1-3083-475b-9841-6e74da62b1b9 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:21.231744 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5c7a77b1-3083-475b-9841-6e74da62b1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:21.238328 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 118/235] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:22:21.259732 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abed5ab-222b-4713-a6a0-b0074e2bf760 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:21.271608 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abed5ab-222b-4713-a6a0-b0074e2bf760 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:21.275417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15c989-8b20-4dc6-afd0-b51301f4d051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:21.276112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15c989-8b20-4dc6-afd0-b51301f4d051 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:21.276399 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15c989-8b20-4dc6-afd0-b51301f4d051 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:21.276720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15c989-8b20-4dc6-afd0-b51301f4d051 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:21.277762 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15c989-8b20-4dc6-afd0-b51301f4d051 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:21.303471 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15c989-8b20-4dc6-afd0-b51301f4d051 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:21.304894 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 118/236] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:22:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:21.309782 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a77b1-3083-475b-9841-6e74da62b1b9 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:21.318110 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a77b1-3083-475b-9841-6e74da62b1b9 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:21.321997 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bb34a-bda5-42b8-aa11-20e7d4958501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:21.322563 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bb34a-bda5-42b8-aa11-20e7d4958501 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:21.322850 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bb34a-bda5-42b8-aa11-20e7d4958501 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:21.323131 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bb34a-bda5-42b8-aa11-20e7d4958501 admin admin] PATH_INFO: `/v3/groups` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:21.323750 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bb34a-bda5-42b8-aa11-20e7d4958501 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:21.350213 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bb34a-bda5-42b8-aa11-20e7d4958501 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:21.436635 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 119/237] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Aug 23 01:22:21 2021] POST /identity/v3/groups => generated 226 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:22:23.370163 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752d105-f1ef-45aa-a852-5721ed456614 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:23.370687 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752d105-f1ef-45aa-a852-5721ed456614 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:23.370771 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752d105-f1ef-45aa-a852-5721ed456614 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:23.372387 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 119/238] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:23.378180 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a77a79-44a1-44a3-b1b0-0beb83d681a4 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:23.378581 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a77a79-44a1-44a3-b1b0-0beb83d681a4 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:23.378743 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a77a79-44a1-44a3-b1b0-0beb83d681a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:23.400308 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-f2a77a79-44a1-44a3-b1b0-0beb83d681a4 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:23.401459 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-f2a77a79-44a1-44a3-b1b0-0beb83d681a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:23.407884 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 120/239] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:23.430193 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752d105-f1ef-45aa-a852-5721ed456614 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:23.442196 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752d105-f1ef-45aa-a852-5721ed456614 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:23.445978 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776ae2d-5192-43d7-91fb-c7eff4d02948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:23.446683 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776ae2d-5192-43d7-91fb-c7eff4d02948 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:23.446972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776ae2d-5192-43d7-91fb-c7eff4d02948 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:23.447250 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776ae2d-5192-43d7-91fb-c7eff4d02948 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:23.458925 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776ae2d-5192-43d7-91fb-c7eff4d02948 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:23.465288 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-1776ae2d-5192-43d7-91fb-c7eff4d02948 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 01:22:23.466343 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 120/240] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:22:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:23.471595 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a77a79-44a1-44a3-b1b0-0beb83d681a4 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:23.480185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a77a79-44a1-44a3-b1b0-0beb83d681a4 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:23.484000 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a9737-eea9-4ff4-a7a1-17995fe804d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:23.484593 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a9737-eea9-4ff4-a7a1-17995fe804d6 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:23.484885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a9737-eea9-4ff4-a7a1-17995fe804d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:23.485163 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a9737-eea9-4ff4-a7a1-17995fe804d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:23.486371 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a9737-eea9-4ff4-a7a1-17995fe804d6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:23.486666 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a9737-eea9-4ff4-a7a1-17995fe804d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:23.512211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a9737-eea9-4ff4-a7a1-17995fe804d6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:23.520517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 121/241] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Aug 23 01:22:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:23.525479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776ae2d-5192-43d7-91fb-c7eff4d02948 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:23.534384 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776ae2d-5192-43d7-91fb-c7eff4d02948 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:23.538195 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca6701-3ad1-43ef-917d-50d85029f5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:23.538750 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca6701-3ad1-43ef-917d-50d85029f5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:23.539039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca6701-3ad1-43ef-917d-50d85029f5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:23.539323 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca6701-3ad1-43ef-917d-50d85029f5d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:23.546819 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca6701-3ad1-43ef-917d-50d85029f5d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:23.572880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca6701-3ad1-43ef-917d-50d85029f5d8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:23.581109 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 121/242] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:22:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:22:23.586206 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a9737-eea9-4ff4-a7a1-17995fe804d6 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:23.594957 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a9737-eea9-4ff4-a7a1-17995fe804d6 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:23.599521 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e7a70-68b0-494f-afb5-267a5f840c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:23.600263 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e7a70-68b0-494f-afb5-267a5f840c64 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:23.600547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e7a70-68b0-494f-afb5-267a5f840c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:23.600858 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e7a70-68b0-494f-afb5-267a5f840c64 admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:23.601883 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e7a70-68b0-494f-afb5-267a5f840c64 admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:23.628070 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e7a70-68b0-494f-afb5-267a5f840c64 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:23.629489 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 122/243] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:23 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:23.634605 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca6701-3ad1-43ef-917d-50d85029f5d8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:23.642672 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca6701-3ad1-43ef-917d-50d85029f5d8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:23.646506 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc5aab-ffdb-4f35-a960-a110665e10dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:23.647253 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc5aab-ffdb-4f35-a960-a110665e10dc admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:23.647535 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc5aab-ffdb-4f35-a960-a110665e10dc admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:23.647811 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc5aab-ffdb-4f35-a960-a110665e10dc admin admin] PATH_INFO: `/v3/groups/8c28a5a980b642488b4ffb9b021959a6` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:23.652485 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc5aab-ffdb-4f35-a960-a110665e10dc admin admin] RBAC: Authorizing `identity:get_group(group_id=8c28a5a980b642488b4ffb9b021959a6)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:23.677692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-03bc5aab-ffdb-4f35-a960-a110665e10dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:22:23.677692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:22:23.677692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:22:23.678847 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc5aab-ffdb-4f35-a960-a110665e10dc admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:23.680248 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 122/244] 10.222.0.20 () {56 vars in 1202 bytes} [Mon Aug 23 01:22:23 2021] GET /identity/v3/groups/8c28a5a980b642488b4ffb9b021959a6 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:23.685393 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e7a70-68b0-494f-afb5-267a5f840c64 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:23.694333 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e7a70-68b0-494f-afb5-267a5f840c64 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:23.698132 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2f9be-7252-443f-af39-3f860d7d27f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:23.698683 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2f9be-7252-443f-af39-3f860d7d27f8 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:23.698969 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2f9be-7252-443f-af39-3f860d7d27f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:23.699249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2f9be-7252-443f-af39-3f860d7d27f8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:23.700007 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2f9be-7252-443f-af39-3f860d7d27f8 admin admin] RBAC: Adding query filter params (group.id=8c28a5a980b642488b4ffb9b021959a6, role.id=fafc5ecb5c074178be50f3c8d8006db2, scope.project.id=fa4552970c8f438c8319be7d42c1811a) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:23.700309 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2f9be-7252-443f-af39-3f860d7d27f8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:23.726174 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2f9be-7252-443f-af39-3f860d7d27f8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:23.731376 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 123/245] 10.222.0.20 () {56 vars in 1398 bytes} [Mon Aug 23 01:22:23 2021] GET /identity/v3/role_assignments?group.id=8c28a5a980b642488b4ffb9b021959a6&scope.project.id=fa4552970c8f438c8319be7d42c1811a&role.id=fafc5ecb5c074178be50f3c8d8006db2 => generated 260 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:22:25.626039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c748c-152a-4416-afc5-3bec01fea748 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:25.626584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c748c-152a-4416-afc5-3bec01fea748 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:25.626737 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c748c-152a-4416-afc5-3bec01fea748 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:25.628343 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 123/246] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:25.633379 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e870d1-7d92-4254-a805-f5c93083446d None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:25.633802 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e870d1-7d92-4254-a805-f5c93083446d None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:25.633977 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e870d1-7d92-4254-a805-f5c93083446d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:25.656400 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-61e870d1-7d92-4254-a805-f5c93083446d None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:25.657578 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-61e870d1-7d92-4254-a805-f5c93083446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:25.664739 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 124/247] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:25.685962 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c748c-152a-4416-afc5-3bec01fea748 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:25.697143 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c748c-152a-4416-afc5-3bec01fea748 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:25.700899 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4384a-7a44-4a4a-a7fe-c0e6177b6571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:25.701590 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4384a-7a44-4a4a-a7fe-c0e6177b6571 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:25.701871 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4384a-7a44-4a4a-a7fe-c0e6177b6571 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:25.702146 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4384a-7a44-4a4a-a7fe-c0e6177b6571 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:25.713363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4384a-7a44-4a4a-a7fe-c0e6177b6571 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:25.719554 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-4dc4384a-7a44-4a4a-a7fe-c0e6177b6571 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 01:22:25.720694 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 124/248] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:22:25 2021] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:22:25.726029 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e870d1-7d92-4254-a805-f5c93083446d None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:25.734303 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e870d1-7d92-4254-a805-f5c93083446d None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:25.738732 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9348c8b-fa2f-4427-93b5-56d5e0b2a7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:25.739309 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9348c8b-fa2f-4427-93b5-56d5e0b2a7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:25.739598 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9348c8b-fa2f-4427-93b5-56d5e0b2a7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:25.739881 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9348c8b-fa2f-4427-93b5-56d5e0b2a7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:25.740611 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9348c8b-fa2f-4427-93b5-56d5e0b2a7a5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:25.740919 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9348c8b-fa2f-4427-93b5-56d5e0b2a7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:25.766576 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9348c8b-fa2f-4427-93b5-56d5e0b2a7a5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:25.775259 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 125/249] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Aug 23 01:22:25 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:25.784862 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4384a-7a44-4a4a-a7fe-c0e6177b6571 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:25.795788 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4384a-7a44-4a4a-a7fe-c0e6177b6571 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:25.800164 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c04349-f1bc-47d4-95fa-06a2070ee0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:25.800952 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c04349-f1bc-47d4-95fa-06a2070ee0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:25.801233 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c04349-f1bc-47d4-95fa-06a2070ee0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:25.801505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c04349-f1bc-47d4-95fa-06a2070ee0b8 admin admin] PATH_INFO: `/v3/groups/8c28a5a980b642488b4ffb9b021959a6` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:25.802534 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c04349-f1bc-47d4-95fa-06a2070ee0b8 admin admin] RBAC: Authorizing `identity:get_group(group_id=8c28a5a980b642488b4ffb9b021959a6)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:25.828184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c04349-f1bc-47d4-95fa-06a2070ee0b8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:25.829640 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 125/250] 10.222.0.20 () {56 vars in 1202 bytes} [Mon Aug 23 01:22:25 2021] GET /identity/v3/groups/8c28a5a980b642488b4ffb9b021959a6 => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:25.834712 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9348c8b-fa2f-4427-93b5-56d5e0b2a7a5 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:25.843927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9348c8b-fa2f-4427-93b5-56d5e0b2a7a5 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:25.848648 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60877b6e-1aa7-4f8f-aa94-57fac01ce520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:25.849416 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60877b6e-1aa7-4f8f-aa94-57fac01ce520 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:25.849705 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60877b6e-1aa7-4f8f-aa94-57fac01ce520 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:25.849988 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60877b6e-1aa7-4f8f-aa94-57fac01ce520 admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:25.851043 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60877b6e-1aa7-4f8f-aa94-57fac01ce520 admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:25.877119 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60877b6e-1aa7-4f8f-aa94-57fac01ce520 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:25.878595 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 126/251] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:25 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:25.883533 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c04349-f1bc-47d4-95fa-06a2070ee0b8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:25.892446 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c04349-f1bc-47d4-95fa-06a2070ee0b8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:25.896296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcb7dd-f7ba-415a-a7a3-cb195fea5410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:25.897100 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcb7dd-f7ba-415a-a7a3-cb195fea5410 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:25.897383 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcb7dd-f7ba-415a-a7a3-cb195fea5410 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:25.897659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcb7dd-f7ba-415a-a7a3-cb195fea5410 admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a/groups/8c28a5a980b642488b4ffb9b021959a6/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:25.899328 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcb7dd-f7ba-415a-a7a3-cb195fea5410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4552970c8f438c8319be7d42c1811a, group_id=8c28a5a980b642488b4ffb9b021959a6, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:25.926358 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcb7dd-f7ba-415a-a7a3-cb195fea5410 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:25.990795 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 126/252] 10.222.0.20 () {58 vars in 1464 bytes} [Mon Aug 23 01:22:25 2021] PUT /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a/groups/8c28a5a980b642488b4ffb9b021959a6/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:22:27.902933 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f55d14-e6fc-43e8-9368-9dcd76c15fed None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:27.903435 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f55d14-e6fc-43e8-9368-9dcd76c15fed None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:27.903518 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f55d14-e6fc-43e8-9368-9dcd76c15fed None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:27.905218 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 127/253] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:27.910659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6853cad-a60a-4a08-9329-048dfda1a6c1 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:27.911026 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6853cad-a60a-4a08-9329-048dfda1a6c1 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:27.911226 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6853cad-a60a-4a08-9329-048dfda1a6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:27.932887 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-e6853cad-a60a-4a08-9329-048dfda1a6c1 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:27.933992 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e6853cad-a60a-4a08-9329-048dfda1a6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:27.994927 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 127/254] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:28.016546 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f55d14-e6fc-43e8-9368-9dcd76c15fed None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:28.028583 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f55d14-e6fc-43e8-9368-9dcd76c15fed None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:28.032489 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42ae0b-bd9c-4b19-9b30-fbac32eb8b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:28.033836 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42ae0b-bd9c-4b19-9b30-fbac32eb8b28 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:28.034129 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42ae0b-bd9c-4b19-9b30-fbac32eb8b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:28.034415 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42ae0b-bd9c-4b19-9b30-fbac32eb8b28 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:28.046680 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42ae0b-bd9c-4b19-9b30-fbac32eb8b28 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:28.053047 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-fe42ae0b-bd9c-4b19-9b30-fbac32eb8b28 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 01:22:28.054145 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 128/255] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:22:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:28.059891 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6853cad-a60a-4a08-9329-048dfda1a6c1 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:28.068327 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6853cad-a60a-4a08-9329-048dfda1a6c1 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:28.072187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820f55c-dd7f-47fc-88b6-ea2c1e4629f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:28.072802 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820f55c-dd7f-47fc-88b6-ea2c1e4629f4 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:28.073089 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820f55c-dd7f-47fc-88b6-ea2c1e4629f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:28.073367 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820f55c-dd7f-47fc-88b6-ea2c1e4629f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:28.074094 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820f55c-dd7f-47fc-88b6-ea2c1e4629f4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:28.074389 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820f55c-dd7f-47fc-88b6-ea2c1e4629f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:28.100492 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820f55c-dd7f-47fc-88b6-ea2c1e4629f4 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:28.108745 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 128/256] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Aug 23 01:22:28 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:28.113706 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42ae0b-bd9c-4b19-9b30-fbac32eb8b28 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:28.122686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42ae0b-bd9c-4b19-9b30-fbac32eb8b28 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:28.127052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c24725-9e3f-4e3c-bb68-2a36e8ca0e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:28.127626 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c24725-9e3f-4e3c-bb68-2a36e8ca0e19 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:28.127920 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c24725-9e3f-4e3c-bb68-2a36e8ca0e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:28.128201 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c24725-9e3f-4e3c-bb68-2a36e8ca0e19 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:28.135727 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c24725-9e3f-4e3c-bb68-2a36e8ca0e19 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:28.161335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c24725-9e3f-4e3c-bb68-2a36e8ca0e19 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:28.169512 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 129/257] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:22:28 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:22:28.174548 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820f55c-dd7f-47fc-88b6-ea2c1e4629f4 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:28.183255 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820f55c-dd7f-47fc-88b6-ea2c1e4629f4 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:28.187029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ed0f6-ff9e-4be3-9082-acf4902780ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:28.187778 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ed0f6-ff9e-4be3-9082-acf4902780ee admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:28.188061 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ed0f6-ff9e-4be3-9082-acf4902780ee admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:28.188338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ed0f6-ff9e-4be3-9082-acf4902780ee admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:28.189912 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ed0f6-ff9e-4be3-9082-acf4902780ee admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:28.215105 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ed0f6-ff9e-4be3-9082-acf4902780ee admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:28.216541 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 129/258] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:28 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:28.221841 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c24725-9e3f-4e3c-bb68-2a36e8ca0e19 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:28.230199 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c24725-9e3f-4e3c-bb68-2a36e8ca0e19 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:28.234111 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382bdba-b972-4743-bafc-2bb66dfac9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:28.234851 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382bdba-b972-4743-bafc-2bb66dfac9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:28.235138 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382bdba-b972-4743-bafc-2bb66dfac9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:28.235420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382bdba-b972-4743-bafc-2bb66dfac9b5 admin admin] PATH_INFO: `/v3/groups/8c28a5a980b642488b4ffb9b021959a6` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:28.237068 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382bdba-b972-4743-bafc-2bb66dfac9b5 admin admin] RBAC: Authorizing `identity:get_group(group_id=8c28a5a980b642488b4ffb9b021959a6)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:28.261331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-0382bdba-b972-4743-bafc-2bb66dfac9b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:22:28.261331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:22:28.261331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:22:28.262485 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382bdba-b972-4743-bafc-2bb66dfac9b5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:28.263888 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 130/259] 10.222.0.20 () {56 vars in 1202 bytes} [Mon Aug 23 01:22:28 2021] GET /identity/v3/groups/8c28a5a980b642488b4ffb9b021959a6 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:28.268968 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ed0f6-ff9e-4be3-9082-acf4902780ee admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:28.277706 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ed0f6-ff9e-4be3-9082-acf4902780ee admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:28.281479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57047c10-47d9-4d56-bc2f-23475ec65023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:28.282018 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57047c10-47d9-4d56-bc2f-23475ec65023 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:28.282303 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57047c10-47d9-4d56-bc2f-23475ec65023 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:28.283121 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57047c10-47d9-4d56-bc2f-23475ec65023 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:28.283867 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57047c10-47d9-4d56-bc2f-23475ec65023 admin admin] RBAC: Adding query filter params (group.id=8c28a5a980b642488b4ffb9b021959a6, role.id=fafc5ecb5c074178be50f3c8d8006db2, scope.project.id=fa4552970c8f438c8319be7d42c1811a) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:28.284166 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57047c10-47d9-4d56-bc2f-23475ec65023 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:28.309771 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57047c10-47d9-4d56-bc2f-23475ec65023 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:28.315266 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 130/260] 10.222.0.20 () {56 vars in 1398 bytes} [Mon Aug 23 01:22:28 2021] GET /identity/v3/role_assignments?group.id=8c28a5a980b642488b4ffb9b021959a6&scope.project.id=fa4552970c8f438c8319be7d42c1811a&role.id=fafc5ecb5c074178be50f3c8d8006db2 => generated 611 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:30.226930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c6325-9a05-4743-bfce-912efbd120b6 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:30.227446 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c6325-9a05-4743-bfce-912efbd120b6 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:30.227529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c6325-9a05-4743-bfce-912efbd120b6 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:30.229199 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 131/261] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:30.234134 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10afc4f-bf59-469a-bb27-e2d4f5179660 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:30.234525 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10afc4f-bf59-469a-bb27-e2d4f5179660 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:30.234706 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10afc4f-bf59-469a-bb27-e2d4f5179660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:30.257614 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-f10afc4f-bf59-469a-bb27-e2d4f5179660 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:30.258715 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f10afc4f-bf59-469a-bb27-e2d4f5179660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:30.265224 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 131/262] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:30.286331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c6325-9a05-4743-bfce-912efbd120b6 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:30.297772 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c6325-9a05-4743-bfce-912efbd120b6 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:30.302122 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b43da2-7762-4570-bb74-df32befad350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:30.302831 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b43da2-7762-4570-bb74-df32befad350 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:30.303116 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b43da2-7762-4570-bb74-df32befad350 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:30.303398 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b43da2-7762-4570-bb74-df32befad350 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:30.314366 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b43da2-7762-4570-bb74-df32befad350 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:30.320955 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-f4b43da2-7762-4570-bb74-df32befad350 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 01:22:30.322005 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 132/263] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:22:30 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:30.327333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10afc4f-bf59-469a-bb27-e2d4f5179660 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:30.336085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10afc4f-bf59-469a-bb27-e2d4f5179660 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:30.339945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd70a36-01e1-4884-bf02-1447f4201dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:30.340516 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd70a36-01e1-4884-bf02-1447f4201dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:30.340829 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd70a36-01e1-4884-bf02-1447f4201dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:30.341106 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd70a36-01e1-4884-bf02-1447f4201dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:30.341795 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd70a36-01e1-4884-bf02-1447f4201dc1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:30.342086 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd70a36-01e1-4884-bf02-1447f4201dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:30.367878 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd70a36-01e1-4884-bf02-1447f4201dc1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:30.375957 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 132/264] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:22:30 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:30.381734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b43da2-7762-4570-bb74-df32befad350 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:30.392658 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b43da2-7762-4570-bb74-df32befad350 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:30.396629 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727cc55-e5c6-4095-894b-70b8c8493713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:30.397197 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727cc55-e5c6-4095-894b-70b8c8493713 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:30.397488 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727cc55-e5c6-4095-894b-70b8c8493713 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:30.397770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727cc55-e5c6-4095-894b-70b8c8493713 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:30.405433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727cc55-e5c6-4095-894b-70b8c8493713 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:30.430470 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727cc55-e5c6-4095-894b-70b8c8493713 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:30.439479 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 133/265] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:22:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:22:30.445056 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd70a36-01e1-4884-bf02-1447f4201dc1 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:30.454067 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd70a36-01e1-4884-bf02-1447f4201dc1 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:30.458513 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae405adc-f507-4fed-b17b-95135986f870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:30.459275 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae405adc-f507-4fed-b17b-95135986f870 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:30.459557 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae405adc-f507-4fed-b17b-95135986f870 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:30.459835 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae405adc-f507-4fed-b17b-95135986f870 admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:30.460912 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae405adc-f507-4fed-b17b-95135986f870 admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:30.486391 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae405adc-f507-4fed-b17b-95135986f870 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:30.487981 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 133/266] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:30 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:30.492812 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727cc55-e5c6-4095-894b-70b8c8493713 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:30.501041 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727cc55-e5c6-4095-894b-70b8c8493713 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:30.505469 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9b4c8-a8d3-4e31-9f3f-be54c5a9d8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:30.506225 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9b4c8-a8d3-4e31-9f3f-be54c5a9d8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:30.506512 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9b4c8-a8d3-4e31-9f3f-be54c5a9d8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:30.506795 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9b4c8-a8d3-4e31-9f3f-be54c5a9d8a6 admin admin] PATH_INFO: `/v3/groups/8c28a5a980b642488b4ffb9b021959a6` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:30.507830 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9b4c8-a8d3-4e31-9f3f-be54c5a9d8a6 admin admin] RBAC: Authorizing `identity:get_group(group_id=8c28a5a980b642488b4ffb9b021959a6)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:30.533771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9b4c8-a8d3-4e31-9f3f-be54c5a9d8a6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:30.535179 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 134/267] 10.222.0.20 () {56 vars in 1202 bytes} [Mon Aug 23 01:22:30 2021] GET /identity/v3/groups/8c28a5a980b642488b4ffb9b021959a6 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:22:30.540435 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae405adc-f507-4fed-b17b-95135986f870 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:30.549460 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae405adc-f507-4fed-b17b-95135986f870 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:30.553283 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6f687-6f32-482a-aa86-22bfba8f6145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:30.553842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6f687-6f32-482a-aa86-22bfba8f6145 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:30.554131 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6f687-6f32-482a-aa86-22bfba8f6145 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:30.554416 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6f687-6f32-482a-aa86-22bfba8f6145 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:30.555172 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6f687-6f32-482a-aa86-22bfba8f6145 admin admin] RBAC: Adding query filter params (group.id=8c28a5a980b642488b4ffb9b021959a6, role.id=1d347df28134487288d9c4a0c6451cb3, scope.project.id=fa4552970c8f438c8319be7d42c1811a) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:30.555476 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6f687-6f32-482a-aa86-22bfba8f6145 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:30.581826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6f687-6f32-482a-aa86-22bfba8f6145 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:30.587103 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 134/268] 10.222.0.20 () {56 vars in 1398 bytes} [Mon Aug 23 01:22:30 2021] GET /identity/v3/role_assignments?group.id=8c28a5a980b642488b4ffb9b021959a6&scope.project.id=fa4552970c8f438c8319be7d42c1811a&role.id=1d347df28134487288d9c4a0c6451cb3 => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:32.488270 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed35751-176e-4771-860f-8973378e1224 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:32.488760 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed35751-176e-4771-860f-8973378e1224 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:32.488875 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed35751-176e-4771-860f-8973378e1224 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:32.490567 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 135/269] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:32.495785 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fdf57-4dbe-4d8d-947f-0cfd1885c4d7 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:32.496146 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fdf57-4dbe-4d8d-947f-0cfd1885c4d7 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:32.496345 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fdf57-4dbe-4d8d-947f-0cfd1885c4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:32.518757 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-c61fdf57-4dbe-4d8d-947f-0cfd1885c4d7 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:32.519884 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c61fdf57-4dbe-4d8d-947f-0cfd1885c4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:32.526401 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 135/270] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:32.548398 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed35751-176e-4771-860f-8973378e1224 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:32.559751 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed35751-176e-4771-860f-8973378e1224 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:32.563550 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6817921-6979-48da-aa4b-78c3649205dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:32.564262 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6817921-6979-48da-aa4b-78c3649205dd admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:32.564556 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6817921-6979-48da-aa4b-78c3649205dd admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:32.564864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6817921-6979-48da-aa4b-78c3649205dd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:32.575822 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6817921-6979-48da-aa4b-78c3649205dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:32.582947 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-c6817921-6979-48da-aa4b-78c3649205dd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 01:22:32.584007 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 136/271] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:22:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:32.589628 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fdf57-4dbe-4d8d-947f-0cfd1885c4d7 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:32.598750 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fdf57-4dbe-4d8d-947f-0cfd1885c4d7 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:32.602575 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804b43a-0de4-449e-a478-019fcad5b279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:32.603151 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804b43a-0de4-449e-a478-019fcad5b279 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:32.603436 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804b43a-0de4-449e-a478-019fcad5b279 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:32.603713 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804b43a-0de4-449e-a478-019fcad5b279 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:32.604407 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804b43a-0de4-449e-a478-019fcad5b279 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:32.604733 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804b43a-0de4-449e-a478-019fcad5b279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:32.637282 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804b43a-0de4-449e-a478-019fcad5b279 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:32.648358 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 136/272] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:22:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:32.653863 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6817921-6979-48da-aa4b-78c3649205dd admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:32.663949 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6817921-6979-48da-aa4b-78c3649205dd admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:32.668006 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e131cc5-7705-4800-930a-f8b40fed5c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:32.668748 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e131cc5-7705-4800-930a-f8b40fed5c4a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:32.669034 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e131cc5-7705-4800-930a-f8b40fed5c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:32.669313 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e131cc5-7705-4800-930a-f8b40fed5c4a admin admin] PATH_INFO: `/v3/groups/8c28a5a980b642488b4ffb9b021959a6` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:32.670345 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e131cc5-7705-4800-930a-f8b40fed5c4a admin admin] RBAC: Authorizing `identity:get_group(group_id=8c28a5a980b642488b4ffb9b021959a6)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:32.696049 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e131cc5-7705-4800-930a-f8b40fed5c4a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:32.697477 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 137/273] 10.222.0.20 () {56 vars in 1202 bytes} [Mon Aug 23 01:22:32 2021] GET /identity/v3/groups/8c28a5a980b642488b4ffb9b021959a6 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:32.702264 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804b43a-0de4-449e-a478-019fcad5b279 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:32.711689 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804b43a-0de4-449e-a478-019fcad5b279 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:32.715473 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414483f-ed02-4b27-9b46-7369d617ed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:32.716232 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414483f-ed02-4b27-9b46-7369d617ed56 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:32.716512 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414483f-ed02-4b27-9b46-7369d617ed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:32.716820 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414483f-ed02-4b27-9b46-7369d617ed56 admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:32.717865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414483f-ed02-4b27-9b46-7369d617ed56 admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:32.743229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414483f-ed02-4b27-9b46-7369d617ed56 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:32.744690 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 137/274] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:32 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:32.749622 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e131cc5-7705-4800-930a-f8b40fed5c4a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:32.759112 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e131cc5-7705-4800-930a-f8b40fed5c4a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:32.762966 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49f159-181f-4caf-bcd7-0aca997ff515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:32.763730 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49f159-181f-4caf-bcd7-0aca997ff515 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:32.764020 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49f159-181f-4caf-bcd7-0aca997ff515 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:32.764304 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49f159-181f-4caf-bcd7-0aca997ff515 admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a/groups/8c28a5a980b642488b4ffb9b021959a6/roles/1d347df28134487288d9c4a0c6451cb3` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:32.766257 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49f159-181f-4caf-bcd7-0aca997ff515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4552970c8f438c8319be7d42c1811a, group_id=8c28a5a980b642488b4ffb9b021959a6, role_id=1d347df28134487288d9c4a0c6451cb3)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:32.792922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49f159-181f-4caf-bcd7-0aca997ff515 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:32.874323 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 138/275] 10.222.0.20 () {58 vars in 1464 bytes} [Mon Aug 23 01:22:32 2021] PUT /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a/groups/8c28a5a980b642488b4ffb9b021959a6/roles/1d347df28134487288d9c4a0c6451cb3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:22:34.813162 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f3501-17b2-4e96-a5fd-aed36735cd21 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:34.813646 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f3501-17b2-4e96-a5fd-aed36735cd21 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:34.813646 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f3501-17b2-4e96-a5fd-aed36735cd21 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:34.815285 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 138/276] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:34.820259 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8384a9-1f09-4bc7-b3c4-009ab1e49046 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:34.820657 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8384a9-1f09-4bc7-b3c4-009ab1e49046 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:34.820860 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8384a9-1f09-4bc7-b3c4-009ab1e49046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:34.845521 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-1d8384a9-1f09-4bc7-b3c4-009ab1e49046 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:34.846655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1d8384a9-1f09-4bc7-b3c4-009ab1e49046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:34.909057 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 139/277] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:34.931075 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f3501-17b2-4e96-a5fd-aed36735cd21 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:34.942866 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f3501-17b2-4e96-a5fd-aed36735cd21 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:34.946646 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba8543-90b2-49a5-a1ba-6ea7ab854205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:34.947367 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba8543-90b2-49a5-a1ba-6ea7ab854205 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:34.947651 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba8543-90b2-49a5-a1ba-6ea7ab854205 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:34.947929 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba8543-90b2-49a5-a1ba-6ea7ab854205 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:34.960990 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba8543-90b2-49a5-a1ba-6ea7ab854205 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:34.967558 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-abba8543-90b2-49a5-a1ba-6ea7ab854205 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 01:22:34.968629 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 139/278] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:22:34 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:34.974740 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8384a9-1f09-4bc7-b3c4-009ab1e49046 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:34.983107 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8384a9-1f09-4bc7-b3c4-009ab1e49046 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:34.987587 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da502ee-6e91-4f24-9baa-b089ecc88a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:34.988162 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da502ee-6e91-4f24-9baa-b089ecc88a3f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:34.988452 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da502ee-6e91-4f24-9baa-b089ecc88a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:34.988761 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da502ee-6e91-4f24-9baa-b089ecc88a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:34.989464 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da502ee-6e91-4f24-9baa-b089ecc88a3f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:34.989763 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da502ee-6e91-4f24-9baa-b089ecc88a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:35.015389 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da502ee-6e91-4f24-9baa-b089ecc88a3f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:35.023555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 140/279] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:22:34 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:35.028583 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba8543-90b2-49a5-a1ba-6ea7ab854205 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:35.037948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba8543-90b2-49a5-a1ba-6ea7ab854205 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:35.041762 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54998d-578f-458f-84ca-0a4c1d698f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:35.042312 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54998d-578f-458f-84ca-0a4c1d698f3d admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:35.042596 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54998d-578f-458f-84ca-0a4c1d698f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:35.042874 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54998d-578f-458f-84ca-0a4c1d698f3d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:35.050888 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54998d-578f-458f-84ca-0a4c1d698f3d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:35.075703 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54998d-578f-458f-84ca-0a4c1d698f3d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:35.083750 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 140/280] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:22:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:22:35.088743 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da502ee-6e91-4f24-9baa-b089ecc88a3f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:35.098334 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da502ee-6e91-4f24-9baa-b089ecc88a3f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:35.102158 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56afbef-5f40-4c6c-9bf4-7b01b408acfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:35.102916 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56afbef-5f40-4c6c-9bf4-7b01b408acfa admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:35.103207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56afbef-5f40-4c6c-9bf4-7b01b408acfa admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:35.103490 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56afbef-5f40-4c6c-9bf4-7b01b408acfa admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:35.104536 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56afbef-5f40-4c6c-9bf4-7b01b408acfa admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:35.130502 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56afbef-5f40-4c6c-9bf4-7b01b408acfa admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:35.131953 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 141/281] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:35 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:35.136750 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54998d-578f-458f-84ca-0a4c1d698f3d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:35.144731 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54998d-578f-458f-84ca-0a4c1d698f3d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:35.148522 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804aa901-18bb-4ff0-97ce-40893e11535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:35.149291 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aa901-18bb-4ff0-97ce-40893e11535a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:35.149574 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aa901-18bb-4ff0-97ce-40893e11535a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:35.149849 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aa901-18bb-4ff0-97ce-40893e11535a admin admin] PATH_INFO: `/v3/groups/8c28a5a980b642488b4ffb9b021959a6` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:35.150876 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804aa901-18bb-4ff0-97ce-40893e11535a admin admin] RBAC: Authorizing `identity:get_group(group_id=8c28a5a980b642488b4ffb9b021959a6)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:35.176858 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804aa901-18bb-4ff0-97ce-40893e11535a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:35.178238 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 141/282] 10.222.0.20 () {56 vars in 1202 bytes} [Mon Aug 23 01:22:35 2021] GET /identity/v3/groups/8c28a5a980b642488b4ffb9b021959a6 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:35.183492 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56afbef-5f40-4c6c-9bf4-7b01b408acfa admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:35.192391 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56afbef-5f40-4c6c-9bf4-7b01b408acfa admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:35.196181 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf0e20-7a51-4690-9ee7-93436d7866a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:35.196758 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf0e20-7a51-4690-9ee7-93436d7866a8 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:35.197043 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf0e20-7a51-4690-9ee7-93436d7866a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:35.197319 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf0e20-7a51-4690-9ee7-93436d7866a8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:35.198075 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf0e20-7a51-4690-9ee7-93436d7866a8 admin admin] RBAC: Adding query filter params (group.id=8c28a5a980b642488b4ffb9b021959a6, role.id=1d347df28134487288d9c4a0c6451cb3, scope.project.id=fa4552970c8f438c8319be7d42c1811a) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:35.198371 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf0e20-7a51-4690-9ee7-93436d7866a8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:35.224093 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf0e20-7a51-4690-9ee7-93436d7866a8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:35.229795 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 142/283] 10.222.0.20 () {56 vars in 1398 bytes} [Mon Aug 23 01:22:35 2021] GET /identity/v3/role_assignments?group.id=8c28a5a980b642488b4ffb9b021959a6&scope.project.id=fa4552970c8f438c8319be7d42c1811a&role.id=1d347df28134487288d9c4a0c6451cb3 => generated 611 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:37.166345 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d68c9-7e32-4355-887a-3f2e216defc3 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:37.166930 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d68c9-7e32-4355-887a-3f2e216defc3 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:37.166930 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d68c9-7e32-4355-887a-3f2e216defc3 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:37.168598 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 142/284] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:37.173637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6481b49-54e4-40a3-abe3-f62d68bcc065 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:37.174042 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6481b49-54e4-40a3-abe3-f62d68bcc065 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:37.174218 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6481b49-54e4-40a3-abe3-f62d68bcc065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:37.196544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-c6481b49-54e4-40a3-abe3-f62d68bcc065 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:37.197702 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-c6481b49-54e4-40a3-abe3-f62d68bcc065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:37.204733 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 143/285] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:37.226604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d68c9-7e32-4355-887a-3f2e216defc3 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:37.237784 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d68c9-7e32-4355-887a-3f2e216defc3 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:37.241499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89a7b5-4f43-4dc2-84c9-fba15ed70162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:37.242193 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89a7b5-4f43-4dc2-84c9-fba15ed70162 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:37.242480 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89a7b5-4f43-4dc2-84c9-fba15ed70162 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:37.242760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89a7b5-4f43-4dc2-84c9-fba15ed70162 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:37.254025 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89a7b5-4f43-4dc2-84c9-fba15ed70162 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:37.260270 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-3e89a7b5-4f43-4dc2-84c9-fba15ed70162 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 01:22:37.261338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 143/286] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:22:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:37.266614 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6481b49-54e4-40a3-abe3-f62d68bcc065 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:37.274923 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6481b49-54e4-40a3-abe3-f62d68bcc065 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:37.278801 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea256cd0-6615-40f1-95f5-3f9a25efd219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:37.279374 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea256cd0-6615-40f1-95f5-3f9a25efd219 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:37.279664 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea256cd0-6615-40f1-95f5-3f9a25efd219 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:37.279946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea256cd0-6615-40f1-95f5-3f9a25efd219 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:37.280676 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea256cd0-6615-40f1-95f5-3f9a25efd219 admin admin] RBAC: Adding query filter params (name=member) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:37.280977 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea256cd0-6615-40f1-95f5-3f9a25efd219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:37.307111 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea256cd0-6615-40f1-95f5-3f9a25efd219 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:37.315376 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 144/287] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Aug 23 01:22:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:37.320332 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89a7b5-4f43-4dc2-84c9-fba15ed70162 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:37.330087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89a7b5-4f43-4dc2-84c9-fba15ed70162 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:37.333844 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce6047-33a8-4cc0-8793-ee3ac4780f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:37.334390 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce6047-33a8-4cc0-8793-ee3ac4780f38 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:37.334681 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce6047-33a8-4cc0-8793-ee3ac4780f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:37.334960 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce6047-33a8-4cc0-8793-ee3ac4780f38 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:37.342324 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce6047-33a8-4cc0-8793-ee3ac4780f38 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:37.368373 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce6047-33a8-4cc0-8793-ee3ac4780f38 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:37.376619 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 144/288] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:22:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:22:37.381825 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea256cd0-6615-40f1-95f5-3f9a25efd219 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:37.390816 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea256cd0-6615-40f1-95f5-3f9a25efd219 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:37.394647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fd3d3-6261-485b-8a8e-bd2b6fbe6500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:37.395412 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fd3d3-6261-485b-8a8e-bd2b6fbe6500 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:37.395698 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fd3d3-6261-485b-8a8e-bd2b6fbe6500 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:37.395979 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fd3d3-6261-485b-8a8e-bd2b6fbe6500 admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:37.397045 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fd3d3-6261-485b-8a8e-bd2b6fbe6500 admin admin] RBAC: Authorizing `identity:get_project(project_id=d95c944d92ef4aebaa584978535338d1)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:37.423521 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fd3d3-6261-485b-8a8e-bd2b6fbe6500 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:37.425014 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 145/289] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:37 2021] GET /identity/v3/projects/d95c944d92ef4aebaa584978535338d1 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:37.430397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce6047-33a8-4cc0-8793-ee3ac4780f38 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:37.438765 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce6047-33a8-4cc0-8793-ee3ac4780f38 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:37.442593 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826e889-89dd-4a0c-a2e0-c40f1070ff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:37.443343 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826e889-89dd-4a0c-a2e0-c40f1070ff90 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:37.443624 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826e889-89dd-4a0c-a2e0-c40f1070ff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:37.443898 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826e889-89dd-4a0c-a2e0-c40f1070ff90 admin admin] PATH_INFO: `/v3/groups/8c28a5a980b642488b4ffb9b021959a6` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:37.444948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826e889-89dd-4a0c-a2e0-c40f1070ff90 admin admin] RBAC: Authorizing `identity:get_group(group_id=8c28a5a980b642488b4ffb9b021959a6)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:37.470589 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826e889-89dd-4a0c-a2e0-c40f1070ff90 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:37.471962 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 145/290] 10.222.0.20 () {56 vars in 1202 bytes} [Mon Aug 23 01:22:37 2021] GET /identity/v3/groups/8c28a5a980b642488b4ffb9b021959a6 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:37.477476 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fd3d3-6261-485b-8a8e-bd2b6fbe6500 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:37.487045 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fd3d3-6261-485b-8a8e-bd2b6fbe6500 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:37.490864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0a39e-91f1-471f-9302-1a396f39a2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:37.491419 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0a39e-91f1-471f-9302-1a396f39a2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:37.491706 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0a39e-91f1-471f-9302-1a396f39a2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:37.491987 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0a39e-91f1-471f-9302-1a396f39a2b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:37.492775 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0a39e-91f1-471f-9302-1a396f39a2b4 admin admin] RBAC: Adding query filter params (group.id=8c28a5a980b642488b4ffb9b021959a6, role.id=fafc5ecb5c074178be50f3c8d8006db2, scope.project.id=d95c944d92ef4aebaa584978535338d1) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:37.493082 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0a39e-91f1-471f-9302-1a396f39a2b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:37.518583 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0a39e-91f1-471f-9302-1a396f39a2b4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:37.523726 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 146/291] 10.222.0.20 () {56 vars in 1398 bytes} [Mon Aug 23 01:22:37 2021] GET /identity/v3/role_assignments?group.id=8c28a5a980b642488b4ffb9b021959a6&scope.project.id=d95c944d92ef4aebaa584978535338d1&role.id=fafc5ecb5c074178be50f3c8d8006db2 => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:22:39.421268 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282e306-3e65-4aea-aa0b-9d1f3b9bba05 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:39.421649 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282e306-3e65-4aea-aa0b-9d1f3b9bba05 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:39.421827 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282e306-3e65-4aea-aa0b-9d1f3b9bba05 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:39.424160 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 146/292] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:39.429155 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c43ade-49fc-4256-ae9d-b544f50e1c7c None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:39.429562 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c43ade-49fc-4256-ae9d-b544f50e1c7c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:39.429729 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c43ade-49fc-4256-ae9d-b544f50e1c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:39.451480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-23c43ade-49fc-4256-ae9d-b544f50e1c7c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:39.452631 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-23c43ade-49fc-4256-ae9d-b544f50e1c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:39.459155 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 147/293] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:22:39.480482 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282e306-3e65-4aea-aa0b-9d1f3b9bba05 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:39.492660 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282e306-3e65-4aea-aa0b-9d1f3b9bba05 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:39.496345 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da182f06-632e-423e-89c7-1e6ba21e833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:39.497070 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da182f06-632e-423e-89c7-1e6ba21e833c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:39.497354 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da182f06-632e-423e-89c7-1e6ba21e833c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:39.497626 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da182f06-632e-423e-89c7-1e6ba21e833c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:39.508434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da182f06-632e-423e-89c7-1e6ba21e833c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:39.514637 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-da182f06-632e-423e-89c7-1e6ba21e833c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 01:22:39.515686 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 147/294] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:22:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:39.520898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c43ade-49fc-4256-ae9d-b544f50e1c7c None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:39.529179 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c43ade-49fc-4256-ae9d-b544f50e1c7c None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:39.533555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123100f-be04-4e49-87bc-a8dc4162bbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:39.534131 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123100f-be04-4e49-87bc-a8dc4162bbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:39.534419 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123100f-be04-4e49-87bc-a8dc4162bbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:39.534701 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123100f-be04-4e49-87bc-a8dc4162bbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:39.535429 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123100f-be04-4e49-87bc-a8dc4162bbc7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:39.535729 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123100f-be04-4e49-87bc-a8dc4162bbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:39.560830 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123100f-be04-4e49-87bc-a8dc4162bbc7 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:39.569648 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 148/295] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Aug 23 01:22:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:39.574550 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da182f06-632e-423e-89c7-1e6ba21e833c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:39.585236 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da182f06-632e-423e-89c7-1e6ba21e833c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:39.589296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f94e6-a804-47ec-8c7c-97656f7ddc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:39.590029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f94e6-a804-47ec-8c7c-97656f7ddc08 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:39.590309 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f94e6-a804-47ec-8c7c-97656f7ddc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:39.590585 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f94e6-a804-47ec-8c7c-97656f7ddc08 admin admin] PATH_INFO: `/v3/groups/8c28a5a980b642488b4ffb9b021959a6` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:39.591623 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f94e6-a804-47ec-8c7c-97656f7ddc08 admin admin] RBAC: Authorizing `identity:get_group(group_id=8c28a5a980b642488b4ffb9b021959a6)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:39.616521 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f94e6-a804-47ec-8c7c-97656f7ddc08 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:39.617935 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 148/296] 10.222.0.20 () {56 vars in 1202 bytes} [Mon Aug 23 01:22:39 2021] GET /identity/v3/groups/8c28a5a980b642488b4ffb9b021959a6 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:22:39.622726 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123100f-be04-4e49-87bc-a8dc4162bbc7 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:39.632090 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123100f-be04-4e49-87bc-a8dc4162bbc7 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:39.635941 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3c4cb-a900-4365-8992-4c4b9e8954dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:39.636736 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3c4cb-a900-4365-8992-4c4b9e8954dd admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:39.637028 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3c4cb-a900-4365-8992-4c4b9e8954dd admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:39.637313 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3c4cb-a900-4365-8992-4c4b9e8954dd admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:39.638349 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3c4cb-a900-4365-8992-4c4b9e8954dd admin admin] RBAC: Authorizing `identity:get_project(project_id=d95c944d92ef4aebaa584978535338d1)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:39.664410 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3c4cb-a900-4365-8992-4c4b9e8954dd admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:39.665845 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 149/297] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:39 2021] GET /identity/v3/projects/d95c944d92ef4aebaa584978535338d1 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:39.670569 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f94e6-a804-47ec-8c7c-97656f7ddc08 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:39.679197 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f94e6-a804-47ec-8c7c-97656f7ddc08 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:39.682953 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247ee5d-a50e-4226-928d-b91a9a41270e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:39.683704 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247ee5d-a50e-4226-928d-b91a9a41270e admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:39.683988 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247ee5d-a50e-4226-928d-b91a9a41270e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:39.684263 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247ee5d-a50e-4226-928d-b91a9a41270e admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1/groups/8c28a5a980b642488b4ffb9b021959a6/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:39.685946 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247ee5d-a50e-4226-928d-b91a9a41270e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95c944d92ef4aebaa584978535338d1, group_id=8c28a5a980b642488b4ffb9b021959a6, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:39.713043 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247ee5d-a50e-4226-928d-b91a9a41270e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:39.784660 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 149/298] 10.222.0.20 () {58 vars in 1464 bytes} [Mon Aug 23 01:22:39 2021] PUT /identity/v3/projects/d95c944d92ef4aebaa584978535338d1/groups/8c28a5a980b642488b4ffb9b021959a6/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:22:41.700710 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a193f98-f56f-448b-af50-bc0c5febb21e None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:41.701202 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a193f98-f56f-448b-af50-bc0c5febb21e None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:41.701202 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a193f98-f56f-448b-af50-bc0c5febb21e None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:41.702873 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 150/299] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:41.708428 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e3243-313b-45d0-8053-8046137ef83a None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:41.708839 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e3243-313b-45d0-8053-8046137ef83a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:41.709033 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e3243-313b-45d0-8053-8046137ef83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:41.731096 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-092e3243-313b-45d0-8053-8046137ef83a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:41.732235 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-092e3243-313b-45d0-8053-8046137ef83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:41.793898 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 150/300] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:41.815765 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a193f98-f56f-448b-af50-bc0c5febb21e None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:41.827285 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a193f98-f56f-448b-af50-bc0c5febb21e None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:41.831935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fe24c-9f00-482f-bbbc-7f62903071f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:41.832654 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fe24c-9f00-482f-bbbc-7f62903071f3 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:41.832941 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fe24c-9f00-482f-bbbc-7f62903071f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:41.833215 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fe24c-9f00-482f-bbbc-7f62903071f3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:41.844764 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fe24c-9f00-482f-bbbc-7f62903071f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:41.851220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-289fe24c-9f00-482f-bbbc-7f62903071f3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 01:22:41.852274 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 151/301] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:22:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:41.857846 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e3243-313b-45d0-8053-8046137ef83a None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:41.866227 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e3243-313b-45d0-8053-8046137ef83a None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:41.870130 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e2800-2010-4652-8e3a-b16dd6054586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:41.870719 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e2800-2010-4652-8e3a-b16dd6054586 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:41.871009 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e2800-2010-4652-8e3a-b16dd6054586 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:41.871292 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e2800-2010-4652-8e3a-b16dd6054586 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:41.871996 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e2800-2010-4652-8e3a-b16dd6054586 admin admin] RBAC: Adding query filter params (name=member) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:41.872298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e2800-2010-4652-8e3a-b16dd6054586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:41.898854 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e2800-2010-4652-8e3a-b16dd6054586 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:41.907301 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 151/302] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Aug 23 01:22:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:41.912447 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fe24c-9f00-482f-bbbc-7f62903071f3 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:41.921505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fe24c-9f00-482f-bbbc-7f62903071f3 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:41.925396 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb79f-5638-4754-92f8-4052f2b09f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:41.925951 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb79f-5638-4754-92f8-4052f2b09f0a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:41.926239 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb79f-5638-4754-92f8-4052f2b09f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:41.926520 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb79f-5638-4754-92f8-4052f2b09f0a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:41.934030 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3eb79f-5638-4754-92f8-4052f2b09f0a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:41.960402 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3eb79f-5638-4754-92f8-4052f2b09f0a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:41.968679 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 152/303] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:22:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:22:41.974116 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e2800-2010-4652-8e3a-b16dd6054586 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:41.982950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e2800-2010-4652-8e3a-b16dd6054586 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:41.987270 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee0b19-ed7c-43f1-83bb-ce1c4232755f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:41.988029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee0b19-ed7c-43f1-83bb-ce1c4232755f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:41.988315 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee0b19-ed7c-43f1-83bb-ce1c4232755f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:41.988618 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee0b19-ed7c-43f1-83bb-ce1c4232755f admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:41.989671 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee0b19-ed7c-43f1-83bb-ce1c4232755f admin admin] RBAC: Authorizing `identity:get_project(project_id=d95c944d92ef4aebaa584978535338d1)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:42.015514 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee0b19-ed7c-43f1-83bb-ce1c4232755f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:42.016991 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 152/304] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:41 2021] GET /identity/v3/projects/d95c944d92ef4aebaa584978535338d1 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:22:42.021779 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb79f-5638-4754-92f8-4052f2b09f0a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:42.030013 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb79f-5638-4754-92f8-4052f2b09f0a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:42.033881 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58719614-ecac-4d2c-ab05-7371a3205c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:42.034630 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58719614-ecac-4d2c-ab05-7371a3205c98 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:42.034916 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58719614-ecac-4d2c-ab05-7371a3205c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:42.035199 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58719614-ecac-4d2c-ab05-7371a3205c98 admin admin] PATH_INFO: `/v3/groups/8c28a5a980b642488b4ffb9b021959a6` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:42.036229 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58719614-ecac-4d2c-ab05-7371a3205c98 admin admin] RBAC: Authorizing `identity:get_group(group_id=8c28a5a980b642488b4ffb9b021959a6)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:42.061979 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58719614-ecac-4d2c-ab05-7371a3205c98 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:42.063974 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 153/305] 10.222.0.20 () {56 vars in 1202 bytes} [Mon Aug 23 01:22:42 2021] GET /identity/v3/groups/8c28a5a980b642488b4ffb9b021959a6 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:42.069039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee0b19-ed7c-43f1-83bb-ce1c4232755f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:42.077781 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee0b19-ed7c-43f1-83bb-ce1c4232755f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:42.081611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3136601-6360-4c4d-88bb-e9b4e7063838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:42.082158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3136601-6360-4c4d-88bb-e9b4e7063838 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:42.082443 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3136601-6360-4c4d-88bb-e9b4e7063838 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:42.082721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3136601-6360-4c4d-88bb-e9b4e7063838 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:42.083475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3136601-6360-4c4d-88bb-e9b4e7063838 admin admin] RBAC: Adding query filter params (group.id=8c28a5a980b642488b4ffb9b021959a6, role.id=fafc5ecb5c074178be50f3c8d8006db2, scope.project.id=d95c944d92ef4aebaa584978535338d1) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:42.083777 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3136601-6360-4c4d-88bb-e9b4e7063838 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:42.109048 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3136601-6360-4c4d-88bb-e9b4e7063838 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:42.115009 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 153/306] 10.222.0.20 () {56 vars in 1398 bytes} [Mon Aug 23 01:22:42 2021] GET /identity/v3/role_assignments?group.id=8c28a5a980b642488b4ffb9b021959a6&scope.project.id=d95c944d92ef4aebaa584978535338d1&role.id=fafc5ecb5c074178be50f3c8d8006db2 => generated 611 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:44.031493 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18c3dd-9d29-4b6e-b68d-af16314aba02 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:44.032051 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18c3dd-9d29-4b6e-b68d-af16314aba02 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:44.032051 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18c3dd-9d29-4b6e-b68d-af16314aba02 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:44.033770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 154/307] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:44.038709 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd999e-c804-4341-bef7-10ef162d5372 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:44.039120 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd999e-c804-4341-bef7-10ef162d5372 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:44.039279 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd999e-c804-4341-bef7-10ef162d5372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:44.061036 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-cccd999e-c804-4341-bef7-10ef162d5372 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:44.062157 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-cccd999e-c804-4341-bef7-10ef162d5372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:44.069126 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 154/308] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:44.091565 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18c3dd-9d29-4b6e-b68d-af16314aba02 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:44.103082 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18c3dd-9d29-4b6e-b68d-af16314aba02 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:44.106808 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99508934-542a-4bfa-9537-704238806735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:44.107518 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99508934-542a-4bfa-9537-704238806735 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:44.107802 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99508934-542a-4bfa-9537-704238806735 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:44.108079 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99508934-542a-4bfa-9537-704238806735 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:44.118746 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99508934-542a-4bfa-9537-704238806735 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:44.125338 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-99508934-542a-4bfa-9537-704238806735 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 01:22:44.126878 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 155/309] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:22:44 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:44.131961 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd999e-c804-4341-bef7-10ef162d5372 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:44.140163 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd999e-c804-4341-bef7-10ef162d5372 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:44.144672 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969471c9-0ed6-4107-a7ff-4a6e261cdae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:44.145248 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969471c9-0ed6-4107-a7ff-4a6e261cdae8 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:44.145534 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969471c9-0ed6-4107-a7ff-4a6e261cdae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:44.145812 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969471c9-0ed6-4107-a7ff-4a6e261cdae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:44.146502 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969471c9-0ed6-4107-a7ff-4a6e261cdae8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:44.146798 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969471c9-0ed6-4107-a7ff-4a6e261cdae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:44.171476 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969471c9-0ed6-4107-a7ff-4a6e261cdae8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:44.179603 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 155/310] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:22:44 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:44.184520 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99508934-542a-4bfa-9537-704238806735 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:44.194982 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99508934-542a-4bfa-9537-704238806735 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:44.199044 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b4265-c4b5-4581-bdf5-f4a3742beea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:44.199595 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b4265-c4b5-4581-bdf5-f4a3742beea0 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:44.199883 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b4265-c4b5-4581-bdf5-f4a3742beea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:44.200164 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b4265-c4b5-4581-bdf5-f4a3742beea0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:44.208217 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b4265-c4b5-4581-bdf5-f4a3742beea0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:44.233397 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b4265-c4b5-4581-bdf5-f4a3742beea0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:44.242147 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 156/311] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:22:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:22:44.247153 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969471c9-0ed6-4107-a7ff-4a6e261cdae8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:44.256579 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969471c9-0ed6-4107-a7ff-4a6e261cdae8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:44.260320 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633671a5-f50c-4340-bd22-3c63774b6c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:44.261103 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633671a5-f50c-4340-bd22-3c63774b6c41 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:44.261386 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633671a5-f50c-4340-bd22-3c63774b6c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:44.261662 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633671a5-f50c-4340-bd22-3c63774b6c41 admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:44.262695 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633671a5-f50c-4340-bd22-3c63774b6c41 admin admin] RBAC: Authorizing `identity:get_project(project_id=d95c944d92ef4aebaa584978535338d1)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:44.287763 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633671a5-f50c-4340-bd22-3c63774b6c41 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:44.289178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 156/312] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:44 2021] GET /identity/v3/projects/d95c944d92ef4aebaa584978535338d1 => generated 302 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:44.293985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b4265-c4b5-4581-bdf5-f4a3742beea0 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:44.302677 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b4265-c4b5-4581-bdf5-f4a3742beea0 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:44.306576 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97e7dc-e6d0-43cb-8d96-f6a1aefc84de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:44.307332 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97e7dc-e6d0-43cb-8d96-f6a1aefc84de admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:44.307622 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97e7dc-e6d0-43cb-8d96-f6a1aefc84de admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:44.307902 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97e7dc-e6d0-43cb-8d96-f6a1aefc84de admin admin] PATH_INFO: `/v3/groups/8c28a5a980b642488b4ffb9b021959a6` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:44.308968 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97e7dc-e6d0-43cb-8d96-f6a1aefc84de admin admin] RBAC: Authorizing `identity:get_group(group_id=8c28a5a980b642488b4ffb9b021959a6)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:44.335085 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97e7dc-e6d0-43cb-8d96-f6a1aefc84de admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:44.336686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 157/313] 10.222.0.20 () {56 vars in 1202 bytes} [Mon Aug 23 01:22:44 2021] GET /identity/v3/groups/8c28a5a980b642488b4ffb9b021959a6 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:44.342466 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633671a5-f50c-4340-bd22-3c63774b6c41 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:44.352072 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633671a5-f50c-4340-bd22-3c63774b6c41 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:44.355919 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3505b9b-e022-4fb1-8f43-f9ea324e074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:44.356491 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3505b9b-e022-4fb1-8f43-f9ea324e074a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:44.356813 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3505b9b-e022-4fb1-8f43-f9ea324e074a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:44.357098 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3505b9b-e022-4fb1-8f43-f9ea324e074a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:44.357865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3505b9b-e022-4fb1-8f43-f9ea324e074a admin admin] RBAC: Adding query filter params (group.id=8c28a5a980b642488b4ffb9b021959a6, role.id=1d347df28134487288d9c4a0c6451cb3, scope.project.id=d95c944d92ef4aebaa584978535338d1) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:44.358171 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3505b9b-e022-4fb1-8f43-f9ea324e074a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:44.384523 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3505b9b-e022-4fb1-8f43-f9ea324e074a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:44.390004 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 157/314] 10.222.0.20 () {56 vars in 1398 bytes} [Mon Aug 23 01:22:44 2021] GET /identity/v3/role_assignments?group.id=8c28a5a980b642488b4ffb9b021959a6&scope.project.id=d95c944d92ef4aebaa584978535338d1&role.id=1d347df28134487288d9c4a0c6451cb3 => generated 260 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:46.306422 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184579a-6f2f-47ab-a0ec-1a0ebc97462d None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:46.306946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184579a-6f2f-47ab-a0ec-1a0ebc97462d None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:46.307046 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184579a-6f2f-47ab-a0ec-1a0ebc97462d None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:46.308672 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 158/315] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:46.314183 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c98e6-280e-49cf-a9a9-f0c60f10c899 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:46.314600 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c98e6-280e-49cf-a9a9-f0c60f10c899 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:46.314744 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c98e6-280e-49cf-a9a9-f0c60f10c899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:46.337177 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-540c98e6-280e-49cf-a9a9-f0c60f10c899 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:46.338284 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-540c98e6-280e-49cf-a9a9-f0c60f10c899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:46.344834 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 158/316] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:46.366206 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184579a-6f2f-47ab-a0ec-1a0ebc97462d None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:46.378156 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184579a-6f2f-47ab-a0ec-1a0ebc97462d None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:46.381991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b762b-35bf-4acc-b23d-c3f036c2099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:46.382708 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b762b-35bf-4acc-b23d-c3f036c2099d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:46.382996 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b762b-35bf-4acc-b23d-c3f036c2099d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:46.383274 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b762b-35bf-4acc-b23d-c3f036c2099d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:46.394835 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b762b-35bf-4acc-b23d-c3f036c2099d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:46.401533 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-f65b762b-35bf-4acc-b23d-c3f036c2099d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 01:22:46.402599 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 159/317] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:22:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:46.407908 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c98e6-280e-49cf-a9a9-f0c60f10c899 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:46.416459 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c98e6-280e-49cf-a9a9-f0c60f10c899 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:46.421082 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb05dd-a84c-4834-a35f-059932d318ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:46.421082 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb05dd-a84c-4834-a35f-059932d318ba admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:46.421280 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb05dd-a84c-4834-a35f-059932d318ba admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:46.421552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb05dd-a84c-4834-a35f-059932d318ba admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:46.422249 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb05dd-a84c-4834-a35f-059932d318ba admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:46.422543 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb05dd-a84c-4834-a35f-059932d318ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:46.447897 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb05dd-a84c-4834-a35f-059932d318ba admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:46.456635 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 159/318] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:22:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:46.461734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b762b-35bf-4acc-b23d-c3f036c2099d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:46.471702 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b762b-35bf-4acc-b23d-c3f036c2099d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:46.475771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcd511-5b9b-4db5-bf96-d5ce6ee46777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:46.476528 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcd511-5b9b-4db5-bf96-d5ce6ee46777 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:46.476847 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcd511-5b9b-4db5-bf96-d5ce6ee46777 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:46.477130 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcd511-5b9b-4db5-bf96-d5ce6ee46777 admin admin] PATH_INFO: `/v3/groups/8c28a5a980b642488b4ffb9b021959a6` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:46.478177 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcd511-5b9b-4db5-bf96-d5ce6ee46777 admin admin] RBAC: Authorizing `identity:get_group(group_id=8c28a5a980b642488b4ffb9b021959a6)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:46.504523 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcd511-5b9b-4db5-bf96-d5ce6ee46777 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:46.505956 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 160/319] 10.222.0.20 () {56 vars in 1202 bytes} [Mon Aug 23 01:22:46 2021] GET /identity/v3/groups/8c28a5a980b642488b4ffb9b021959a6 => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:46.510905 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb05dd-a84c-4834-a35f-059932d318ba admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:46.519756 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb05dd-a84c-4834-a35f-059932d318ba admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:46.523512 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ed976-adff-410c-bb37-16bd7ead9e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:46.524267 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ed976-adff-410c-bb37-16bd7ead9e1e admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:46.524546 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ed976-adff-410c-bb37-16bd7ead9e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:46.524850 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ed976-adff-410c-bb37-16bd7ead9e1e admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:46.525891 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ed976-adff-410c-bb37-16bd7ead9e1e admin admin] RBAC: Authorizing `identity:get_project(project_id=d95c944d92ef4aebaa584978535338d1)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:46.551530 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ed976-adff-410c-bb37-16bd7ead9e1e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:46.553001 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 160/320] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:46 2021] GET /identity/v3/projects/d95c944d92ef4aebaa584978535338d1 => generated 302 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:46.557944 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcd511-5b9b-4db5-bf96-d5ce6ee46777 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:46.567354 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcd511-5b9b-4db5-bf96-d5ce6ee46777 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:46.571184 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364f336-d145-4e84-837e-50a7bf449145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:46.571951 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364f336-d145-4e84-837e-50a7bf449145 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:46.572238 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364f336-d145-4e84-837e-50a7bf449145 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:46.572520 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364f336-d145-4e84-837e-50a7bf449145 admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1/groups/8c28a5a980b642488b4ffb9b021959a6/roles/1d347df28134487288d9c4a0c6451cb3` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:46.574524 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364f336-d145-4e84-837e-50a7bf449145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95c944d92ef4aebaa584978535338d1, group_id=8c28a5a980b642488b4ffb9b021959a6, role_id=1d347df28134487288d9c4a0c6451cb3)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:46.601221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364f336-d145-4e84-837e-50a7bf449145 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:46.693504 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 161/321] 10.222.0.20 () {58 vars in 1464 bytes} [Mon Aug 23 01:22:46 2021] PUT /identity/v3/projects/d95c944d92ef4aebaa584978535338d1/groups/8c28a5a980b642488b4ffb9b021959a6/roles/1d347df28134487288d9c4a0c6451cb3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:22:48.605172 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01046553-472d-4841-9118-dae9048363c8 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:48.605666 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01046553-472d-4841-9118-dae9048363c8 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:48.605754 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01046553-472d-4841-9118-dae9048363c8 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:48.607382 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 161/322] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:48.613109 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a35031-9aa0-484d-901f-3ca2b7dbc1d3 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:48.613512 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a35031-9aa0-484d-901f-3ca2b7dbc1d3 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:48.613685 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a35031-9aa0-484d-901f-3ca2b7dbc1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:48.635486 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-23a35031-9aa0-484d-901f-3ca2b7dbc1d3 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:48.636636 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-23a35031-9aa0-484d-901f-3ca2b7dbc1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:48.698629 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 162/323] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:48.720379 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01046553-472d-4841-9118-dae9048363c8 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:48.731764 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01046553-472d-4841-9118-dae9048363c8 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:48.736108 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15230301-d343-482e-a2d8-1971108b2000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:48.736842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15230301-d343-482e-a2d8-1971108b2000 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:48.737127 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15230301-d343-482e-a2d8-1971108b2000 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:48.737402 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15230301-d343-482e-a2d8-1971108b2000 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:48.749032 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15230301-d343-482e-a2d8-1971108b2000 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:48.756074 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-15230301-d343-482e-a2d8-1971108b2000 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 01:22:48.757141 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 162/324] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:22:48 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:48.762361 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a35031-9aa0-484d-901f-3ca2b7dbc1d3 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:48.771186 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a35031-9aa0-484d-901f-3ca2b7dbc1d3 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:48.775067 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d52243-91ec-4c7d-8f9e-d767ce1bb31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:48.775646 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d52243-91ec-4c7d-8f9e-d767ce1bb31c admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:48.775936 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d52243-91ec-4c7d-8f9e-d767ce1bb31c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:48.776218 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d52243-91ec-4c7d-8f9e-d767ce1bb31c admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:48.776965 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d52243-91ec-4c7d-8f9e-d767ce1bb31c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:48.777273 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d52243-91ec-4c7d-8f9e-d767ce1bb31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:48.803000 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d52243-91ec-4c7d-8f9e-d767ce1bb31c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:48.811252 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 163/325] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:22:48 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:48.816171 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15230301-d343-482e-a2d8-1971108b2000 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:48.824972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15230301-d343-482e-a2d8-1971108b2000 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:48.829182 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ba957-d3de-41b4-8928-5f6e64efbfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:48.829721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ba957-d3de-41b4-8928-5f6e64efbfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:48.830002 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ba957-d3de-41b4-8928-5f6e64efbfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:48.830281 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ba957-d3de-41b4-8928-5f6e64efbfa5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:48.837643 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ba957-d3de-41b4-8928-5f6e64efbfa5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:48.863380 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ba957-d3de-41b4-8928-5f6e64efbfa5 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:48.871422 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 163/326] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:22:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:22:48.876540 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d52243-91ec-4c7d-8f9e-d767ce1bb31c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:48.885384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d52243-91ec-4c7d-8f9e-d767ce1bb31c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:48.889508 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411ec72-2ec4-49bd-8c13-211a4e9714cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:48.890264 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411ec72-2ec4-49bd-8c13-211a4e9714cd admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:48.890552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411ec72-2ec4-49bd-8c13-211a4e9714cd admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:48.890833 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411ec72-2ec4-49bd-8c13-211a4e9714cd admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:48.892382 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411ec72-2ec4-49bd-8c13-211a4e9714cd admin admin] RBAC: Authorizing `identity:get_project(project_id=d95c944d92ef4aebaa584978535338d1)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:48.918428 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411ec72-2ec4-49bd-8c13-211a4e9714cd admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:48.919889 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 164/327] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:48 2021] GET /identity/v3/projects/d95c944d92ef4aebaa584978535338d1 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:48.924857 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ba957-d3de-41b4-8928-5f6e64efbfa5 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:48.932922 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ba957-d3de-41b4-8928-5f6e64efbfa5 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:48.936733 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cc405-dc61-426c-8e08-900727c9faf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:48.937477 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cc405-dc61-426c-8e08-900727c9faf4 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:48.937760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cc405-dc61-426c-8e08-900727c9faf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:48.938191 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cc405-dc61-426c-8e08-900727c9faf4 admin admin] PATH_INFO: `/v3/groups/8c28a5a980b642488b4ffb9b021959a6` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:48.939073 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cc405-dc61-426c-8e08-900727c9faf4 admin admin] RBAC: Authorizing `identity:get_group(group_id=8c28a5a980b642488b4ffb9b021959a6)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:48.964628 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cc405-dc61-426c-8e08-900727c9faf4 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:48.965966 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 164/328] 10.222.0.20 () {56 vars in 1202 bytes} [Mon Aug 23 01:22:48 2021] GET /identity/v3/groups/8c28a5a980b642488b4ffb9b021959a6 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:48.971658 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411ec72-2ec4-49bd-8c13-211a4e9714cd admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:48.980764 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411ec72-2ec4-49bd-8c13-211a4e9714cd admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:48.984636 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73178a46-9689-42e2-834c-8334a4036169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:48.985183 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73178a46-9689-42e2-834c-8334a4036169 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:48.985472 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73178a46-9689-42e2-834c-8334a4036169 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:48.985753 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73178a46-9689-42e2-834c-8334a4036169 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:48.986512 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73178a46-9689-42e2-834c-8334a4036169 admin admin] RBAC: Adding query filter params (group.id=8c28a5a980b642488b4ffb9b021959a6, role.id=1d347df28134487288d9c4a0c6451cb3, scope.project.id=d95c944d92ef4aebaa584978535338d1) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:48.987075 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73178a46-9689-42e2-834c-8334a4036169 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:49.012999 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73178a46-9689-42e2-834c-8334a4036169 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:49.019025 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 165/329] 10.222.0.20 () {56 vars in 1398 bytes} [Mon Aug 23 01:22:48 2021] GET /identity/v3/role_assignments?group.id=8c28a5a980b642488b4ffb9b021959a6&scope.project.id=d95c944d92ef4aebaa584978535338d1&role.id=1d347df28134487288d9c4a0c6451cb3 => generated 611 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:50.935838 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c1283-b176-45a5-a3cb-595225e76de7 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:50.936354 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c1283-b176-45a5-a3cb-595225e76de7 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:50.936445 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c1283-b176-45a5-a3cb-595225e76de7 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:50.938610 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 165/330] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:50.943545 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeca07-4c6c-4af7-bb56-133cac1fbc97 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:50.943909 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeca07-4c6c-4af7-bb56-133cac1fbc97 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:50.944117 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeca07-4c6c-4af7-bb56-133cac1fbc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:50.966652 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-8caeca07-4c6c-4af7-bb56-133cac1fbc97 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:50.967787 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-8caeca07-4c6c-4af7-bb56-133cac1fbc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:50.974719 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 166/331] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:50.996520 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c1283-b176-45a5-a3cb-595225e76de7 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:51.008288 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c1283-b176-45a5-a3cb-595225e76de7 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:51.012014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34111d9a-0100-4328-9c10-b397583b634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:51.012731 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34111d9a-0100-4328-9c10-b397583b634b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:51.013014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34111d9a-0100-4328-9c10-b397583b634b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:51.013287 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34111d9a-0100-4328-9c10-b397583b634b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:51.023964 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34111d9a-0100-4328-9c10-b397583b634b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:51.030194 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-34111d9a-0100-4328-9c10-b397583b634b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:22:51.031234 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 166/332] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:22:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:51.036529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caeca07-4c6c-4af7-bb56-133cac1fbc97 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:51.044897 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caeca07-4c6c-4af7-bb56-133cac1fbc97 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:51.049306 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4974034-9d45-47a9-a09f-37e9b07a848f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:51.049882 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4974034-9d45-47a9-a09f-37e9b07a848f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:51.050169 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4974034-9d45-47a9-a09f-37e9b07a848f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:51.050452 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4974034-9d45-47a9-a09f-37e9b07a848f admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:51.051160 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4974034-9d45-47a9-a09f-37e9b07a848f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:51.051457 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4974034-9d45-47a9-a09f-37e9b07a848f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:51.077135 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4974034-9d45-47a9-a09f-37e9b07a848f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:51.085433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 167/333] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:22:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:51.090288 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34111d9a-0100-4328-9c10-b397583b634b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:51.100244 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34111d9a-0100-4328-9c10-b397583b634b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:51.104027 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65258df-1b25-4769-8ec0-29e2956bbcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:51.104587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65258df-1b25-4769-8ec0-29e2956bbcf2 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:51.104874 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65258df-1b25-4769-8ec0-29e2956bbcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:51.105150 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65258df-1b25-4769-8ec0-29e2956bbcf2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:51.113000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65258df-1b25-4769-8ec0-29e2956bbcf2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:51.138303 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65258df-1b25-4769-8ec0-29e2956bbcf2 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:51.146355 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 167/334] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:22:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:22:51.151389 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4974034-9d45-47a9-a09f-37e9b07a848f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:51.160191 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4974034-9d45-47a9-a09f-37e9b07a848f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:51.163996 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ae664-9267-47ef-9130-69ac4c5a3341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:51.164780 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ae664-9267-47ef-9130-69ac4c5a3341 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:51.165072 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ae664-9267-47ef-9130-69ac4c5a3341 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:51.165355 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ae664-9267-47ef-9130-69ac4c5a3341 admin admin] PATH_INFO: `/v3/projects/4f6bd6480e9c4a609f8c029a43846e42` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:51.166405 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ae664-9267-47ef-9130-69ac4c5a3341 admin admin] RBAC: Authorizing `identity:get_project(project_id=4f6bd6480e9c4a609f8c029a43846e42)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:51.192776 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ae664-9267-47ef-9130-69ac4c5a3341 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:51.194189 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 168/335] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:51 2021] GET /identity/v3/projects/4f6bd6480e9c4a609f8c029a43846e42 => generated 344 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:51.198929 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65258df-1b25-4769-8ec0-29e2956bbcf2 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:51.206905 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65258df-1b25-4769-8ec0-29e2956bbcf2 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:51.210681 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4076b2-01f1-46da-9dc8-05b4e5c16301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:51.211422 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4076b2-01f1-46da-9dc8-05b4e5c16301 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:51.211702 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4076b2-01f1-46da-9dc8-05b4e5c16301 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:51.211976 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4076b2-01f1-46da-9dc8-05b4e5c16301 admin admin] PATH_INFO: `/v3/groups/dca5af1123cb4fcf81e9f13ab95cc826` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:51.216355 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4076b2-01f1-46da-9dc8-05b4e5c16301 admin admin] RBAC: Authorizing `identity:get_group(group_id=dca5af1123cb4fcf81e9f13ab95cc826)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:51.242739 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4076b2-01f1-46da-9dc8-05b4e5c16301 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:51.244175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 168/336] 10.222.0.20 () {56 vars in 1202 bytes} [Mon Aug 23 01:22:51 2021] GET /identity/v3/groups/dca5af1123cb4fcf81e9f13ab95cc826 => generated 229 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:51.249700 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ae664-9267-47ef-9130-69ac4c5a3341 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:51.259410 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ae664-9267-47ef-9130-69ac4c5a3341 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:51.263161 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26e293-4b58-4e44-9370-82a1f78e3185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:51.263723 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26e293-4b58-4e44-9370-82a1f78e3185 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:51.264006 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26e293-4b58-4e44-9370-82a1f78e3185 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:51.264282 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26e293-4b58-4e44-9370-82a1f78e3185 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:51.265078 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26e293-4b58-4e44-9370-82a1f78e3185 admin admin] RBAC: Adding query filter params (group.id=dca5af1123cb4fcf81e9f13ab95cc826, role.id=56d36413cf4047229b6f9d36a3990b0d, scope.project.id=4f6bd6480e9c4a609f8c029a43846e42) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:51.265489 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26e293-4b58-4e44-9370-82a1f78e3185 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:51.290524 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26e293-4b58-4e44-9370-82a1f78e3185 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:51.295617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 169/337] 10.222.0.20 () {56 vars in 1398 bytes} [Mon Aug 23 01:22:51 2021] GET /identity/v3/role_assignments?group.id=dca5af1123cb4fcf81e9f13ab95cc826&scope.project.id=4f6bd6480e9c4a609f8c029a43846e42&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 260 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:53.186580 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d4707-d85e-4144-b8e6-5750f9cfde28 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:53.187127 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d4707-d85e-4144-b8e6-5750f9cfde28 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:53.187127 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d4707-d85e-4144-b8e6-5750f9cfde28 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:53.189326 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 169/338] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:53.194328 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38440680-32ca-4ccb-830d-b885cdbb6bf1 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:53.194689 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38440680-32ca-4ccb-830d-b885cdbb6bf1 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:53.194890 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38440680-32ca-4ccb-830d-b885cdbb6bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:53.218370 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-38440680-32ca-4ccb-830d-b885cdbb6bf1 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:53.219513 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-38440680-32ca-4ccb-830d-b885cdbb6bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:53.226218 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 170/339] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:53.247593 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d4707-d85e-4144-b8e6-5750f9cfde28 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:53.258957 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d4707-d85e-4144-b8e6-5750f9cfde28 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:53.262744 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ed0ae-16d6-4483-8e9b-3a76f398a910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:53.263447 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ed0ae-16d6-4483-8e9b-3a76f398a910 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:53.263732 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ed0ae-16d6-4483-8e9b-3a76f398a910 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:53.264007 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ed0ae-16d6-4483-8e9b-3a76f398a910 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:53.275292 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ed0ae-16d6-4483-8e9b-3a76f398a910 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:53.282125 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-c78ed0ae-16d6-4483-8e9b-3a76f398a910 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:22:53.283171 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 170/340] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:22:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:53.288257 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38440680-32ca-4ccb-830d-b885cdbb6bf1 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:53.296467 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38440680-32ca-4ccb-830d-b885cdbb6bf1 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:53.300279 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed157d9a-7679-4ba1-9274-eebed869e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:53.300876 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed157d9a-7679-4ba1-9274-eebed869e532 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:53.301161 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed157d9a-7679-4ba1-9274-eebed869e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:53.301438 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed157d9a-7679-4ba1-9274-eebed869e532 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:53.302132 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed157d9a-7679-4ba1-9274-eebed869e532 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:53.302431 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed157d9a-7679-4ba1-9274-eebed869e532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:53.327206 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed157d9a-7679-4ba1-9274-eebed869e532 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:53.335946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 171/341] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:22:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:53.341012 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ed0ae-16d6-4483-8e9b-3a76f398a910 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:53.351629 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ed0ae-16d6-4483-8e9b-3a76f398a910 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:53.355392 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181699b-464f-49eb-840e-c28a9aab2e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:53.356127 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181699b-464f-49eb-840e-c28a9aab2e3f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:53.356409 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181699b-464f-49eb-840e-c28a9aab2e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:53.356721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181699b-464f-49eb-840e-c28a9aab2e3f admin admin] PATH_INFO: `/v3/groups/dca5af1123cb4fcf81e9f13ab95cc826` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:53.357744 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181699b-464f-49eb-840e-c28a9aab2e3f admin admin] RBAC: Authorizing `identity:get_group(group_id=dca5af1123cb4fcf81e9f13ab95cc826)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:53.382724 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181699b-464f-49eb-840e-c28a9aab2e3f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:53.384115 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 171/342] 10.222.0.20 () {56 vars in 1202 bytes} [Mon Aug 23 01:22:53 2021] GET /identity/v3/groups/dca5af1123cb4fcf81e9f13ab95cc826 => generated 229 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:22:53.389042 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed157d9a-7679-4ba1-9274-eebed869e532 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:53.398452 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed157d9a-7679-4ba1-9274-eebed869e532 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:53.402318 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d6f67-1b5b-43e7-9acf-48e0f7c0e108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:53.403082 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d6f67-1b5b-43e7-9acf-48e0f7c0e108 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:53.403361 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d6f67-1b5b-43e7-9acf-48e0f7c0e108 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:53.403633 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d6f67-1b5b-43e7-9acf-48e0f7c0e108 admin admin] PATH_INFO: `/v3/projects/4f6bd6480e9c4a609f8c029a43846e42` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:53.404695 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d6f67-1b5b-43e7-9acf-48e0f7c0e108 admin admin] RBAC: Authorizing `identity:get_project(project_id=4f6bd6480e9c4a609f8c029a43846e42)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:53.430437 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d6f67-1b5b-43e7-9acf-48e0f7c0e108 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:53.431939 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 172/343] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:53 2021] GET /identity/v3/projects/4f6bd6480e9c4a609f8c029a43846e42 => generated 344 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:53.437214 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181699b-464f-49eb-840e-c28a9aab2e3f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:53.446202 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181699b-464f-49eb-840e-c28a9aab2e3f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:53.450038 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df7c14-127f-4848-9cdd-6d7f97bdc588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:53.450817 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df7c14-127f-4848-9cdd-6d7f97bdc588 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:53.451099 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df7c14-127f-4848-9cdd-6d7f97bdc588 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:53.451375 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df7c14-127f-4848-9cdd-6d7f97bdc588 admin admin] PATH_INFO: `/v3/projects/4f6bd6480e9c4a609f8c029a43846e42/groups/dca5af1123cb4fcf81e9f13ab95cc826/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:53.453074 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df7c14-127f-4848-9cdd-6d7f97bdc588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6bd6480e9c4a609f8c029a43846e42, group_id=dca5af1123cb4fcf81e9f13ab95cc826, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:53.480345 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df7c14-127f-4848-9cdd-6d7f97bdc588 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:53.582559 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 172/344] 10.222.0.20 () {58 vars in 1464 bytes} [Mon Aug 23 01:22:53 2021] PUT /identity/v3/projects/4f6bd6480e9c4a609f8c029a43846e42/groups/dca5af1123cb4fcf81e9f13ab95cc826/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:22:55.499315 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c6dcc-fd35-4736-9bc9-6af622c82e6c None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:55.499820 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c6dcc-fd35-4736-9bc9-6af622c82e6c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:55.499910 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c6dcc-fd35-4736-9bc9-6af622c82e6c None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:55.502192 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 173/345] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:55.507176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a5af6-114a-458a-b143-42ba27b74505 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:55.507557 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a5af6-114a-458a-b143-42ba27b74505 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:55.507736 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a5af6-114a-458a-b143-42ba27b74505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:55.529301 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-d71a5af6-114a-458a-b143-42ba27b74505 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:55.530401 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-d71a5af6-114a-458a-b143-42ba27b74505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:55.592770 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 173/346] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:55.615308 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c6dcc-fd35-4736-9bc9-6af622c82e6c None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:55.627134 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c6dcc-fd35-4736-9bc9-6af622c82e6c None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:55.630860 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273170d6-3581-467b-afda-7f5d39e8c19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:55.631552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273170d6-3581-467b-afda-7f5d39e8c19d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:55.631835 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273170d6-3581-467b-afda-7f5d39e8c19d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:55.632109 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273170d6-3581-467b-afda-7f5d39e8c19d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:55.643683 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273170d6-3581-467b-afda-7f5d39e8c19d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:22:55.649908 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-273170d6-3581-467b-afda-7f5d39e8c19d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:22:55.650987 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 174/347] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:22:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:55.656779 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a5af6-114a-458a-b143-42ba27b74505 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:55.665665 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a5af6-114a-458a-b143-42ba27b74505 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:55.669531 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678c3ef-b7af-4a72-8558-de78aea5965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:55.670122 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678c3ef-b7af-4a72-8558-de78aea5965d admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:55.670408 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678c3ef-b7af-4a72-8558-de78aea5965d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:55.670684 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678c3ef-b7af-4a72-8558-de78aea5965d admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:55.671387 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678c3ef-b7af-4a72-8558-de78aea5965d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:55.671683 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678c3ef-b7af-4a72-8558-de78aea5965d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:55.697458 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678c3ef-b7af-4a72-8558-de78aea5965d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:55.705985 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 174/348] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:22:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:55.711550 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273170d6-3581-467b-afda-7f5d39e8c19d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:55.720738 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273170d6-3581-467b-afda-7f5d39e8c19d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:55.724844 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370930fe-8304-4b16-9ba8-379474137c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:55.725404 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370930fe-8304-4b16-9ba8-379474137c7f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:55.725687 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370930fe-8304-4b16-9ba8-379474137c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:55.725964 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370930fe-8304-4b16-9ba8-379474137c7f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:55.733341 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370930fe-8304-4b16-9ba8-379474137c7f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:55.759420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370930fe-8304-4b16-9ba8-379474137c7f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:55.767517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 175/349] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:22:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:22:55.773114 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678c3ef-b7af-4a72-8558-de78aea5965d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:55.782015 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678c3ef-b7af-4a72-8558-de78aea5965d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:55.785845 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba749e17-b763-43ef-81b6-9c5b4d4d4219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:55.786602 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba749e17-b763-43ef-81b6-9c5b4d4d4219 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:55.786885 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba749e17-b763-43ef-81b6-9c5b4d4d4219 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:55.787162 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba749e17-b763-43ef-81b6-9c5b4d4d4219 admin admin] PATH_INFO: `/v3/projects/4f6bd6480e9c4a609f8c029a43846e42` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:55.788216 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba749e17-b763-43ef-81b6-9c5b4d4d4219 admin admin] RBAC: Authorizing `identity:get_project(project_id=4f6bd6480e9c4a609f8c029a43846e42)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:55.814333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba749e17-b763-43ef-81b6-9c5b4d4d4219 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:55.815823 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 175/350] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:22:55 2021] GET /identity/v3/projects/4f6bd6480e9c4a609f8c029a43846e42 => generated 344 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:22:55.820942 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370930fe-8304-4b16-9ba8-379474137c7f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:55.829214 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370930fe-8304-4b16-9ba8-379474137c7f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:55.833126 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf914d-2970-444e-a001-e1165836567c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:55.833883 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf914d-2970-444e-a001-e1165836567c admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:55.834170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf914d-2970-444e-a001-e1165836567c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:55.834452 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf914d-2970-444e-a001-e1165836567c admin admin] PATH_INFO: `/v3/groups/dca5af1123cb4fcf81e9f13ab95cc826` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:55.835495 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf914d-2970-444e-a001-e1165836567c admin admin] RBAC: Authorizing `identity:get_group(group_id=dca5af1123cb4fcf81e9f13ab95cc826)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:55.862144 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf914d-2970-444e-a001-e1165836567c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:55.863541 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 176/351] 10.222.0.20 () {56 vars in 1202 bytes} [Mon Aug 23 01:22:55 2021] GET /identity/v3/groups/dca5af1123cb4fcf81e9f13ab95cc826 => generated 229 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:55.868742 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba749e17-b763-43ef-81b6-9c5b4d4d4219 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:55.877548 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba749e17-b763-43ef-81b6-9c5b4d4d4219 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:55.881390 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d3956-a00b-4179-92bb-b1d6d6f06713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:55.881945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d3956-a00b-4179-92bb-b1d6d6f06713 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:55.882231 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d3956-a00b-4179-92bb-b1d6d6f06713 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:55.882514 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d3956-a00b-4179-92bb-b1d6d6f06713 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:55.883265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d3956-a00b-4179-92bb-b1d6d6f06713 admin admin] RBAC: Adding query filter params (group.id=dca5af1123cb4fcf81e9f13ab95cc826, role.id=56d36413cf4047229b6f9d36a3990b0d, scope.project.id=4f6bd6480e9c4a609f8c029a43846e42) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:55.883567 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d3956-a00b-4179-92bb-b1d6d6f06713 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:55.908907 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d3956-a00b-4179-92bb-b1d6d6f06713 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:55.914359 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 176/352] 10.222.0.20 () {56 vars in 1398 bytes} [Mon Aug 23 01:22:55 2021] GET /identity/v3/role_assignments?group.id=dca5af1123cb4fcf81e9f13ab95cc826&scope.project.id=4f6bd6480e9c4a609f8c029a43846e42&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 611 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:57.889185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80995430-4058-41a4-98ab-18dede33e4e7 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:57.889685 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80995430-4058-41a4-98ab-18dede33e4e7 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:57.889791 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80995430-4058-41a4-98ab-18dede33e4e7 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:57.891922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 177/353] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:22:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:22:57.897018 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4e811-eeeb-4c96-94eb-98de9015b66e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:57.897404 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4e811-eeeb-4c96-94eb-98de9015b66e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:57.897595 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4e811-eeeb-4c96-94eb-98de9015b66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:57.920117 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-26d4e811-eeeb-4c96-94eb-98de9015b66e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:22:57.921271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-26d4e811-eeeb-4c96-94eb-98de9015b66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:22:57.927788 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 177/354] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:22:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:22:57.950593 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80995430-4058-41a4-98ab-18dede33e4e7 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:57.962449 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80995430-4058-41a4-98ab-18dede33e4e7 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:57.966289 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6212ec-c48d-4621-b05b-5f8b671ad263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:57.966988 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6212ec-c48d-4621-b05b-5f8b671ad263 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:57.967274 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6212ec-c48d-4621-b05b-5f8b671ad263 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:57.967556 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6212ec-c48d-4621-b05b-5f8b671ad263 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:57.980402 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6212ec-c48d-4621-b05b-5f8b671ad263 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:58.005530 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6212ec-c48d-4621-b05b-5f8b671ad263 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:58.022575 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-bd6212ec-c48d-4621-b05b-5f8b671ad263 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:22:58.023645 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 178/355] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:22:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:22:58.029245 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4e811-eeeb-4c96-94eb-98de9015b66e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:58.038280 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4e811-eeeb-4c96-94eb-98de9015b66e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:58.042221 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011cf067-5af2-42c1-b5e9-beaa441a7944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:58.042806 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cf067-5af2-42c1-b5e9-beaa441a7944 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:58.043093 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cf067-5af2-42c1-b5e9-beaa441a7944 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:58.043374 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cf067-5af2-42c1-b5e9-beaa441a7944 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:58.044051 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011cf067-5af2-42c1-b5e9-beaa441a7944 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:22:58.044351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011cf067-5af2-42c1-b5e9-beaa441a7944 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:58.069116 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011cf067-5af2-42c1-b5e9-beaa441a7944 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:58.082202 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 178/356] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:22:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:22:58.087473 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6212ec-c48d-4621-b05b-5f8b671ad263 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:22:58.097340 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6212ec-c48d-4621-b05b-5f8b671ad263 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:22:58.101210 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd435d3-fd29-40ca-86e9-d4b0ca085b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:22:58.101781 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd435d3-fd29-40ca-86e9-d4b0ca085b79 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:22:58.102071 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd435d3-fd29-40ca-86e9-d4b0ca085b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:22:58.102357 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd435d3-fd29-40ca-86e9-d4b0ca085b79 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:22:58.103003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd435d3-fd29-40ca-86e9-d4b0ca085b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:22:58.127666 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-4dd435d3-fd29-40ca-86e9-d4b0ca085b79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:22:58.127666 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:22:58.127666 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:22:58.128876 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd435d3-fd29-40ca-86e9-d4b0ca085b79 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:22:58.216693 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 179/357] 10.222.0.20 () {60 vars in 1154 bytes} [Mon Aug 23 01:22:58 2021] POST /identity/v3/users => generated 246 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:23:00.176389 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0d080-085f-4f84-b292-3b70045eb5b1 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:00.176948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0d080-085f-4f84-b292-3b70045eb5b1 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:00.177031 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0d080-085f-4f84-b292-3b70045eb5b1 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:00.178644 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 179/358] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:00.183686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de99d5-f465-4d94-80c2-fba008202b62 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:00.184097 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de99d5-f465-4d94-80c2-fba008202b62 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:00.184249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de99d5-f465-4d94-80c2-fba008202b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:00.206257 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-f3de99d5-f465-4d94-80c2-fba008202b62 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:00.207368 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-f3de99d5-f465-4d94-80c2-fba008202b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:00.213860 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 180/359] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:00.235938 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0d080-085f-4f84-b292-3b70045eb5b1 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:00.247332 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0d080-085f-4f84-b292-3b70045eb5b1 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:00.251699 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8797e19-2904-488c-b8aa-a737a0eb2482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:00.252398 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8797e19-2904-488c-b8aa-a737a0eb2482 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:00.252723 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8797e19-2904-488c-b8aa-a737a0eb2482 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:00.253010 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8797e19-2904-488c-b8aa-a737a0eb2482 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:00.263939 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8797e19-2904-488c-b8aa-a737a0eb2482 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:23:00.270441 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-e8797e19-2904-488c-b8aa-a737a0eb2482 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:23:00.271497 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 180/360] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:23:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:23:00.276584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de99d5-f465-4d94-80c2-fba008202b62 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:00.284841 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de99d5-f465-4d94-80c2-fba008202b62 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:00.288681 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9fed3-7613-4e0c-af52-cc8de8976a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:00.289253 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9fed3-7613-4e0c-af52-cc8de8976a40 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:00.289538 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9fed3-7613-4e0c-af52-cc8de8976a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:00.289816 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9fed3-7613-4e0c-af52-cc8de8976a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:00.290509 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9fed3-7613-4e0c-af52-cc8de8976a40 admin admin] RBAC: Adding query filter params (name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:00.290803 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9fed3-7613-4e0c-af52-cc8de8976a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:00.316243 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9fed3-7613-4e0c-af52-cc8de8976a40 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:00.324273 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 181/361] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:23:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:00.329679 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8797e19-2904-488c-b8aa-a737a0eb2482 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:00.339003 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8797e19-2904-488c-b8aa-a737a0eb2482 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:00.342867 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5915a0-a13b-43d3-8f22-dfb808de5233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:00.343555 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5915a0-a13b-43d3-8f22-dfb808de5233 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:00.343844 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5915a0-a13b-43d3-8f22-dfb808de5233 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:00.344706 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5915a0-a13b-43d3-8f22-dfb808de5233 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:00.355786 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5915a0-a13b-43d3-8f22-dfb808de5233 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:00.381391 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5915a0-a13b-43d3-8f22-dfb808de5233 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:00.399132 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-8a5915a0-a13b-43d3-8f22-dfb808de5233 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:00.400305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 181/362] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:00.405565 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9fed3-7613-4e0c-af52-cc8de8976a40 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:00.414669 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9fed3-7613-4e0c-af52-cc8de8976a40 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:00.418567 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112f477-e3d1-49ad-8092-88dfb6233cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:00.419142 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112f477-e3d1-49ad-8092-88dfb6233cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:00.419432 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112f477-e3d1-49ad-8092-88dfb6233cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:00.419714 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112f477-e3d1-49ad-8092-88dfb6233cd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:00.420392 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112f477-e3d1-49ad-8092-88dfb6233cd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:00.420730 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112f477-e3d1-49ad-8092-88dfb6233cd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:00.445672 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-1112f477-e3d1-49ad-8092-88dfb6233cd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:23:00.445672 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:23:00.445672 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:23:00.446489 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112f477-e3d1-49ad-8092-88dfb6233cd8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:00.459825 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 182/363] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:00.464913 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5915a0-a13b-43d3-8f22-dfb808de5233 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:00.474194 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5915a0-a13b-43d3-8f22-dfb808de5233 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:00.478044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5610ed-6d12-4613-8469-fdf930802d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:00.478738 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5610ed-6d12-4613-8469-fdf930802d07 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:00.479028 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5610ed-6d12-4613-8469-fdf930802d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:00.479374 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5610ed-6d12-4613-8469-fdf930802d07 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:00.491616 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5610ed-6d12-4613-8469-fdf930802d07 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:00.518118 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5610ed-6d12-4613-8469-fdf930802d07 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:00.535117 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-aa5610ed-6d12-4613-8469-fdf930802d07 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 01:23:00.536145 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 182/364] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Aug 23 01:23:00 2021] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:00.541439 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112f477-e3d1-49ad-8092-88dfb6233cd8 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:00.550446 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112f477-e3d1-49ad-8092-88dfb6233cd8 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:00.554314 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9deac-8823-4880-9af0-c271a9f6a855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:00.554891 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9deac-8823-4880-9af0-c271a9f6a855 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:00.555182 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9deac-8823-4880-9af0-c271a9f6a855 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:00.555466 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9deac-8823-4880-9af0-c271a9f6a855 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:00.556238 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9deac-8823-4880-9af0-c271a9f6a855 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:00.556543 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9deac-8823-4880-9af0-c271a9f6a855 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:00.582554 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-c9b9deac-8823-4880-9af0-c271a9f6a855 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:23:00.582554 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:23:00.582554 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:23:00.583669 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9deac-8823-4880-9af0-c271a9f6a855 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:00.612471 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 183/365] 10.222.0.20 () {56 vars in 1155 bytes} [Mon Aug 23 01:23:00 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:00.617989 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5610ed-6d12-4613-8469-fdf930802d07 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:00.627468 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5610ed-6d12-4613-8469-fdf930802d07 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:00.631203 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743669ef-c20f-4442-a120-e78cbee9d85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:00.631761 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743669ef-c20f-4442-a120-e78cbee9d85f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:00.632047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743669ef-c20f-4442-a120-e78cbee9d85f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:00.632329 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743669ef-c20f-4442-a120-e78cbee9d85f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:00.639860 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743669ef-c20f-4442-a120-e78cbee9d85f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:00.665455 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743669ef-c20f-4442-a120-e78cbee9d85f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:00.673665 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 183/366] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:23:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:23:00.678702 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9deac-8823-4880-9af0-c271a9f6a855 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:00.687557 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9deac-8823-4880-9af0-c271a9f6a855 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:00.691885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fd4a1-745e-45ba-acbc-fad634be308e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:00.692606 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fd4a1-745e-45ba-acbc-fad634be308e admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:00.692896 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fd4a1-745e-45ba-acbc-fad634be308e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:00.693174 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fd4a1-745e-45ba-acbc-fad634be308e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:00.704988 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fd4a1-745e-45ba-acbc-fad634be308e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:00.730302 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fd4a1-745e-45ba-acbc-fad634be308e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:00.746867 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-693fd4a1-745e-45ba-acbc-fad634be308e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:00.747894 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 184/367] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:00.753515 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743669ef-c20f-4442-a120-e78cbee9d85f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:00.761701 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743669ef-c20f-4442-a120-e78cbee9d85f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:00.765617 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f68fb-e4ae-415a-ad8d-ab9355b1c709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:00.766186 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f68fb-e4ae-415a-ad8d-ab9355b1c709 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:00.766474 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f68fb-e4ae-415a-ad8d-ab9355b1c709 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:00.766755 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f68fb-e4ae-415a-ad8d-ab9355b1c709 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:00.767418 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f68fb-e4ae-415a-ad8d-ab9355b1c709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:00.767715 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f68fb-e4ae-415a-ad8d-ab9355b1c709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:00.792398 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f68fb-e4ae-415a-ad8d-ab9355b1c709 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:00.805411 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 184/368] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:00.810211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fd4a1-745e-45ba-acbc-fad634be308e admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:00.819731 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fd4a1-745e-45ba-acbc-fad634be308e admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:00.823538 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2ae24-f3b0-4e51-a016-47491c3181ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:00.824214 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2ae24-f3b0-4e51-a016-47491c3181ea admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:00.824496 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2ae24-f3b0-4e51-a016-47491c3181ea admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:00.824796 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2ae24-f3b0-4e51-a016-47491c3181ea admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:00.833349 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2ae24-f3b0-4e51-a016-47491c3181ea admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:00.858808 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2ae24-f3b0-4e51-a016-47491c3181ea admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:00.872693 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-15f2ae24-f3b0-4e51-a016-47491c3181ea admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:23:00.873715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 185/369] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:23:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:00.879338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f68fb-e4ae-415a-ad8d-ab9355b1c709 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:00.888358 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f68fb-e4ae-415a-ad8d-ab9355b1c709 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:00.892195 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99363d9-cc2e-40fb-86ec-8eea5618a467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:00.892803 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99363d9-cc2e-40fb-86ec-8eea5618a467 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:00.893095 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99363d9-cc2e-40fb-86ec-8eea5618a467 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:00.893381 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99363d9-cc2e-40fb-86ec-8eea5618a467 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:00.896650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99363d9-cc2e-40fb-86ec-8eea5618a467 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:00.896650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99363d9-cc2e-40fb-86ec-8eea5618a467 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:00.919403 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-a99363d9-cc2e-40fb-86ec-8eea5618a467 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:23:00.919403 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:23:00.919403 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:23:00.920644 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99363d9-cc2e-40fb-86ec-8eea5618a467 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:00.934043 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 185/370] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:23:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:00.940015 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2ae24-f3b0-4e51-a016-47491c3181ea admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:00.948964 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2ae24-f3b0-4e51-a016-47491c3181ea admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:00.952768 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db7330-f6a2-4c7a-85e7-9f5fe4408cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:00.953360 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db7330-f6a2-4c7a-85e7-9f5fe4408cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:00.953647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db7330-f6a2-4c7a-85e7-9f5fe4408cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:00.953927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db7330-f6a2-4c7a-85e7-9f5fe4408cf3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:00.954695 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db7330-f6a2-4c7a-85e7-9f5fe4408cf3 admin admin] RBAC: Adding query filter params (role.id=aa34949eb3ac4431991f6c257fca79a9, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=094c5e571da7480584098ba6ebcb70ed) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:00.955047 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db7330-f6a2-4c7a-85e7-9f5fe4408cf3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:00.980406 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db7330-f6a2-4c7a-85e7-9f5fe4408cf3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:00.986117 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 186/371] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:23:00 2021] GET /identity/v3/role_assignments?user.id=094c5e571da7480584098ba6ebcb70ed&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=aa34949eb3ac4431991f6c257fca79a9 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:02.907625 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a7cdd-2508-4b88-89e7-583f128ab664 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:02.908141 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a7cdd-2508-4b88-89e7-583f128ab664 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:02.908232 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a7cdd-2508-4b88-89e7-583f128ab664 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:02.909910 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 186/372] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:02.914854 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb326f88-4103-4362-b314-84109be3f0fc None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:02.915265 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb326f88-4103-4362-b314-84109be3f0fc None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:02.915418 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb326f88-4103-4362-b314-84109be3f0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:02.938255 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-cb326f88-4103-4362-b314-84109be3f0fc None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:02.939386 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-cb326f88-4103-4362-b314-84109be3f0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:02.945975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 187/373] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:02.967295 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a7cdd-2508-4b88-89e7-583f128ab664 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:02.979449 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a7cdd-2508-4b88-89e7-583f128ab664 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:02.983237 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daa006-f87f-45d4-bf28-ba552bd4ad4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:02.983936 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daa006-f87f-45d4-bf28-ba552bd4ad4f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:02.984224 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daa006-f87f-45d4-bf28-ba552bd4ad4f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:02.985145 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daa006-f87f-45d4-bf28-ba552bd4ad4f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:02.995987 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daa006-f87f-45d4-bf28-ba552bd4ad4f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:23:03.002446 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-23daa006-f87f-45d4-bf28-ba552bd4ad4f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:23:03.003507 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 187/374] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:23:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:03.008668 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb326f88-4103-4362-b314-84109be3f0fc None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:03.017461 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb326f88-4103-4362-b314-84109be3f0fc None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:03.021379 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06a537-2dad-495d-9da8-2e001acc0d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:03.021954 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06a537-2dad-495d-9da8-2e001acc0d15 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:03.022240 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06a537-2dad-495d-9da8-2e001acc0d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:03.022518 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06a537-2dad-495d-9da8-2e001acc0d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:03.023213 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06a537-2dad-495d-9da8-2e001acc0d15 admin admin] RBAC: Adding query filter params (name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:03.023509 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06a537-2dad-495d-9da8-2e001acc0d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:03.049049 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06a537-2dad-495d-9da8-2e001acc0d15 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:03.057164 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 188/375] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:23:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:03.062050 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daa006-f87f-45d4-bf28-ba552bd4ad4f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:03.071351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daa006-f87f-45d4-bf28-ba552bd4ad4f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:03.075113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d475563-76d3-41aa-a1bd-d8de7302a8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:03.075787 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d475563-76d3-41aa-a1bd-d8de7302a8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:03.076071 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d475563-76d3-41aa-a1bd-d8de7302a8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:03.076347 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d475563-76d3-41aa-a1bd-d8de7302a8e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:03.087624 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d475563-76d3-41aa-a1bd-d8de7302a8e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:03.113316 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d475563-76d3-41aa-a1bd-d8de7302a8e6 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:03.130254 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-5d475563-76d3-41aa-a1bd-d8de7302a8e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:03.131268 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 188/376] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:03.136250 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06a537-2dad-495d-9da8-2e001acc0d15 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:03.145599 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06a537-2dad-495d-9da8-2e001acc0d15 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:03.149404 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33d417-3340-4973-92fe-e0019bff92fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:03.149962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33d417-3340-4973-92fe-e0019bff92fd admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:03.150247 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33d417-3340-4973-92fe-e0019bff92fd admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:03.150524 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33d417-3340-4973-92fe-e0019bff92fd admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:03.151184 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33d417-3340-4973-92fe-e0019bff92fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:03.151475 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33d417-3340-4973-92fe-e0019bff92fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:03.176972 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33d417-3340-4973-92fe-e0019bff92fd admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:03.189182 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 189/377] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:03.194090 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d475563-76d3-41aa-a1bd-d8de7302a8e6 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:03.203834 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d475563-76d3-41aa-a1bd-d8de7302a8e6 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:03.207687 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631674b-a066-41a3-9d28-2d54691df0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:03.208393 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631674b-a066-41a3-9d28-2d54691df0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:03.208724 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631674b-a066-41a3-9d28-2d54691df0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:03.209011 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631674b-a066-41a3-9d28-2d54691df0d1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:03.222283 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631674b-a066-41a3-9d28-2d54691df0d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:03.247613 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631674b-a066-41a3-9d28-2d54691df0d1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:03.264795 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-8631674b-a066-41a3-9d28-2d54691df0d1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 01:23:03.266353 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 189/378] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Aug 23 01:23:03 2021] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:03.271749 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33d417-3340-4973-92fe-e0019bff92fd admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:03.280835 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33d417-3340-4973-92fe-e0019bff92fd admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:03.285246 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533a7f7-3ce6-4aac-964b-bab8754cc167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:03.285821 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533a7f7-3ce6-4aac-964b-bab8754cc167 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:03.286105 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533a7f7-3ce6-4aac-964b-bab8754cc167 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:03.286382 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533a7f7-3ce6-4aac-964b-bab8754cc167 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:03.287156 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533a7f7-3ce6-4aac-964b-bab8754cc167 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:03.287453 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533a7f7-3ce6-4aac-964b-bab8754cc167 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:03.312865 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533a7f7-3ce6-4aac-964b-bab8754cc167 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:03.417787 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 190/379] 10.222.0.20 () {56 vars in 1155 bytes} [Mon Aug 23 01:23:03 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:03.423282 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631674b-a066-41a3-9d28-2d54691df0d1 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:03.432518 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631674b-a066-41a3-9d28-2d54691df0d1 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:03.436199 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492683b-df21-47d7-a9e4-a90374bacd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:03.437017 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492683b-df21-47d7-a9e4-a90374bacd0b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:03.437301 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492683b-df21-47d7-a9e4-a90374bacd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:03.438062 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492683b-df21-47d7-a9e4-a90374bacd0b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:03.450948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492683b-df21-47d7-a9e4-a90374bacd0b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:03.476549 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492683b-df21-47d7-a9e4-a90374bacd0b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:03.496972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-1492683b-df21-47d7-a9e4-a90374bacd0b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:03.498024 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 190/380] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:23:03.503931 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533a7f7-3ce6-4aac-964b-bab8754cc167 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:03.513207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533a7f7-3ce6-4aac-964b-bab8754cc167 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:03.517719 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72287252-c144-4ce8-8b1e-0a808a53ab79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:03.518296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72287252-c144-4ce8-8b1e-0a808a53ab79 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:03.518582 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72287252-c144-4ce8-8b1e-0a808a53ab79 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:03.518860 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72287252-c144-4ce8-8b1e-0a808a53ab79 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:03.519537 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72287252-c144-4ce8-8b1e-0a808a53ab79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:03.519832 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72287252-c144-4ce8-8b1e-0a808a53ab79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:03.544839 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72287252-c144-4ce8-8b1e-0a808a53ab79 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:03.556464 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 191/381] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:03.561428 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492683b-df21-47d7-a9e4-a90374bacd0b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:03.570852 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492683b-df21-47d7-a9e4-a90374bacd0b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:03.574803 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13633912-c656-4614-902e-ad92e7dfd26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:03.575488 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13633912-c656-4614-902e-ad92e7dfd26c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:03.575772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13633912-c656-4614-902e-ad92e7dfd26c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:03.576049 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13633912-c656-4614-902e-ad92e7dfd26c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:03.659349 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13633912-c656-4614-902e-ad92e7dfd26c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:03.688940 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13633912-c656-4614-902e-ad92e7dfd26c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:03.702171 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-13633912-c656-4614-902e-ad92e7dfd26c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:23:03.703280 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 191/382] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:23:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:23:03.709433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72287252-c144-4ce8-8b1e-0a808a53ab79 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:03.718610 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72287252-c144-4ce8-8b1e-0a808a53ab79 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:03.722763 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c15376-a34c-4224-b745-1f1398226ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:03.723335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c15376-a34c-4224-b745-1f1398226ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:03.723619 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c15376-a34c-4224-b745-1f1398226ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:03.723896 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c15376-a34c-4224-b745-1f1398226ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:03.724660 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c15376-a34c-4224-b745-1f1398226ba0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:03.724963 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c15376-a34c-4224-b745-1f1398226ba0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:03.749684 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-b2c15376-a34c-4224-b745-1f1398226ba0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:23:03.749684 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:23:03.749684 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:23:03.751416 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c15376-a34c-4224-b745-1f1398226ba0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:03.764004 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 192/383] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:23:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:03.769269 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13633912-c656-4614-902e-ad92e7dfd26c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:03.778889 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13633912-c656-4614-902e-ad92e7dfd26c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:03.782702 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae9357-acd5-4486-a83d-fb1db58e78f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:03.783475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae9357-acd5-4486-a83d-fb1db58e78f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:03.783755 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae9357-acd5-4486-a83d-fb1db58e78f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:03.784030 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae9357-acd5-4486-a83d-fb1db58e78f0 admin admin] PATH_INFO: `/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/094c5e571da7480584098ba6ebcb70ed/roles/aa34949eb3ac4431991f6c257fca79a9` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:03.803111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae9357-acd5-4486-a83d-fb1db58e78f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2728fddda1c4691b33daad4fa4ef3d2, user_id=094c5e571da7480584098ba6ebcb70ed, role_id=aa34949eb3ac4431991f6c257fca79a9)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:03.829385 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae9357-acd5-4486-a83d-fb1db58e78f0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:03.903963 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 192/384] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:23:03 2021] PUT /identity/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/094c5e571da7480584098ba6ebcb70ed/roles/aa34949eb3ac4431991f6c257fca79a9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:23:05.808027 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8f62b-5f74-494a-9ce9-09e0a73e87db None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:05.808515 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8f62b-5f74-494a-9ce9-09e0a73e87db None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:05.808515 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8f62b-5f74-494a-9ce9-09e0a73e87db None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:05.810216 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 193/385] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:05.815285 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3a732-6f5b-42e1-ae3c-a5c862e5ffce None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:05.815648 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3a732-6f5b-42e1-ae3c-a5c862e5ffce None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:05.815858 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3a732-6f5b-42e1-ae3c-a5c862e5ffce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:05.837675 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-38a3a732-6f5b-42e1-ae3c-a5c862e5ffce None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:05.838805 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-38a3a732-6f5b-42e1-ae3c-a5c862e5ffce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:05.900510 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 193/386] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:05.922946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8f62b-5f74-494a-9ce9-09e0a73e87db None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:05.934301 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8f62b-5f74-494a-9ce9-09e0a73e87db None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:05.938570 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12306af-a7c6-4b3d-82ff-3f82da3ed849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:05.939275 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12306af-a7c6-4b3d-82ff-3f82da3ed849 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:05.939560 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12306af-a7c6-4b3d-82ff-3f82da3ed849 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:05.939837 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12306af-a7c6-4b3d-82ff-3f82da3ed849 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:05.950612 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12306af-a7c6-4b3d-82ff-3f82da3ed849 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:23:05.957540 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-e12306af-a7c6-4b3d-82ff-3f82da3ed849 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:23:05.958588 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 194/387] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:23:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:05.963762 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3a732-6f5b-42e1-ae3c-a5c862e5ffce None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:05.972323 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3a732-6f5b-42e1-ae3c-a5c862e5ffce None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:05.976231 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef9b94-3107-4364-b894-750cf8619747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:05.976839 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef9b94-3107-4364-b894-750cf8619747 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:05.977129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef9b94-3107-4364-b894-750cf8619747 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:05.977409 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef9b94-3107-4364-b894-750cf8619747 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:05.978108 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef9b94-3107-4364-b894-750cf8619747 admin admin] RBAC: Adding query filter params (name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:05.978406 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef9b94-3107-4364-b894-750cf8619747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:06.004258 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef9b94-3107-4364-b894-750cf8619747 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:06.012302 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 194/388] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:23:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:06.017303 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12306af-a7c6-4b3d-82ff-3f82da3ed849 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:06.026531 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12306af-a7c6-4b3d-82ff-3f82da3ed849 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:06.030501 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d19a7f-d8f4-4732-9dd2-9eac588d4b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:06.031175 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d19a7f-d8f4-4732-9dd2-9eac588d4b43 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:06.031458 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d19a7f-d8f4-4732-9dd2-9eac588d4b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:06.031738 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d19a7f-d8f4-4732-9dd2-9eac588d4b43 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:06.042576 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d19a7f-d8f4-4732-9dd2-9eac588d4b43 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:06.068241 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d19a7f-d8f4-4732-9dd2-9eac588d4b43 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:06.085540 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-c0d19a7f-d8f4-4732-9dd2-9eac588d4b43 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:06.086549 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 195/389] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:06.091511 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef9b94-3107-4364-b894-750cf8619747 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:06.101190 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef9b94-3107-4364-b894-750cf8619747 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:06.105068 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80505d7e-f6ac-4260-b3a8-69780a6b067c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:06.105630 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80505d7e-f6ac-4260-b3a8-69780a6b067c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:06.105918 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80505d7e-f6ac-4260-b3a8-69780a6b067c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:06.106202 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80505d7e-f6ac-4260-b3a8-69780a6b067c admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:06.106868 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80505d7e-f6ac-4260-b3a8-69780a6b067c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:06.107166 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80505d7e-f6ac-4260-b3a8-69780a6b067c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:06.131914 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80505d7e-f6ac-4260-b3a8-69780a6b067c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:06.144663 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 195/390] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:06.149677 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d19a7f-d8f4-4732-9dd2-9eac588d4b43 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:06.159055 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d19a7f-d8f4-4732-9dd2-9eac588d4b43 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:06.162896 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1a01e-b20f-4d98-9522-d786d4fd2d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:06.163570 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1a01e-b20f-4d98-9522-d786d4fd2d23 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:06.163856 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1a01e-b20f-4d98-9522-d786d4fd2d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:06.164134 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1a01e-b20f-4d98-9522-d786d4fd2d23 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:06.176256 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1a01e-b20f-4d98-9522-d786d4fd2d23 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:06.201495 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1a01e-b20f-4d98-9522-d786d4fd2d23 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:06.219419 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-e4d1a01e-b20f-4d98-9522-d786d4fd2d23 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 01:23:06.220440 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 196/391] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Aug 23 01:23:06 2021] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:06.225929 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80505d7e-f6ac-4260-b3a8-69780a6b067c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:06.234752 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80505d7e-f6ac-4260-b3a8-69780a6b067c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:06.238554 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df230e-47bc-49bd-a822-cc966d220cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:06.239127 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df230e-47bc-49bd-a822-cc966d220cfc admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:06.239415 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df230e-47bc-49bd-a822-cc966d220cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:06.239695 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df230e-47bc-49bd-a822-cc966d220cfc admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:06.240460 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df230e-47bc-49bd-a822-cc966d220cfc admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:06.240791 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df230e-47bc-49bd-a822-cc966d220cfc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:06.264956 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-f0df230e-47bc-49bd-a822-cc966d220cfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:23:06.264956 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:23:06.264956 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:23:06.266673 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df230e-47bc-49bd-a822-cc966d220cfc admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:06.295502 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 196/392] 10.222.0.20 () {56 vars in 1155 bytes} [Mon Aug 23 01:23:06 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:23:06.301152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1a01e-b20f-4d98-9522-d786d4fd2d23 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:06.310130 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1a01e-b20f-4d98-9522-d786d4fd2d23 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:06.314134 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea3d68-67c0-471d-9044-2664fed4bcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:06.314688 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea3d68-67c0-471d-9044-2664fed4bcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:06.314973 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea3d68-67c0-471d-9044-2664fed4bcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:06.315250 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea3d68-67c0-471d-9044-2664fed4bcb4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:06.322700 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea3d68-67c0-471d-9044-2664fed4bcb4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:06.348795 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea3d68-67c0-471d-9044-2664fed4bcb4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:06.356985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 197/393] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:23:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:23:06.362001 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df230e-47bc-49bd-a822-cc966d220cfc admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:06.370969 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df230e-47bc-49bd-a822-cc966d220cfc admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:06.374820 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a654d9e-2a7e-4ae3-9801-cd9bb5e0ee9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:06.376053 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a654d9e-2a7e-4ae3-9801-cd9bb5e0ee9b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:06.376342 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a654d9e-2a7e-4ae3-9801-cd9bb5e0ee9b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:06.376660 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a654d9e-2a7e-4ae3-9801-cd9bb5e0ee9b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:06.387962 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a654d9e-2a7e-4ae3-9801-cd9bb5e0ee9b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:06.413686 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a654d9e-2a7e-4ae3-9801-cd9bb5e0ee9b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:06.430235 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-1a654d9e-2a7e-4ae3-9801-cd9bb5e0ee9b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:06.431332 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 197/394] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:06.436601 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea3d68-67c0-471d-9044-2664fed4bcb4 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:06.445500 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea3d68-67c0-471d-9044-2664fed4bcb4 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:06.449459 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f587ef5-595d-43c8-9b4f-df8fb579f8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:06.450034 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f587ef5-595d-43c8-9b4f-df8fb579f8eb admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:06.450323 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f587ef5-595d-43c8-9b4f-df8fb579f8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:06.450606 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f587ef5-595d-43c8-9b4f-df8fb579f8eb admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:06.451283 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f587ef5-595d-43c8-9b4f-df8fb579f8eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:06.451584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f587ef5-595d-43c8-9b4f-df8fb579f8eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:06.477428 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f587ef5-595d-43c8-9b4f-df8fb579f8eb admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:06.489938 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 198/395] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:06.494736 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a654d9e-2a7e-4ae3-9801-cd9bb5e0ee9b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:06.504080 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a654d9e-2a7e-4ae3-9801-cd9bb5e0ee9b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:06.507884 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824de3d-db15-45ec-b4b1-a9094dd5cfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:06.508590 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824de3d-db15-45ec-b4b1-a9094dd5cfec admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:06.508880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824de3d-db15-45ec-b4b1-a9094dd5cfec admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:06.509161 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824de3d-db15-45ec-b4b1-a9094dd5cfec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:06.518352 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824de3d-db15-45ec-b4b1-a9094dd5cfec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:06.543601 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824de3d-db15-45ec-b4b1-a9094dd5cfec admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:06.556981 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-a824de3d-db15-45ec-b4b1-a9094dd5cfec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:23:06.558030 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 198/396] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:23:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:06.564016 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f587ef5-595d-43c8-9b4f-df8fb579f8eb admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:06.573354 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f587ef5-595d-43c8-9b4f-df8fb579f8eb admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:06.577293 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724d401-4bcb-46ab-a149-99a31b3cf857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:06.577866 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724d401-4bcb-46ab-a149-99a31b3cf857 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:06.578697 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724d401-4bcb-46ab-a149-99a31b3cf857 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:06.578991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724d401-4bcb-46ab-a149-99a31b3cf857 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:06.579726 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724d401-4bcb-46ab-a149-99a31b3cf857 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:06.580028 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724d401-4bcb-46ab-a149-99a31b3cf857 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:06.605629 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724d401-4bcb-46ab-a149-99a31b3cf857 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:06.618241 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 199/397] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:23:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:06.623409 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824de3d-db15-45ec-b4b1-a9094dd5cfec admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:06.632740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824de3d-db15-45ec-b4b1-a9094dd5cfec admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:06.636555 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e29d20-b23a-48df-bcbb-4b5bdd3e935b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:06.637157 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e29d20-b23a-48df-bcbb-4b5bdd3e935b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:06.637444 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e29d20-b23a-48df-bcbb-4b5bdd3e935b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:06.637724 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e29d20-b23a-48df-bcbb-4b5bdd3e935b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:06.638483 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e29d20-b23a-48df-bcbb-4b5bdd3e935b admin admin] RBAC: Adding query filter params (role.id=aa34949eb3ac4431991f6c257fca79a9, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=094c5e571da7480584098ba6ebcb70ed) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:06.638786 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e29d20-b23a-48df-bcbb-4b5bdd3e935b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:06.664369 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e29d20-b23a-48df-bcbb-4b5bdd3e935b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:06.669873 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 199/398] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:23:06 2021] GET /identity/v3/role_assignments?user.id=094c5e571da7480584098ba6ebcb70ed&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=aa34949eb3ac4431991f6c257fca79a9 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:08.646971 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6abbb-4432-400c-a5da-fd5730c14210 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:08.647499 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6abbb-4432-400c-a5da-fd5730c14210 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:08.647594 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6abbb-4432-400c-a5da-fd5730c14210 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:08.649236 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 200/399] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:08.654165 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c44163-ad39-41af-99a7-bba3c3d580ca None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:08.654524 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c44163-ad39-41af-99a7-bba3c3d580ca None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:08.654734 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c44163-ad39-41af-99a7-bba3c3d580ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:08.677816 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-c8c44163-ad39-41af-99a7-bba3c3d580ca None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:08.678861 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c8c44163-ad39-41af-99a7-bba3c3d580ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:08.685352 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 200/400] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:08.706672 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6abbb-4432-400c-a5da-fd5730c14210 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:08.717874 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6abbb-4432-400c-a5da-fd5730c14210 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:08.722335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4848ce2-22dc-4ca9-9bb1-5883f0e8de81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:08.723026 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4848ce2-22dc-4ca9-9bb1-5883f0e8de81 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:08.723309 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4848ce2-22dc-4ca9-9bb1-5883f0e8de81 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:08.723583 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4848ce2-22dc-4ca9-9bb1-5883f0e8de81 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:08.734964 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4848ce2-22dc-4ca9-9bb1-5883f0e8de81 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:23:08.741324 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-a4848ce2-22dc-4ca9-9bb1-5883f0e8de81 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:23:08.742368 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 201/401] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:23:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:08.747493 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c44163-ad39-41af-99a7-bba3c3d580ca None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:08.755757 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c44163-ad39-41af-99a7-bba3c3d580ca None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:08.759637 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcde65-27e9-4026-be56-19e3f667f98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:08.760214 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcde65-27e9-4026-be56-19e3f667f98e admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:08.760502 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcde65-27e9-4026-be56-19e3f667f98e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:08.760810 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcde65-27e9-4026-be56-19e3f667f98e admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:08.761504 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcde65-27e9-4026-be56-19e3f667f98e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:08.761801 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcde65-27e9-4026-be56-19e3f667f98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:08.786984 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcde65-27e9-4026-be56-19e3f667f98e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:08.795187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 201/402] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:23:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:08.800644 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4848ce2-22dc-4ca9-9bb1-5883f0e8de81 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:08.809865 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4848ce2-22dc-4ca9-9bb1-5883f0e8de81 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:08.813714 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe1cd5-5e42-4f99-b67a-4795e1766984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:08.814384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe1cd5-5e42-4f99-b67a-4795e1766984 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:08.814667 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe1cd5-5e42-4f99-b67a-4795e1766984 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:08.814943 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe1cd5-5e42-4f99-b67a-4795e1766984 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:08.825710 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe1cd5-5e42-4f99-b67a-4795e1766984 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:08.851734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe1cd5-5e42-4f99-b67a-4795e1766984 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:08.869191 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-5abe1cd5-5e42-4f99-b67a-4795e1766984 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:08.870206 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 202/403] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:08.875299 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcde65-27e9-4026-be56-19e3f667f98e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:08.884160 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcde65-27e9-4026-be56-19e3f667f98e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:08.889370 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a1954-6e9f-4998-850d-30c68a1f1143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:08.889370 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a1954-6e9f-4998-850d-30c68a1f1143 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:08.889370 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a1954-6e9f-4998-850d-30c68a1f1143 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:08.889370 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a1954-6e9f-4998-850d-30c68a1f1143 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:08.889790 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a1954-6e9f-4998-850d-30c68a1f1143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:08.890087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a1954-6e9f-4998-850d-30c68a1f1143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:08.916186 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a1954-6e9f-4998-850d-30c68a1f1143 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:08.930464 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 202/404] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:08.935532 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe1cd5-5e42-4f99-b67a-4795e1766984 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:08.944504 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe1cd5-5e42-4f99-b67a-4795e1766984 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:08.948327 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9380724-b486-46ff-bd46-41eeb844717c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:08.952059 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9380724-b486-46ff-bd46-41eeb844717c admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:08.952059 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9380724-b486-46ff-bd46-41eeb844717c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:08.952059 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9380724-b486-46ff-bd46-41eeb844717c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:08.961738 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9380724-b486-46ff-bd46-41eeb844717c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:08.988414 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9380724-b486-46ff-bd46-41eeb844717c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:09.005272 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-d9380724-b486-46ff-bd46-41eeb844717c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 01:23:09.006302 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 203/405] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Aug 23 01:23:08 2021] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:09.011980 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a1954-6e9f-4998-850d-30c68a1f1143 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:09.021538 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a1954-6e9f-4998-850d-30c68a1f1143 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:09.025449 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45b329-3dc1-429a-b8de-03e8e83074e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:09.026287 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45b329-3dc1-429a-b8de-03e8e83074e4 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:09.026573 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45b329-3dc1-429a-b8de-03e8e83074e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:09.026850 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45b329-3dc1-429a-b8de-03e8e83074e4 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:09.027619 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45b329-3dc1-429a-b8de-03e8e83074e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:09.027919 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45b329-3dc1-429a-b8de-03e8e83074e4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:09.053698 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45b329-3dc1-429a-b8de-03e8e83074e4 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:09.081763 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 203/406] 10.222.0.20 () {56 vars in 1155 bytes} [Mon Aug 23 01:23:09 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:09.087140 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9380724-b486-46ff-bd46-41eeb844717c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:09.096912 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9380724-b486-46ff-bd46-41eeb844717c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:09.100722 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5a16e-e1b5-4deb-8e00-eb64a15ba1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:09.101272 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5a16e-e1b5-4deb-8e00-eb64a15ba1ca admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:09.101555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5a16e-e1b5-4deb-8e00-eb64a15ba1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:09.101832 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5a16e-e1b5-4deb-8e00-eb64a15ba1ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:09.109162 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5a16e-e1b5-4deb-8e00-eb64a15ba1ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:09.134032 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5a16e-e1b5-4deb-8e00-eb64a15ba1ca admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:09.142626 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 204/407] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:23:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:23:09.147667 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45b329-3dc1-429a-b8de-03e8e83074e4 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:09.156992 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45b329-3dc1-429a-b8de-03e8e83074e4 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:09.160948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecd7e7-9477-4dfe-a43d-d4a40199d661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:09.161639 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecd7e7-9477-4dfe-a43d-d4a40199d661 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:09.161924 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecd7e7-9477-4dfe-a43d-d4a40199d661 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:09.162199 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecd7e7-9477-4dfe-a43d-d4a40199d661 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:09.173292 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecd7e7-9477-4dfe-a43d-d4a40199d661 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:09.198162 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecd7e7-9477-4dfe-a43d-d4a40199d661 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:09.214544 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-19ecd7e7-9477-4dfe-a43d-d4a40199d661 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:09.215556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 204/408] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:09.221003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5a16e-e1b5-4deb-8e00-eb64a15ba1ca admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:09.229272 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5a16e-e1b5-4deb-8e00-eb64a15ba1ca admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:09.233099 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d2c8e-1af2-49fc-8b6f-0ceff396d617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:09.233650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d2c8e-1af2-49fc-8b6f-0ceff396d617 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:09.233932 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d2c8e-1af2-49fc-8b6f-0ceff396d617 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:09.234255 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d2c8e-1af2-49fc-8b6f-0ceff396d617 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:09.234916 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d2c8e-1af2-49fc-8b6f-0ceff396d617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:09.235209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d2c8e-1af2-49fc-8b6f-0ceff396d617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:09.260091 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d2c8e-1af2-49fc-8b6f-0ceff396d617 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:09.272925 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 205/409] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:09.277689 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecd7e7-9477-4dfe-a43d-d4a40199d661 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:09.287036 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecd7e7-9477-4dfe-a43d-d4a40199d661 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:09.291064 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cc272-bdb1-4afb-a4cb-3670008d4838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:09.291735 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cc272-bdb1-4afb-a4cb-3670008d4838 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:09.292020 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cc272-bdb1-4afb-a4cb-3670008d4838 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:09.292295 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cc272-bdb1-4afb-a4cb-3670008d4838 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:09.300878 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539cc272-bdb1-4afb-a4cb-3670008d4838 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:09.325954 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539cc272-bdb1-4afb-a4cb-3670008d4838 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:09.339432 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-539cc272-bdb1-4afb-a4cb-3670008d4838 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:23:09.340452 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 205/410] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:23:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:23:09.345996 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d2c8e-1af2-49fc-8b6f-0ceff396d617 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:09.355006 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d2c8e-1af2-49fc-8b6f-0ceff396d617 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:09.358865 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e192570-7f58-4c5e-a0ed-91643bc33761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:09.359440 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e192570-7f58-4c5e-a0ed-91643bc33761 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:09.359720 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e192570-7f58-4c5e-a0ed-91643bc33761 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:09.359997 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e192570-7f58-4c5e-a0ed-91643bc33761 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:09.360754 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e192570-7f58-4c5e-a0ed-91643bc33761 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:09.361051 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e192570-7f58-4c5e-a0ed-91643bc33761 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:09.387085 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e192570-7f58-4c5e-a0ed-91643bc33761 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:09.400281 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 206/411] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:23:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:23:09.405569 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cc272-bdb1-4afb-a4cb-3670008d4838 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:09.414497 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cc272-bdb1-4afb-a4cb-3670008d4838 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:09.418403 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dd979-f037-4333-81dd-0a7e17e3ae19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:09.418966 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dd979-f037-4333-81dd-0a7e17e3ae19 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:09.419251 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dd979-f037-4333-81dd-0a7e17e3ae19 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:09.419529 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dd979-f037-4333-81dd-0a7e17e3ae19 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:09.420299 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dd979-f037-4333-81dd-0a7e17e3ae19 admin admin] RBAC: Adding query filter params (role.id=56d36413cf4047229b6f9d36a3990b0d, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=094c5e571da7480584098ba6ebcb70ed) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:09.420627 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dd979-f037-4333-81dd-0a7e17e3ae19 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:09.446300 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dd979-f037-4333-81dd-0a7e17e3ae19 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:09.451530 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 206/412] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:23:09 2021] GET /identity/v3/role_assignments?user.id=094c5e571da7480584098ba6ebcb70ed&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:11.367564 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82278ef5-0084-4991-be6d-778659ab66a2 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:11.368106 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82278ef5-0084-4991-be6d-778659ab66a2 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:11.368106 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82278ef5-0084-4991-be6d-778659ab66a2 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:11.369827 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 207/413] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:11.375505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69885dae-e43f-4c71-a7a9-70f633a7c971 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:11.375912 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69885dae-e43f-4c71-a7a9-70f633a7c971 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:11.376079 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69885dae-e43f-4c71-a7a9-70f633a7c971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:11.398046 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-69885dae-e43f-4c71-a7a9-70f633a7c971 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:11.399175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-69885dae-e43f-4c71-a7a9-70f633a7c971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:11.405730 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 207/414] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:11.427639 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82278ef5-0084-4991-be6d-778659ab66a2 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:11.439633 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82278ef5-0084-4991-be6d-778659ab66a2 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:11.443404 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74751248-c9c1-4c30-8462-7e719e74c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:11.444101 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74751248-c9c1-4c30-8462-7e719e74c2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:11.444383 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74751248-c9c1-4c30-8462-7e719e74c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:11.444704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74751248-c9c1-4c30-8462-7e719e74c2b6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:11.455561 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74751248-c9c1-4c30-8462-7e719e74c2b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:23:11.461745 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-74751248-c9c1-4c30-8462-7e719e74c2b6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:23:11.462794 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 208/415] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:23:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:11.467955 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69885dae-e43f-4c71-a7a9-70f633a7c971 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:11.476473 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69885dae-e43f-4c71-a7a9-70f633a7c971 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:11.480296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0498a0-fdee-4168-9acb-613441c6fc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:11.480903 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0498a0-fdee-4168-9acb-613441c6fc54 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:11.481192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0498a0-fdee-4168-9acb-613441c6fc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:11.481468 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0498a0-fdee-4168-9acb-613441c6fc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:11.482155 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0498a0-fdee-4168-9acb-613441c6fc54 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:11.482446 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0498a0-fdee-4168-9acb-613441c6fc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:11.508502 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0498a0-fdee-4168-9acb-613441c6fc54 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:11.516725 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 208/416] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:23:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:11.521678 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74751248-c9c1-4c30-8462-7e719e74c2b6 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:11.532476 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74751248-c9c1-4c30-8462-7e719e74c2b6 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:11.536272 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfa6cc-ed17-4580-85cb-6638dad66102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:11.536982 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfa6cc-ed17-4580-85cb-6638dad66102 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:11.537266 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfa6cc-ed17-4580-85cb-6638dad66102 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:11.537543 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfa6cc-ed17-4580-85cb-6638dad66102 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:11.548827 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfa6cc-ed17-4580-85cb-6638dad66102 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:11.574234 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfa6cc-ed17-4580-85cb-6638dad66102 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:11.591814 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-afbfa6cc-ed17-4580-85cb-6638dad66102 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:11.592856 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 209/417] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:11.598777 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0498a0-fdee-4168-9acb-613441c6fc54 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:11.607649 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0498a0-fdee-4168-9acb-613441c6fc54 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:11.611536 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafe89b-2b75-46c6-b13d-efff432169ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:11.612103 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafe89b-2b75-46c6-b13d-efff432169ce admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:11.612412 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafe89b-2b75-46c6-b13d-efff432169ce admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:11.612733 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafe89b-2b75-46c6-b13d-efff432169ce admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:11.613409 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafe89b-2b75-46c6-b13d-efff432169ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:11.613706 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafe89b-2b75-46c6-b13d-efff432169ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:11.638899 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafe89b-2b75-46c6-b13d-efff432169ce admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:11.651697 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 209/418] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:23:11.656609 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfa6cc-ed17-4580-85cb-6638dad66102 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:11.665429 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfa6cc-ed17-4580-85cb-6638dad66102 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:11.669274 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eecd3d-d838-4460-bb33-94ae6fbc9683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:11.669950 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eecd3d-d838-4460-bb33-94ae6fbc9683 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:11.670234 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eecd3d-d838-4460-bb33-94ae6fbc9683 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:11.670510 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eecd3d-d838-4460-bb33-94ae6fbc9683 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:11.682639 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eecd3d-d838-4460-bb33-94ae6fbc9683 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:11.709093 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eecd3d-d838-4460-bb33-94ae6fbc9683 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:11.726352 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-e9eecd3d-d838-4460-bb33-94ae6fbc9683 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 01:23:11.727356 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 210/419] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Aug 23 01:23:11 2021] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:11.732253 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafe89b-2b75-46c6-b13d-efff432169ce admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:11.741063 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafe89b-2b75-46c6-b13d-efff432169ce admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:11.744923 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc401cd-1367-48c5-ba14-78c289292ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:11.745492 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc401cd-1367-48c5-ba14-78c289292ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:11.745775 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc401cd-1367-48c5-ba14-78c289292ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:11.746054 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc401cd-1367-48c5-ba14-78c289292ab5 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:11.746820 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc401cd-1367-48c5-ba14-78c289292ab5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:11.747116 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc401cd-1367-48c5-ba14-78c289292ab5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:11.773392 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc401cd-1367-48c5-ba14-78c289292ab5 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:11.800870 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 210/420] 10.222.0.20 () {56 vars in 1155 bytes} [Mon Aug 23 01:23:11 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:11.805686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eecd3d-d838-4460-bb33-94ae6fbc9683 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:11.815219 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eecd3d-d838-4460-bb33-94ae6fbc9683 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:11.819053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe0ba7-3622-4a88-a00e-cecb161408f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:11.819731 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe0ba7-3622-4a88-a00e-cecb161408f6 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:11.820014 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe0ba7-3622-4a88-a00e-cecb161408f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:11.820290 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe0ba7-3622-4a88-a00e-cecb161408f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:11.832340 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe0ba7-3622-4a88-a00e-cecb161408f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:11.858159 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe0ba7-3622-4a88-a00e-cecb161408f6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:11.874704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-47fe0ba7-3622-4a88-a00e-cecb161408f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:11.875715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 211/421] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:23:11.880529 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc401cd-1367-48c5-ba14-78c289292ab5 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:11.889589 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc401cd-1367-48c5-ba14-78c289292ab5 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:11.893440 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a6857-9ec1-4671-a1d8-f36b3cf5be86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:11.894009 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a6857-9ec1-4671-a1d8-f36b3cf5be86 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:11.894298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a6857-9ec1-4671-a1d8-f36b3cf5be86 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:11.894578 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a6857-9ec1-4671-a1d8-f36b3cf5be86 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:11.895276 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a6857-9ec1-4671-a1d8-f36b3cf5be86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:11.895575 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a6857-9ec1-4671-a1d8-f36b3cf5be86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:11.921015 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a6857-9ec1-4671-a1d8-f36b3cf5be86 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:11.933131 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 211/422] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:11.937926 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe0ba7-3622-4a88-a00e-cecb161408f6 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:11.946704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe0ba7-3622-4a88-a00e-cecb161408f6 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:11.950547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e934138-a533-4d33-a41d-5b64ca651493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:11.951222 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e934138-a533-4d33-a41d-5b64ca651493 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:11.951505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e934138-a533-4d33-a41d-5b64ca651493 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:11.951778 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e934138-a533-4d33-a41d-5b64ca651493 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:11.960300 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e934138-a533-4d33-a41d-5b64ca651493 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:11.987235 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e934138-a533-4d33-a41d-5b64ca651493 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:12.001389 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-0e934138-a533-4d33-a41d-5b64ca651493 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:23:12.002450 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 212/423] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:23:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:23:12.008047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a6857-9ec1-4671-a1d8-f36b3cf5be86 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:12.017797 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a6857-9ec1-4671-a1d8-f36b3cf5be86 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:12.021647 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b6b0f-ad90-4fee-b2b9-bfc969785697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:12.022218 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b6b0f-ad90-4fee-b2b9-bfc969785697 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:12.022501 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b6b0f-ad90-4fee-b2b9-bfc969785697 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:12.022778 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b6b0f-ad90-4fee-b2b9-bfc969785697 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:12.023504 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b6b0f-ad90-4fee-b2b9-bfc969785697 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:12.023799 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b6b0f-ad90-4fee-b2b9-bfc969785697 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:12.049790 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b6b0f-ad90-4fee-b2b9-bfc969785697 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:12.062356 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 212/424] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:23:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:12.067907 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e934138-a533-4d33-a41d-5b64ca651493 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:12.076886 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e934138-a533-4d33-a41d-5b64ca651493 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:12.081209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace8bd1-c170-4b06-99a2-fee5c8f63cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:12.081990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace8bd1-c170-4b06-99a2-fee5c8f63cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:12.082273 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace8bd1-c170-4b06-99a2-fee5c8f63cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:12.082547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace8bd1-c170-4b06-99a2-fee5c8f63cb4 admin admin] PATH_INFO: `/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/094c5e571da7480584098ba6ebcb70ed/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:12.084238 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace8bd1-c170-4b06-99a2-fee5c8f63cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2728fddda1c4691b33daad4fa4ef3d2, user_id=094c5e571da7480584098ba6ebcb70ed, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:12.111163 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace8bd1-c170-4b06-99a2-fee5c8f63cb4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:12.192694 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 213/425] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:23:12 2021] PUT /identity/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/094c5e571da7480584098ba6ebcb70ed/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:23:14.105747 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a173e6-4746-431d-9ff5-8633d2da9ed1 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:14.106292 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a173e6-4746-431d-9ff5-8633d2da9ed1 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:14.106292 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a173e6-4746-431d-9ff5-8633d2da9ed1 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:14.107979 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 213/426] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:14.113476 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4b77b-2478-479d-949a-e410e78a2b4a None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:14.113878 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4b77b-2478-479d-949a-e410e78a2b4a None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:14.114028 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4b77b-2478-479d-949a-e410e78a2b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:14.135866 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-82c4b77b-2478-479d-949a-e410e78a2b4a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:14.137011 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-82c4b77b-2478-479d-949a-e410e78a2b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:14.197427 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 214/427] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:14.220204 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a173e6-4746-431d-9ff5-8633d2da9ed1 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:14.231720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a173e6-4746-431d-9ff5-8633d2da9ed1 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:14.236185 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f13b27-7992-4b30-aad4-23872c754193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:14.237192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f13b27-7992-4b30-aad4-23872c754193 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:14.237493 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f13b27-7992-4b30-aad4-23872c754193 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:14.237776 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f13b27-7992-4b30-aad4-23872c754193 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:14.248637 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f13b27-7992-4b30-aad4-23872c754193 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:23:14.254872 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-15f13b27-7992-4b30-aad4-23872c754193 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:23:14.255927 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 214/428] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:23:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:14.261060 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4b77b-2478-479d-949a-e410e78a2b4a None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:14.269729 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4b77b-2478-479d-949a-e410e78a2b4a None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:14.273532 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720d9df-8b9d-485a-9c0d-dd081a7b37f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:14.274097 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720d9df-8b9d-485a-9c0d-dd081a7b37f8 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:14.274381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720d9df-8b9d-485a-9c0d-dd081a7b37f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:14.274655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720d9df-8b9d-485a-9c0d-dd081a7b37f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:14.275344 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720d9df-8b9d-485a-9c0d-dd081a7b37f8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:14.275638 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720d9df-8b9d-485a-9c0d-dd081a7b37f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:14.301243 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720d9df-8b9d-485a-9c0d-dd081a7b37f8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:14.309452 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 215/429] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:23:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:14.314337 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f13b27-7992-4b30-aad4-23872c754193 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:14.323621 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f13b27-7992-4b30-aad4-23872c754193 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:14.327506 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef632394-ca6e-4f4f-875b-0b8ed3d12b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:14.328713 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef632394-ca6e-4f4f-875b-0b8ed3d12b18 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:14.329000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef632394-ca6e-4f4f-875b-0b8ed3d12b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:14.329277 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef632394-ca6e-4f4f-875b-0b8ed3d12b18 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:14.340336 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef632394-ca6e-4f4f-875b-0b8ed3d12b18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:14.366375 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef632394-ca6e-4f4f-875b-0b8ed3d12b18 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:14.383854 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-ef632394-ca6e-4f4f-875b-0b8ed3d12b18 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:14.384917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 215/430] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:14.389943 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720d9df-8b9d-485a-9c0d-dd081a7b37f8 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:14.399036 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720d9df-8b9d-485a-9c0d-dd081a7b37f8 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:14.402917 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890c5b1-fa86-4273-8f68-c9d2ea51c3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:14.403487 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890c5b1-fa86-4273-8f68-c9d2ea51c3fc admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:14.403775 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890c5b1-fa86-4273-8f68-c9d2ea51c3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:14.404056 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890c5b1-fa86-4273-8f68-c9d2ea51c3fc admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:14.404769 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890c5b1-fa86-4273-8f68-c9d2ea51c3fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:14.405069 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890c5b1-fa86-4273-8f68-c9d2ea51c3fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:14.430690 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890c5b1-fa86-4273-8f68-c9d2ea51c3fc admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:14.443784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 216/431] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:14.449175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef632394-ca6e-4f4f-875b-0b8ed3d12b18 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:14.458307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef632394-ca6e-4f4f-875b-0b8ed3d12b18 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:14.462177 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc5541-c3bf-46a1-95b1-4fa485401afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:14.462871 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc5541-c3bf-46a1-95b1-4fa485401afb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:14.463157 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc5541-c3bf-46a1-95b1-4fa485401afb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:14.463437 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc5541-c3bf-46a1-95b1-4fa485401afb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:14.477591 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc5541-c3bf-46a1-95b1-4fa485401afb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:14.503840 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc5541-c3bf-46a1-95b1-4fa485401afb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:14.520764 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-1bcc5541-c3bf-46a1-95b1-4fa485401afb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 01:23:14.521791 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 216/432] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Aug 23 01:23:14 2021] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:14.527143 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890c5b1-fa86-4273-8f68-c9d2ea51c3fc admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:14.536082 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890c5b1-fa86-4273-8f68-c9d2ea51c3fc admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:14.539932 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e92e7d-9e89-48d9-a0fa-6c478ca823a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:14.540504 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e92e7d-9e89-48d9-a0fa-6c478ca823a9 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:14.540818 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e92e7d-9e89-48d9-a0fa-6c478ca823a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:14.541099 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e92e7d-9e89-48d9-a0fa-6c478ca823a9 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:14.541873 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e92e7d-9e89-48d9-a0fa-6c478ca823a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:14.542170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e92e7d-9e89-48d9-a0fa-6c478ca823a9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:14.568471 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e92e7d-9e89-48d9-a0fa-6c478ca823a9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:14.603309 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 217/433] 10.222.0.20 () {56 vars in 1155 bytes} [Mon Aug 23 01:23:14 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:14.608807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc5541-c3bf-46a1-95b1-4fa485401afb admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:14.618399 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc5541-c3bf-46a1-95b1-4fa485401afb admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:14.622150 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699e2b9-64af-4759-84e8-8003cb0008f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:14.622707 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699e2b9-64af-4759-84e8-8003cb0008f8 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:14.622990 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699e2b9-64af-4759-84e8-8003cb0008f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:14.623265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699e2b9-64af-4759-84e8-8003cb0008f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:14.630595 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699e2b9-64af-4759-84e8-8003cb0008f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:14.655318 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699e2b9-64af-4759-84e8-8003cb0008f8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:14.663947 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 217/434] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:23:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:23:14.669401 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e92e7d-9e89-48d9-a0fa-6c478ca823a9 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:14.679112 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e92e7d-9e89-48d9-a0fa-6c478ca823a9 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:14.682994 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78653e11-314a-4fc9-9d5e-9d4b3797bedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:14.683699 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78653e11-314a-4fc9-9d5e-9d4b3797bedb admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:14.683987 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78653e11-314a-4fc9-9d5e-9d4b3797bedb admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:14.684274 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78653e11-314a-4fc9-9d5e-9d4b3797bedb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:14.695515 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78653e11-314a-4fc9-9d5e-9d4b3797bedb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:14.721340 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78653e11-314a-4fc9-9d5e-9d4b3797bedb admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:14.738554 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-78653e11-314a-4fc9-9d5e-9d4b3797bedb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:14.739592 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 218/435] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:14.744673 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699e2b9-64af-4759-84e8-8003cb0008f8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:14.752793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699e2b9-64af-4759-84e8-8003cb0008f8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:14.756615 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7fff4-5ed4-4097-9406-93bc9ef5b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:14.757178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7fff4-5ed4-4097-9406-93bc9ef5b2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:14.757459 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7fff4-5ed4-4097-9406-93bc9ef5b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:14.757738 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7fff4-5ed4-4097-9406-93bc9ef5b2b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:14.758397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7fff4-5ed4-4097-9406-93bc9ef5b2b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:14.758689 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7fff4-5ed4-4097-9406-93bc9ef5b2b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:14.783793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7fff4-5ed4-4097-9406-93bc9ef5b2b1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:14.796104 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 218/436] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:14.801499 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78653e11-314a-4fc9-9d5e-9d4b3797bedb admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:14.810494 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78653e11-314a-4fc9-9d5e-9d4b3797bedb admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:14.814397 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13d6ae-0437-463d-ab33-eda0b11d8353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:14.815066 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13d6ae-0437-463d-ab33-eda0b11d8353 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:14.815350 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13d6ae-0437-463d-ab33-eda0b11d8353 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:14.815630 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13d6ae-0437-463d-ab33-eda0b11d8353 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:14.825816 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13d6ae-0437-463d-ab33-eda0b11d8353 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:14.851862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13d6ae-0437-463d-ab33-eda0b11d8353 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:14.865746 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-ca13d6ae-0437-463d-ab33-eda0b11d8353 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:23:14.866771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 219/437] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:23:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:14.871884 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7fff4-5ed4-4097-9406-93bc9ef5b2b1 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:14.880632 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7fff4-5ed4-4097-9406-93bc9ef5b2b1 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:14.884392 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe012439-4ea1-401c-90d3-9207ef55be1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:14.884986 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe012439-4ea1-401c-90d3-9207ef55be1b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:14.885270 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe012439-4ea1-401c-90d3-9207ef55be1b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:14.895028 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe012439-4ea1-401c-90d3-9207ef55be1b admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:14.895028 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe012439-4ea1-401c-90d3-9207ef55be1b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:14.895028 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe012439-4ea1-401c-90d3-9207ef55be1b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:14.912010 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe012439-4ea1-401c-90d3-9207ef55be1b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:14.925223 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 219/438] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:23:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:23:14.931089 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13d6ae-0437-463d-ab33-eda0b11d8353 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:14.940930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13d6ae-0437-463d-ab33-eda0b11d8353 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:14.944953 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423f668-cba8-41ec-bb12-cd64594dcc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:14.945532 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423f668-cba8-41ec-bb12-cd64594dcc0c admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:14.945824 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423f668-cba8-41ec-bb12-cd64594dcc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:14.946107 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423f668-cba8-41ec-bb12-cd64594dcc0c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:14.946886 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423f668-cba8-41ec-bb12-cd64594dcc0c admin admin] RBAC: Adding query filter params (role.id=56d36413cf4047229b6f9d36a3990b0d, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=094c5e571da7480584098ba6ebcb70ed) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:14.947199 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423f668-cba8-41ec-bb12-cd64594dcc0c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:14.973463 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423f668-cba8-41ec-bb12-cd64594dcc0c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:14.979435 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 220/439] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:23:14 2021] GET /identity/v3/role_assignments?user.id=094c5e571da7480584098ba6ebcb70ed&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:16.926932 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199d96a-5f99-4e0d-a827-e9894429321f None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:16.927545 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199d96a-5f99-4e0d-a827-e9894429321f None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:16.927545 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199d96a-5f99-4e0d-a827-e9894429321f None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:16.929189 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 220/440] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:16.934303 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86407c-222c-477f-8dd5-b453224c2b8d None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:16.934692 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86407c-222c-477f-8dd5-b453224c2b8d None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:16.934880 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86407c-222c-477f-8dd5-b453224c2b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:16.957942 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-cf86407c-222c-477f-8dd5-b453224c2b8d None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:16.959084 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-cf86407c-222c-477f-8dd5-b453224c2b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:16.965641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 221/441] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:16.986858 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199d96a-5f99-4e0d-a827-e9894429321f None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:16.998129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199d96a-5f99-4e0d-a827-e9894429321f None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:17.002610 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e04adb-5aa8-447f-9550-01ba932f7bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:17.003331 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e04adb-5aa8-447f-9550-01ba932f7bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:17.003621 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e04adb-5aa8-447f-9550-01ba932f7bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:17.003903 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e04adb-5aa8-447f-9550-01ba932f7bb0 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:17.004517 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e04adb-5aa8-447f-9550-01ba932f7bb0 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:17.029411 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-f9e04adb-5aa8-447f-9550-01ba932f7bb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:23:17.029411 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:23:17.029411 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:23:17.030280 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e04adb-5aa8-447f-9550-01ba932f7bb0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:17.041499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-f9e04adb-5aa8-447f-9550-01ba932f7bb0 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 01:23:17.042552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 221/442] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Aug 23 01:23:16 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:17.047824 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86407c-222c-477f-8dd5-b453224c2b8d None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:17.056218 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86407c-222c-477f-8dd5-b453224c2b8d None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:17.060176 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b05221-3107-4931-9200-22307ee727c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:17.060790 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b05221-3107-4931-9200-22307ee727c5 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:17.061079 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b05221-3107-4931-9200-22307ee727c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:17.061357 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b05221-3107-4931-9200-22307ee727c5 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:17.062505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b05221-3107-4931-9200-22307ee727c5 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:17.062806 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b05221-3107-4931-9200-22307ee727c5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:17.087813 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-60b05221-3107-4931-9200-22307ee727c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:23:17.087813 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:23:17.087813 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:23:17.088716 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b05221-3107-4931-9200-22307ee727c5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:17.092881 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 222/443] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 23 01:23:17 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:17.098018 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e04adb-5aa8-447f-9550-01ba932f7bb0 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:17.106760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e04adb-5aa8-447f-9550-01ba932f7bb0 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:17.110565 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784997ed-7824-407f-87db-bbcf62c371fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:17.111115 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784997ed-7824-407f-87db-bbcf62c371fb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:17.111398 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784997ed-7824-407f-87db-bbcf62c371fb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:17.111671 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784997ed-7824-407f-87db-bbcf62c371fb admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:17.112312 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784997ed-7824-407f-87db-bbcf62c371fb admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:17.112633 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784997ed-7824-407f-87db-bbcf62c371fb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:17.137158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-784997ed-7824-407f-87db-bbcf62c371fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:23:17.137158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:23:17.137158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:23:17.138014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784997ed-7824-407f-87db-bbcf62c371fb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:17.142799 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 222/444] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 23 01:23:17 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:19.077247 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42f03f-0835-4cec-b698-e0960a85efce None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:19.078330 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42f03f-0835-4cec-b698-e0960a85efce None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:19.078330 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42f03f-0835-4cec-b698-e0960a85efce None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:19.079972 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 223/445] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:19.085119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa6f04-482b-4cd7-9f45-5d1012173a64 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:19.085543 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa6f04-482b-4cd7-9f45-5d1012173a64 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:19.085685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa6f04-482b-4cd7-9f45-5d1012173a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:19.108250 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-60aa6f04-482b-4cd7-9f45-5d1012173a64 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:19.109418 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-60aa6f04-482b-4cd7-9f45-5d1012173a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:19.115864 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 223/446] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:23:19.137475 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42f03f-0835-4cec-b698-e0960a85efce None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:19.148820 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42f03f-0835-4cec-b698-e0960a85efce None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:19.152538 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fc9b0-ff1d-4631-a4a3-fe778838d084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:19.153136 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fc9b0-ff1d-4631-a4a3-fe778838d084 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:19.153421 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fc9b0-ff1d-4631-a4a3-fe778838d084 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:19.153700 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fc9b0-ff1d-4631-a4a3-fe778838d084 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:19.154359 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fc9b0-ff1d-4631-a4a3-fe778838d084 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:19.179634 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-937fc9b0-ff1d-4631-a4a3-fe778838d084 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:23:19.179634 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:23:19.179634 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:23:19.180498 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fc9b0-ff1d-4631-a4a3-fe778838d084 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:19.258328 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 224/447] 10.222.0.20 () {60 vars in 1163 bytes} [Mon Aug 23 01:23:19 2021] POST /identity/v3/services => generated 269 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:23:21.204344 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dce97f-a333-4daa-992a-02aefc44071b None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:21.204926 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dce97f-a333-4daa-992a-02aefc44071b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:21.204926 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dce97f-a333-4daa-992a-02aefc44071b None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:21.206611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 224/448] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:21.211585 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd4bcb-333a-4108-897e-968b863d8672 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:21.211955 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd4bcb-333a-4108-897e-968b863d8672 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:21.212148 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd4bcb-333a-4108-897e-968b863d8672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:21.234828 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-24dd4bcb-333a-4108-897e-968b863d8672 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:21.235952 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-24dd4bcb-333a-4108-897e-968b863d8672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:21.251350 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 225/449] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:21 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:21.273426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dce97f-a333-4daa-992a-02aefc44071b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:21.284799 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dce97f-a333-4daa-992a-02aefc44071b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:21.288622 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ed0e2-e506-42d2-b9cb-8627c37b85b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:21.289343 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ed0e2-e506-42d2-b9cb-8627c37b85b8 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:21.289631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ed0e2-e506-42d2-b9cb-8627c37b85b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:21.289914 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ed0e2-e506-42d2-b9cb-8627c37b85b8 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:21.290529 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ed0e2-e506-42d2-b9cb-8627c37b85b8 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:21.316511 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ed0e2-e506-42d2-b9cb-8627c37b85b8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:21.327041 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-444ed0e2-e506-42d2-b9cb-8627c37b85b8 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 01:23:21.328094 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 225/450] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Aug 23 01:23:21 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:21.333378 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd4bcb-333a-4108-897e-968b863d8672 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:21.341701 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd4bcb-333a-4108-897e-968b863d8672 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:21.346140 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020d2d1-ce29-4b05-a153-967a3a00bf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:21.346980 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020d2d1-ce29-4b05-a153-967a3a00bf91 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:21.347265 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020d2d1-ce29-4b05-a153-967a3a00bf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:21.347543 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020d2d1-ce29-4b05-a153-967a3a00bf91 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:21.348200 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020d2d1-ce29-4b05-a153-967a3a00bf91 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:21.348495 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020d2d1-ce29-4b05-a153-967a3a00bf91 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:21.374038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020d2d1-ce29-4b05-a153-967a3a00bf91 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:21.378285 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 226/451] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 23 01:23:21 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:21.383236 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ed0e2-e506-42d2-b9cb-8627c37b85b8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:21.392094 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ed0e2-e506-42d2-b9cb-8627c37b85b8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:21.395875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca7c5b-ebbe-4293-8d11-22be7b08a3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:21.396437 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca7c5b-ebbe-4293-8d11-22be7b08a3ab admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:21.396762 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca7c5b-ebbe-4293-8d11-22be7b08a3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:21.397042 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca7c5b-ebbe-4293-8d11-22be7b08a3ab admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:21.397690 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca7c5b-ebbe-4293-8d11-22be7b08a3ab admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:21.397983 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca7c5b-ebbe-4293-8d11-22be7b08a3ab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:21.424244 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca7c5b-ebbe-4293-8d11-22be7b08a3ab admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:21.428891 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 226/452] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 23 01:23:21 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:23:21.434228 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020d2d1-ce29-4b05-a153-967a3a00bf91 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:21.443275 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020d2d1-ce29-4b05-a153-967a3a00bf91 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:21.447209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632f28b-412e-44f0-9672-f173aae51e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:21.447772 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632f28b-412e-44f0-9672-f173aae51e17 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:21.448059 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632f28b-412e-44f0-9672-f173aae51e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:21.448339 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632f28b-412e-44f0-9672-f173aae51e17 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:21.449116 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632f28b-412e-44f0-9672-f173aae51e17 admin admin] RBAC: Adding query filter params (interface=public, service_id=c51720753d0e4dc282c6a44be00ce0be, region_id=RegionOne) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:21.449422 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632f28b-412e-44f0-9672-f173aae51e17 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:21.474619 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-d632f28b-412e-44f0-9672-f173aae51e17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:23:21.474619 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:23:21.474619 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:23:21.475433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632f28b-412e-44f0-9672-f173aae51e17 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:21.481117 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 227/453] 10.222.0.20 () {56 vars in 1273 bytes} [Mon Aug 23 01:23:21 2021] GET /identity/v3/endpoints?service_id=c51720753d0e4dc282c6a44be00ce0be&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:21.486575 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca7c5b-ebbe-4293-8d11-22be7b08a3ab admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:21.495605 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca7c5b-ebbe-4293-8d11-22be7b08a3ab admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:21.499443 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cb554-f7ca-435f-93f9-ee54b04bd143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:21.500065 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cb554-f7ca-435f-93f9-ee54b04bd143 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:21.500350 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cb554-f7ca-435f-93f9-ee54b04bd143 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:21.500659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cb554-f7ca-435f-93f9-ee54b04bd143 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:21.501284 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cb554-f7ca-435f-93f9-ee54b04bd143 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:21.526178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cb554-f7ca-435f-93f9-ee54b04bd143 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:21.531102 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 227/454] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 23 01:23:21 2021] GET /identity/v3/services => generated 562 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:23:23.466410 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a01ca-c0c9-4833-bfcf-8ddc27f02c85 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:23.466851 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a01ca-c0c9-4833-bfcf-8ddc27f02c85 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:23.466980 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a01ca-c0c9-4833-bfcf-8ddc27f02c85 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:23.468735 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 228/455] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:23.474139 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c306303-b37d-45b8-ab76-3079579a2fa6 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:23.474533 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c306303-b37d-45b8-ab76-3079579a2fa6 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:23.474708 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c306303-b37d-45b8-ab76-3079579a2fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:23.496928 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-6c306303-b37d-45b8-ab76-3079579a2fa6 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:23.498045 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-6c306303-b37d-45b8-ab76-3079579a2fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:23.505269 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 228/456] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:23 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:23.526419 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a01ca-c0c9-4833-bfcf-8ddc27f02c85 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:23.538026 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a01ca-c0c9-4833-bfcf-8ddc27f02c85 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:23.541826 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0715a-25c4-41c1-ad8a-627b5f5c2a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:23.542539 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0715a-25c4-41c1-ad8a-627b5f5c2a59 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:23.542824 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0715a-25c4-41c1-ad8a-627b5f5c2a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:23.543102 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0715a-25c4-41c1-ad8a-627b5f5c2a59 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:23.543715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0715a-25c4-41c1-ad8a-627b5f5c2a59 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:23.569387 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-d8f0715a-25c4-41c1-ad8a-627b5f5c2a59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:23:23.569387 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:23:23.569387 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:23:23.570249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0715a-25c4-41c1-ad8a-627b5f5c2a59 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:23.581408 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-d8f0715a-25c4-41c1-ad8a-627b5f5c2a59 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 01:23:23.582438 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 229/457] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Aug 23 01:23:23 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:23.587689 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c306303-b37d-45b8-ab76-3079579a2fa6 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:23.596716 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c306303-b37d-45b8-ab76-3079579a2fa6 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:23.600630 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdefbe0-7a81-4473-91d8-68a0607ad25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:23.601207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdefbe0-7a81-4473-91d8-68a0607ad25a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:23.601493 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdefbe0-7a81-4473-91d8-68a0607ad25a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:23.601772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdefbe0-7a81-4473-91d8-68a0607ad25a admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:23.602424 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdefbe0-7a81-4473-91d8-68a0607ad25a admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:23.602721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdefbe0-7a81-4473-91d8-68a0607ad25a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:23.628099 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdefbe0-7a81-4473-91d8-68a0607ad25a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:23.632243 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 229/458] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 23 01:23:23 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:23.637185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0715a-25c4-41c1-ad8a-627b5f5c2a59 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:23.646424 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0715a-25c4-41c1-ad8a-627b5f5c2a59 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:23.650329 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23880adb-fff5-4ac3-ab58-24c20dfb7d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:23.650884 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23880adb-fff5-4ac3-ab58-24c20dfb7d87 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:23.651170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23880adb-fff5-4ac3-ab58-24c20dfb7d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:23.651451 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23880adb-fff5-4ac3-ab58-24c20dfb7d87 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:23.652104 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23880adb-fff5-4ac3-ab58-24c20dfb7d87 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:23.652400 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23880adb-fff5-4ac3-ab58-24c20dfb7d87 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:23.678391 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23880adb-fff5-4ac3-ab58-24c20dfb7d87 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:23.682876 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 230/459] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 23 01:23:23 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:23.687631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdefbe0-7a81-4473-91d8-68a0607ad25a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:23.696368 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdefbe0-7a81-4473-91d8-68a0607ad25a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:23.700223 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6105d44-b558-4790-affc-6cf623051a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:23.700798 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6105d44-b558-4790-affc-6cf623051a5d admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:23.701085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6105d44-b558-4790-affc-6cf623051a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:23.701364 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6105d44-b558-4790-affc-6cf623051a5d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:23.702035 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6105d44-b558-4790-affc-6cf623051a5d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:23.726853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-a6105d44-b558-4790-affc-6cf623051a5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:23:23.726853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:23:23.726853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:23:23.727701 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6105d44-b558-4790-affc-6cf623051a5d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:23.801774 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 230/460] 10.222.0.20 () {60 vars in 1166 bytes} [Mon Aug 23 01:23:23 2021] POST /identity/v3/endpoints => generated 347 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:23:25.742354 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ee562-2f3f-43c5-8ecc-c4c00db9ef5e None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:25.742859 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ee562-2f3f-43c5-8ecc-c4c00db9ef5e None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:25.742859 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ee562-2f3f-43c5-8ecc-c4c00db9ef5e None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:25.744480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 231/461] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:25.749525 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4573b7-93dd-422c-80d0-aee6b81aafa3 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:25.749901 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4573b7-93dd-422c-80d0-aee6b81aafa3 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:25.750101 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4573b7-93dd-422c-80d0-aee6b81aafa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:25.772310 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-2e4573b7-93dd-422c-80d0-aee6b81aafa3 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:25.773468 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-2e4573b7-93dd-422c-80d0-aee6b81aafa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:25.793461 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 231/462] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:25 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:25.814234 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ee562-2f3f-43c5-8ecc-c4c00db9ef5e None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:25.825477 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ee562-2f3f-43c5-8ecc-c4c00db9ef5e None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:25.829755 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0a84e-c8bf-4546-ab44-6b24fef1cd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:25.830451 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0a84e-c8bf-4546-ab44-6b24fef1cd71 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:25.830734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0a84e-c8bf-4546-ab44-6b24fef1cd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:25.831351 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0a84e-c8bf-4546-ab44-6b24fef1cd71 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:25.831965 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0a84e-c8bf-4546-ab44-6b24fef1cd71 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:25.857922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0a84e-c8bf-4546-ab44-6b24fef1cd71 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:25.867894 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-93b0a84e-c8bf-4546-ab44-6b24fef1cd71 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 01:23:25.868929 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 232/463] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:23:25 2021] GET /identity/v3/services/compute => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:25.874108 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4573b7-93dd-422c-80d0-aee6b81aafa3 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:25.882869 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4573b7-93dd-422c-80d0-aee6b81aafa3 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:25.886787 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4d07e-c4fb-4807-a13f-8586fff343d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:25.887362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4d07e-c4fb-4807-a13f-8586fff343d0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:25.887652 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4d07e-c4fb-4807-a13f-8586fff343d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:25.887936 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4d07e-c4fb-4807-a13f-8586fff343d0 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:25.888624 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4d07e-c4fb-4807-a13f-8586fff343d0 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:25.888927 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4d07e-c4fb-4807-a13f-8586fff343d0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:25.914199 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4d07e-c4fb-4807-a13f-8586fff343d0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:25.918319 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 232/464] 10.222.0.20 () {56 vars in 1134 bytes} [Mon Aug 23 01:23:25 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:25.923316 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0a84e-c8bf-4546-ab44-6b24fef1cd71 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:25.932967 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0a84e-c8bf-4546-ab44-6b24fef1cd71 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:25.937301 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a28f5a-e6cc-495a-a52a-f7d8051bcbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:25.937845 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a28f5a-e6cc-495a-a52a-f7d8051bcbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:25.938126 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a28f5a-e6cc-495a-a52a-f7d8051bcbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:25.938401 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a28f5a-e6cc-495a-a52a-f7d8051bcbf4 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:25.939042 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a28f5a-e6cc-495a-a52a-f7d8051bcbf4 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:25.939334 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a28f5a-e6cc-495a-a52a-f7d8051bcbf4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:25.964819 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a28f5a-e6cc-495a-a52a-f7d8051bcbf4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:25.968935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 233/465] 10.222.0.20 () {56 vars in 1134 bytes} [Mon Aug 23 01:23:25 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:27.899998 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368c553-1613-4dde-ad7f-d0ec704c0992 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:27.900494 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368c553-1613-4dde-ad7f-d0ec704c0992 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:27.900630 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368c553-1613-4dde-ad7f-d0ec704c0992 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:27.902254 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 233/466] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:27.907317 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385c21d-5167-4202-bc20-e96842e14b2d None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:27.907743 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385c21d-5167-4202-bc20-e96842e14b2d None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:27.907929 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385c21d-5167-4202-bc20-e96842e14b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:27.930059 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-2385c21d-5167-4202-bc20-e96842e14b2d None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:27.931169 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2385c21d-5167-4202-bc20-e96842e14b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:27.938235 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 234/467] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:27 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:23:27.959408 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368c553-1613-4dde-ad7f-d0ec704c0992 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:27.970732 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368c553-1613-4dde-ad7f-d0ec704c0992 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:27.974854 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349b3c5-6d2c-427f-8f94-89710192304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:27.975425 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349b3c5-6d2c-427f-8f94-89710192304c admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:27.975716 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349b3c5-6d2c-427f-8f94-89710192304c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:27.976000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349b3c5-6d2c-427f-8f94-89710192304c admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:27.976687 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349b3c5-6d2c-427f-8f94-89710192304c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:28.002037 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-6349b3c5-6d2c-427f-8f94-89710192304c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:23:28.002037 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:23:28.002037 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:23:28.002902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349b3c5-6d2c-427f-8f94-89710192304c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:28.102665 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 234/468] 10.222.0.20 () {60 vars in 1163 bytes} [Mon Aug 23 01:23:27 2021] POST /identity/v3/services => generated 242 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:23:30.035544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f07b9-1877-441a-9b21-5cdb6285027d None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:30.036087 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f07b9-1877-441a-9b21-5cdb6285027d None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:30.036087 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f07b9-1877-441a-9b21-5cdb6285027d None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:30.037795 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 235/469] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:30.043050 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f01b4-66b5-474e-a9ae-3e0cf46a0bad None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:30.043427 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f01b4-66b5-474e-a9ae-3e0cf46a0bad None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:30.043629 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f01b4-66b5-474e-a9ae-3e0cf46a0bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:30.065593 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-511f01b4-66b5-474e-a9ae-3e0cf46a0bad None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:30.066731 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-511f01b4-66b5-474e-a9ae-3e0cf46a0bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:30.083580 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 235/470] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:30 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:30.106584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f07b9-1877-441a-9b21-5cdb6285027d None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:30.117839 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f07b9-1877-441a-9b21-5cdb6285027d None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:30.121579 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78acb3d-01ac-4318-b28c-c73320176a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:30.122282 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78acb3d-01ac-4318-b28c-c73320176a4b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:30.122568 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78acb3d-01ac-4318-b28c-c73320176a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:30.122845 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78acb3d-01ac-4318-b28c-c73320176a4b admin admin] PATH_INFO: `/v3/services/compute` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:30.123449 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78acb3d-01ac-4318-b28c-c73320176a4b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:30.148782 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78acb3d-01ac-4318-b28c-c73320176a4b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:30.159332 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-e78acb3d-01ac-4318-b28c-c73320176a4b admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 01:23:30.160347 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 236/471] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:23:30 2021] GET /identity/v3/services/compute => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:30.165671 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f01b4-66b5-474e-a9ae-3e0cf46a0bad None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:30.174031 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f01b4-66b5-474e-a9ae-3e0cf46a0bad None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:30.177995 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e49834-519e-4974-ba83-c832e70d2f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:30.178573 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e49834-519e-4974-ba83-c832e70d2f58 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:30.178863 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e49834-519e-4974-ba83-c832e70d2f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:30.179145 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e49834-519e-4974-ba83-c832e70d2f58 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:30.179810 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e49834-519e-4974-ba83-c832e70d2f58 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:30.180108 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e49834-519e-4974-ba83-c832e70d2f58 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:30.205510 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e49834-519e-4974-ba83-c832e70d2f58 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:30.209746 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 236/472] 10.222.0.20 () {56 vars in 1134 bytes} [Mon Aug 23 01:23:30 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:30.214709 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78acb3d-01ac-4318-b28c-c73320176a4b admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:30.223792 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78acb3d-01ac-4318-b28c-c73320176a4b admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:30.227626 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7802ee-80bc-4b1e-91b5-d95a138030a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:30.228175 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7802ee-80bc-4b1e-91b5-d95a138030a5 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:30.228459 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7802ee-80bc-4b1e-91b5-d95a138030a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:30.228774 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7802ee-80bc-4b1e-91b5-d95a138030a5 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:30.229424 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7802ee-80bc-4b1e-91b5-d95a138030a5 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:30.229719 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7802ee-80bc-4b1e-91b5-d95a138030a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:30.255426 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7802ee-80bc-4b1e-91b5-d95a138030a5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:30.259858 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 237/473] 10.222.0.20 () {56 vars in 1134 bytes} [Mon Aug 23 01:23:30 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:30.265007 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e49834-519e-4974-ba83-c832e70d2f58 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:30.273748 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e49834-519e-4974-ba83-c832e70d2f58 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:30.277647 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224371c9-3e85-4c61-8b13-949afc1306bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:30.278199 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224371c9-3e85-4c61-8b13-949afc1306bc admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:30.278487 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224371c9-3e85-4c61-8b13-949afc1306bc admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:30.278768 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224371c9-3e85-4c61-8b13-949afc1306bc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:30.279494 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224371c9-3e85-4c61-8b13-949afc1306bc admin admin] RBAC: Adding query filter params (interface=public, service_id=7382c8db2f614576bf10997ae890f8f3, region_id=RegionOne) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:30.279797 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224371c9-3e85-4c61-8b13-949afc1306bc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:30.304527 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-224371c9-3e85-4c61-8b13-949afc1306bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:23:30.304527 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:23:30.304527 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:23:30.305361 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224371c9-3e85-4c61-8b13-949afc1306bc admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:30.310938 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 237/474] 10.222.0.20 () {56 vars in 1273 bytes} [Mon Aug 23 01:23:30 2021] GET /identity/v3/endpoints?service_id=7382c8db2f614576bf10997ae890f8f3&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:30.316167 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7802ee-80bc-4b1e-91b5-d95a138030a5 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:30.324881 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7802ee-80bc-4b1e-91b5-d95a138030a5 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:30.328733 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fccaf7-ceaa-4081-b5e9-d240320a5f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:30.329280 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fccaf7-ceaa-4081-b5e9-d240320a5f7b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:30.329566 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fccaf7-ceaa-4081-b5e9-d240320a5f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:30.329841 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fccaf7-ceaa-4081-b5e9-d240320a5f7b admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:30.330460 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fccaf7-ceaa-4081-b5e9-d240320a5f7b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:30.356063 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fccaf7-ceaa-4081-b5e9-d240320a5f7b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:30.362409 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 238/475] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 23 01:23:30 2021] GET /identity/v3/services => generated 792 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:32.302297 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b6be2-5ddf-45fd-8fa4-41c844001a7d None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:32.302928 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b6be2-5ddf-45fd-8fa4-41c844001a7d None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:32.302928 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b6be2-5ddf-45fd-8fa4-41c844001a7d None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:32.304536 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 238/476] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:32.309794 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b69eff-4f91-4439-8d4f-8ad418c441d8 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:32.310268 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b69eff-4f91-4439-8d4f-8ad418c441d8 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:32.310360 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b69eff-4f91-4439-8d4f-8ad418c441d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:32.332735 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-65b69eff-4f91-4439-8d4f-8ad418c441d8 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:32.333858 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-65b69eff-4f91-4439-8d4f-8ad418c441d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:32.340413 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 239/477] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:32 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:32.363164 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b6be2-5ddf-45fd-8fa4-41c844001a7d None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:32.374514 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b6be2-5ddf-45fd-8fa4-41c844001a7d None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:32.378292 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9365d-ad4f-4895-af13-ffba18b2fd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:32.378997 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9365d-ad4f-4895-af13-ffba18b2fd35 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:32.379288 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9365d-ad4f-4895-af13-ffba18b2fd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:32.379569 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9365d-ad4f-4895-af13-ffba18b2fd35 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:32.380185 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9365d-ad4f-4895-af13-ffba18b2fd35 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:32.406004 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9365d-ad4f-4895-af13-ffba18b2fd35 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:32.416036 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-5be9365d-ad4f-4895-af13-ffba18b2fd35 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 01:23:32.417144 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 239/478] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:23:32 2021] GET /identity/v3/services/compute => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:32.422739 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b69eff-4f91-4439-8d4f-8ad418c441d8 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:32.431270 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b69eff-4f91-4439-8d4f-8ad418c441d8 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:32.435246 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965086a-c466-483d-b5af-081a6790158d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:32.435824 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965086a-c466-483d-b5af-081a6790158d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:32.436115 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965086a-c466-483d-b5af-081a6790158d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:32.436418 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965086a-c466-483d-b5af-081a6790158d admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:32.437136 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965086a-c466-483d-b5af-081a6790158d admin admin] RBAC: Adding query filter params (name=compute) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:32.437439 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965086a-c466-483d-b5af-081a6790158d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:32.462941 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965086a-c466-483d-b5af-081a6790158d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:32.467205 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 240/479] 10.222.0.20 () {56 vars in 1134 bytes} [Mon Aug 23 01:23:32 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:32.473158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9365d-ad4f-4895-af13-ffba18b2fd35 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:32.482022 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9365d-ad4f-4895-af13-ffba18b2fd35 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:32.485838 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf411f-3ed5-4c9f-85aa-e0e6f6b581c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:32.486403 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf411f-3ed5-4c9f-85aa-e0e6f6b581c4 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:32.486691 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf411f-3ed5-4c9f-85aa-e0e6f6b581c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:32.486972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf411f-3ed5-4c9f-85aa-e0e6f6b581c4 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:32.487626 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf411f-3ed5-4c9f-85aa-e0e6f6b581c4 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:32.487923 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf411f-3ed5-4c9f-85aa-e0e6f6b581c4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:32.512683 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf411f-3ed5-4c9f-85aa-e0e6f6b581c4 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:32.517608 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 240/480] 10.222.0.20 () {56 vars in 1134 bytes} [Mon Aug 23 01:23:32 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:32.522621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965086a-c466-483d-b5af-081a6790158d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:32.531571 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965086a-c466-483d-b5af-081a6790158d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:32.535477 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec46ce-34dd-4291-8c52-49a300f2a356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:32.536029 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec46ce-34dd-4291-8c52-49a300f2a356 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:32.536321 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec46ce-34dd-4291-8c52-49a300f2a356 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:32.536637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec46ce-34dd-4291-8c52-49a300f2a356 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:32.537316 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec46ce-34dd-4291-8c52-49a300f2a356 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:32.562618 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-f2ec46ce-34dd-4291-8c52-49a300f2a356 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:23:32.562618 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:23:32.562618 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:23:32.563428 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec46ce-34dd-4291-8c52-49a300f2a356 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:32.657341 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 241/481] 10.222.0.20 () {60 vars in 1166 bytes} [Mon Aug 23 01:23:32 2021] POST /identity/v3/endpoints => generated 334 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:23:34.674930 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f5adf-dc24-4548-82b2-aa1cf584e742 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:34.675408 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f5adf-dc24-4548-82b2-aa1cf584e742 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:34.675408 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f5adf-dc24-4548-82b2-aa1cf584e742 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:34.677097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 241/482] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:34.682015 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca68538-f4bc-4f73-9624-cda4438efb52 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:34.682395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca68538-f4bc-4f73-9624-cda4438efb52 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:34.682586 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca68538-f4bc-4f73-9624-cda4438efb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:34.705002 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-eca68538-f4bc-4f73-9624-cda4438efb52 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:34.706129 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-eca68538-f4bc-4f73-9624-cda4438efb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:34.721756 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 242/483] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:34 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:34.743941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f5adf-dc24-4548-82b2-aa1cf584e742 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:34.755069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f5adf-dc24-4548-82b2-aa1cf584e742 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:34.758804 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8adf7a-482a-4933-9f57-4fa23411127a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:34.759514 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8adf7a-482a-4933-9f57-4fa23411127a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:34.759795 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8adf7a-482a-4933-9f57-4fa23411127a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:34.760069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8adf7a-482a-4933-9f57-4fa23411127a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:34.772192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8adf7a-482a-4933-9f57-4fa23411127a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:23:34.778802 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-7b8adf7a-482a-4933-9f57-4fa23411127a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 01:23:34.779837 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 242/484] 10.222.0.20 () {56 vars in 1142 bytes} [Mon Aug 23 01:23:34 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:34.785722 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca68538-f4bc-4f73-9624-cda4438efb52 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:34.793964 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca68538-f4bc-4f73-9624-cda4438efb52 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:34.797846 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26f3b5-8683-4bae-a629-b9dcb044cb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:34.798417 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26f3b5-8683-4bae-a629-b9dcb044cb9d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:34.798705 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26f3b5-8683-4bae-a629-b9dcb044cb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:34.798983 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26f3b5-8683-4bae-a629-b9dcb044cb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:34.799680 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26f3b5-8683-4bae-a629-b9dcb044cb9d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:34.799976 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26f3b5-8683-4bae-a629-b9dcb044cb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:34.825002 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26f3b5-8683-4bae-a629-b9dcb044cb9d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:34.833604 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 243/485] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Aug 23 01:23:34 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:34.838667 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8adf7a-482a-4933-9f57-4fa23411127a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:34.848550 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8adf7a-482a-4933-9f57-4fa23411127a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:34.852502 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea22451-c602-4754-bc43-0f6636baa544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:34.853222 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea22451-c602-4754-bc43-0f6636baa544 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:34.853511 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea22451-c602-4754-bc43-0f6636baa544 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:34.853792 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea22451-c602-4754-bc43-0f6636baa544 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:34.865439 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea22451-c602-4754-bc43-0f6636baa544 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:34.891594 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea22451-c602-4754-bc43-0f6636baa544 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:34.907825 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-0ea22451-c602-4754-bc43-0f6636baa544 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:34.908880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 243/486] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:34.913990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26f3b5-8683-4bae-a629-b9dcb044cb9d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:34.922895 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26f3b5-8683-4bae-a629-b9dcb044cb9d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:34.926847 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1302c-b90a-4711-8fa9-d542fb3eb200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:34.927359 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1302c-b90a-4711-8fa9-d542fb3eb200 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:34.927648 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1302c-b90a-4711-8fa9-d542fb3eb200 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:34.927931 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1302c-b90a-4711-8fa9-d542fb3eb200 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:34.928628 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1302c-b90a-4711-8fa9-d542fb3eb200 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:34.928932 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1302c-b90a-4711-8fa9-d542fb3eb200 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:34.954944 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1302c-b90a-4711-8fa9-d542fb3eb200 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:34.967211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 244/487] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:23:34.972510 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea22451-c602-4754-bc43-0f6636baa544 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:34.981388 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea22451-c602-4754-bc43-0f6636baa544 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:34.985311 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad58c4d-1b23-4a7e-b97b-29901c4cc31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:34.985988 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad58c4d-1b23-4a7e-b97b-29901c4cc31a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:34.986276 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad58c4d-1b23-4a7e-b97b-29901c4cc31a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:34.986554 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad58c4d-1b23-4a7e-b97b-29901c4cc31a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:34.999861 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad58c4d-1b23-4a7e-b97b-29901c4cc31a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:35.025200 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad58c4d-1b23-4a7e-b97b-29901c4cc31a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:35.042663 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-9ad58c4d-1b23-4a7e-b97b-29901c4cc31a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 01:23:35.043687 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 244/488] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Aug 23 01:23:34 2021] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:35.048917 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1302c-b90a-4711-8fa9-d542fb3eb200 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:35.057795 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1302c-b90a-4711-8fa9-d542fb3eb200 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:35.062193 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6cc8d-63ea-4462-ac30-c89d8665aba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:35.062761 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6cc8d-63ea-4462-ac30-c89d8665aba3 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:35.063047 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6cc8d-63ea-4462-ac30-c89d8665aba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:35.063323 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6cc8d-63ea-4462-ac30-c89d8665aba3 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:35.064096 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6cc8d-63ea-4462-ac30-c89d8665aba3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:35.064394 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6cc8d-63ea-4462-ac30-c89d8665aba3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:35.090112 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6cc8d-63ea-4462-ac30-c89d8665aba3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:35.117961 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 245/489] 10.222.0.20 () {56 vars in 1155 bytes} [Mon Aug 23 01:23:35 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:35.123019 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad58c4d-1b23-4a7e-b97b-29901c4cc31a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:35.132339 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad58c4d-1b23-4a7e-b97b-29901c4cc31a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:35.136193 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868f17d-df26-4909-a015-7d6ea9e7ee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:35.136785 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868f17d-df26-4909-a015-7d6ea9e7ee99 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:35.137068 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868f17d-df26-4909-a015-7d6ea9e7ee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:35.137341 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868f17d-df26-4909-a015-7d6ea9e7ee99 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:35.145226 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868f17d-df26-4909-a015-7d6ea9e7ee99 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:35.170192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868f17d-df26-4909-a015-7d6ea9e7ee99 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:35.179139 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 245/490] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:23:35 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:23:35.184045 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6cc8d-63ea-4462-ac30-c89d8665aba3 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:35.193441 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6cc8d-63ea-4462-ac30-c89d8665aba3 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:35.197368 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd0652-b4c5-4d72-818b-473d48018c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:35.198063 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd0652-b4c5-4d72-818b-473d48018c3c admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:35.198348 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd0652-b4c5-4d72-818b-473d48018c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:35.198626 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd0652-b4c5-4d72-818b-473d48018c3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:35.209939 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd0652-b4c5-4d72-818b-473d48018c3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:35.236635 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd0652-b4c5-4d72-818b-473d48018c3c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:35.253062 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-6ffd0652-b4c5-4d72-818b-473d48018c3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:35.254127 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 246/491] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:23:35.259406 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868f17d-df26-4909-a015-7d6ea9e7ee99 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:35.268210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868f17d-df26-4909-a015-7d6ea9e7ee99 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:35.272137 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7a773-0585-4bd1-bde1-9f88a09d5c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:35.272744 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7a773-0585-4bd1-bde1-9f88a09d5c93 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:35.273034 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7a773-0585-4bd1-bde1-9f88a09d5c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:35.273309 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7a773-0585-4bd1-bde1-9f88a09d5c93 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:35.273973 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7a773-0585-4bd1-bde1-9f88a09d5c93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:35.274263 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7a773-0585-4bd1-bde1-9f88a09d5c93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:35.299482 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7a773-0585-4bd1-bde1-9f88a09d5c93 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:35.310941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 246/492] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:23:35.315868 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd0652-b4c5-4d72-818b-473d48018c3c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:35.324771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd0652-b4c5-4d72-818b-473d48018c3c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:35.329207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0109d-9683-4038-932a-3cacd78da431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:35.329880 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0109d-9683-4038-932a-3cacd78da431 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:35.330163 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0109d-9683-4038-932a-3cacd78da431 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:35.330439 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0109d-9683-4038-932a-3cacd78da431 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:35.339045 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0109d-9683-4038-932a-3cacd78da431 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:35.365107 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0109d-9683-4038-932a-3cacd78da431 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:35.378198 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-efe0109d-9683-4038-932a-3cacd78da431 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:23:35.379233 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 247/493] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:23:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:35.384445 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7a773-0585-4bd1-bde1-9f88a09d5c93 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:35.393940 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7a773-0585-4bd1-bde1-9f88a09d5c93 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:35.397872 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e782373-cb06-4a91-957a-742c5f613b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:35.398506 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e782373-cb06-4a91-957a-742c5f613b73 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:35.398857 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e782373-cb06-4a91-957a-742c5f613b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:35.399199 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e782373-cb06-4a91-957a-742c5f613b73 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:35.399986 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e782373-cb06-4a91-957a-742c5f613b73 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:35.400348 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e782373-cb06-4a91-957a-742c5f613b73 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:35.426062 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e782373-cb06-4a91-957a-742c5f613b73 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:35.438686 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 247/494] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:23:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:23:35.444062 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0109d-9683-4038-932a-3cacd78da431 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:35.453575 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0109d-9683-4038-932a-3cacd78da431 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:35.457421 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369d016-1cca-4a04-9455-0db8432b04d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:35.457973 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369d016-1cca-4a04-9455-0db8432b04d6 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:35.458258 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369d016-1cca-4a04-9455-0db8432b04d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:35.458534 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369d016-1cca-4a04-9455-0db8432b04d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:35.459293 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369d016-1cca-4a04-9455-0db8432b04d6 admin admin] RBAC: Adding query filter params (role.id=4b08bc68a548443bab31d6b110aa5c96, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=094c5e571da7480584098ba6ebcb70ed) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:35.459593 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369d016-1cca-4a04-9455-0db8432b04d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:35.485669 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369d016-1cca-4a04-9455-0db8432b04d6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:35.490751 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 248/495] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:23:35 2021] GET /identity/v3/role_assignments?user.id=094c5e571da7480584098ba6ebcb70ed&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=4b08bc68a548443bab31d6b110aa5c96 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:37.407464 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c0fbf-e9fd-4ee5-bee6-c0083a09f73d None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:37.408006 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c0fbf-e9fd-4ee5-bee6-c0083a09f73d None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:37.408006 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c0fbf-e9fd-4ee5-bee6-c0083a09f73d None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:37.409700 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 248/496] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:37.415046 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929a893-307f-4161-a4ac-ada72b63bef7 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:37.415402 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929a893-307f-4161-a4ac-ada72b63bef7 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:37.415402 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929a893-307f-4161-a4ac-ada72b63bef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:37.439159 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-2929a893-307f-4161-a4ac-ada72b63bef7 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:37.440278 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2929a893-307f-4161-a4ac-ada72b63bef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:37.446908 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 249/497] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:37 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:37.469050 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c0fbf-e9fd-4ee5-bee6-c0083a09f73d None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:37.480504 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c0fbf-e9fd-4ee5-bee6-c0083a09f73d None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:37.484838 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74744811-d436-44e4-a4d0-43ff56685a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:37.485553 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74744811-d436-44e4-a4d0-43ff56685a4d admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:37.485834 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74744811-d436-44e4-a4d0-43ff56685a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:37.486110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74744811-d436-44e4-a4d0-43ff56685a4d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:37.496810 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74744811-d436-44e4-a4d0-43ff56685a4d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:23:37.504043 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-74744811-d436-44e4-a4d0-43ff56685a4d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 01:23:37.505101 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 249/498] 10.222.0.20 () {56 vars in 1142 bytes} [Mon Aug 23 01:23:37 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:23:37.510229 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929a893-307f-4161-a4ac-ada72b63bef7 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:37.518517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929a893-307f-4161-a4ac-ada72b63bef7 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:37.522440 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386778a-63a5-4aa3-ae08-0fc48b3018d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:37.523009 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386778a-63a5-4aa3-ae08-0fc48b3018d9 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:37.523297 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386778a-63a5-4aa3-ae08-0fc48b3018d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:37.523576 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386778a-63a5-4aa3-ae08-0fc48b3018d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:37.524271 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386778a-63a5-4aa3-ae08-0fc48b3018d9 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:37.524584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386778a-63a5-4aa3-ae08-0fc48b3018d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:37.550148 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386778a-63a5-4aa3-ae08-0fc48b3018d9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:37.558169 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 250/499] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Aug 23 01:23:37 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:37.563160 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74744811-d436-44e4-a4d0-43ff56685a4d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:37.574573 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74744811-d436-44e4-a4d0-43ff56685a4d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:37.578989 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf5864-5a52-42a7-99ca-ec1ef491f847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:37.579652 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf5864-5a52-42a7-99ca-ec1ef491f847 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:37.579934 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf5864-5a52-42a7-99ca-ec1ef491f847 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:37.580205 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf5864-5a52-42a7-99ca-ec1ef491f847 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:37.590879 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf5864-5a52-42a7-99ca-ec1ef491f847 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:37.616938 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf5864-5a52-42a7-99ca-ec1ef491f847 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:37.634113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-11cf5864-5a52-42a7-99ca-ec1ef491f847 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:37.635155 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 250/500] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:37.640264 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386778a-63a5-4aa3-ae08-0fc48b3018d9 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:37.649142 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386778a-63a5-4aa3-ae08-0fc48b3018d9 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:37.653036 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154fcc2-c0e4-4949-8cd7-8172b4b2e2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:37.653598 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154fcc2-c0e4-4949-8cd7-8172b4b2e2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:37.653883 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154fcc2-c0e4-4949-8cd7-8172b4b2e2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:37.654164 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154fcc2-c0e4-4949-8cd7-8172b4b2e2e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:37.654834 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154fcc2-c0e4-4949-8cd7-8172b4b2e2e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:37.655130 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154fcc2-c0e4-4949-8cd7-8172b4b2e2e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:37.680532 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154fcc2-c0e4-4949-8cd7-8172b4b2e2e6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:37.693385 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 251/501] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:37.698264 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf5864-5a52-42a7-99ca-ec1ef491f847 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:37.707039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf5864-5a52-42a7-99ca-ec1ef491f847 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:37.710896 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52188c-5e78-4917-ad5b-69d65f452ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:37.711571 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52188c-5e78-4917-ad5b-69d65f452ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:37.711854 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52188c-5e78-4917-ad5b-69d65f452ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:37.712132 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52188c-5e78-4917-ad5b-69d65f452ca1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:37.724462 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52188c-5e78-4917-ad5b-69d65f452ca1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:37.750123 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52188c-5e78-4917-ad5b-69d65f452ca1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:37.767361 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-6c52188c-5e78-4917-ad5b-69d65f452ca1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 01:23:37.768365 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 251/502] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Aug 23 01:23:37 2021] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:37.773390 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154fcc2-c0e4-4949-8cd7-8172b4b2e2e6 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:37.782780 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154fcc2-c0e4-4949-8cd7-8172b4b2e2e6 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:37.786707 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1649d-b39e-4f12-8d5e-c2b39a9fe9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:37.787276 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1649d-b39e-4f12-8d5e-c2b39a9fe9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:37.787566 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1649d-b39e-4f12-8d5e-c2b39a9fe9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:37.787846 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1649d-b39e-4f12-8d5e-c2b39a9fe9a8 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:37.788647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1649d-b39e-4f12-8d5e-c2b39a9fe9a8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:37.788949 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1649d-b39e-4f12-8d5e-c2b39a9fe9a8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:37.814017 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1649d-b39e-4f12-8d5e-c2b39a9fe9a8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:37.841881 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 252/503] 10.222.0.20 () {56 vars in 1155 bytes} [Mon Aug 23 01:23:37 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:37.847628 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52188c-5e78-4917-ad5b-69d65f452ca1 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:37.856422 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52188c-5e78-4917-ad5b-69d65f452ca1 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:37.860335 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1ce0f-7bb2-40f6-ac98-33ff47468b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:37.861046 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1ce0f-7bb2-40f6-ac98-33ff47468b90 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:37.861331 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1ce0f-7bb2-40f6-ac98-33ff47468b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:37.861609 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1ce0f-7bb2-40f6-ac98-33ff47468b90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:37.873551 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1ce0f-7bb2-40f6-ac98-33ff47468b90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:37.899365 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1ce0f-7bb2-40f6-ac98-33ff47468b90 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:37.915290 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-c6c1ce0f-7bb2-40f6-ac98-33ff47468b90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:37.916307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 252/504] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:37.921247 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1649d-b39e-4f12-8d5e-c2b39a9fe9a8 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:37.930058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1649d-b39e-4f12-8d5e-c2b39a9fe9a8 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:37.934030 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c649034-d1be-4a27-bc3a-d1a8f8d61d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:37.934542 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c649034-d1be-4a27-bc3a-d1a8f8d61d45 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:37.934830 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c649034-d1be-4a27-bc3a-d1a8f8d61d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:37.935109 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c649034-d1be-4a27-bc3a-d1a8f8d61d45 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:37.935774 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c649034-d1be-4a27-bc3a-d1a8f8d61d45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:37.936069 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c649034-d1be-4a27-bc3a-d1a8f8d61d45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:37.961987 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c649034-d1be-4a27-bc3a-d1a8f8d61d45 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:37.973796 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 253/505] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:23:37.978753 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1ce0f-7bb2-40f6-ac98-33ff47468b90 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:37.987514 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1ce0f-7bb2-40f6-ac98-33ff47468b90 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:37.991338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdf5ac-83d8-4d85-a5b3-6005d327d3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:37.992017 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdf5ac-83d8-4d85-a5b3-6005d327d3cb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:37.992300 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdf5ac-83d8-4d85-a5b3-6005d327d3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:37.992588 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdf5ac-83d8-4d85-a5b3-6005d327d3cb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:38.001657 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdf5ac-83d8-4d85-a5b3-6005d327d3cb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:38.027178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdf5ac-83d8-4d85-a5b3-6005d327d3cb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:38.040086 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-4dbdf5ac-83d8-4d85-a5b3-6005d327d3cb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:23:38.041113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 253/506] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:23:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:38.046055 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c649034-d1be-4a27-bc3a-d1a8f8d61d45 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:38.054836 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c649034-d1be-4a27-bc3a-d1a8f8d61d45 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:38.058740 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9068f1-cef0-43c1-af83-e4e38f4ce720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:38.059296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9068f1-cef0-43c1-af83-e4e38f4ce720 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:38.059583 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9068f1-cef0-43c1-af83-e4e38f4ce720 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:38.059862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9068f1-cef0-43c1-af83-e4e38f4ce720 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:38.060610 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9068f1-cef0-43c1-af83-e4e38f4ce720 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:38.060914 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9068f1-cef0-43c1-af83-e4e38f4ce720 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:38.086992 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9068f1-cef0-43c1-af83-e4e38f4ce720 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:38.099728 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 254/507] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:23:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:38.104824 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdf5ac-83d8-4d85-a5b3-6005d327d3cb admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:38.113597 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdf5ac-83d8-4d85-a5b3-6005d327d3cb admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:38.117491 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3aab2d-641f-4bbd-8459-9e6ed5804814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:38.118260 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aab2d-641f-4bbd-8459-9e6ed5804814 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:38.118542 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aab2d-641f-4bbd-8459-9e6ed5804814 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:38.118816 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aab2d-641f-4bbd-8459-9e6ed5804814 admin admin] PATH_INFO: `/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/094c5e571da7480584098ba6ebcb70ed/roles/4b08bc68a548443bab31d6b110aa5c96` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:38.120772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3aab2d-641f-4bbd-8459-9e6ed5804814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2728fddda1c4691b33daad4fa4ef3d2, user_id=094c5e571da7480584098ba6ebcb70ed, role_id=4b08bc68a548443bab31d6b110aa5c96)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:38.147782 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3aab2d-641f-4bbd-8459-9e6ed5804814 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:38.232675 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 254/508] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:23:38 2021] PUT /identity/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/094c5e571da7480584098ba6ebcb70ed/roles/4b08bc68a548443bab31d6b110aa5c96 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:23:40.139658 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16836f2f-1d4c-4fe9-8e09-3e17d17858a3 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:40.140198 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16836f2f-1d4c-4fe9-8e09-3e17d17858a3 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:40.140198 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16836f2f-1d4c-4fe9-8e09-3e17d17858a3 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:40.141900 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 255/509] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:40.146799 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e874d4b-01fe-4c70-9f19-43c7198a7fae None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:40.147217 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e874d4b-01fe-4c70-9f19-43c7198a7fae None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:40.147356 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e874d4b-01fe-4c70-9f19-43c7198a7fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:40.169822 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-3e874d4b-01fe-4c70-9f19-43c7198a7fae None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:40.171518 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-3e874d4b-01fe-4c70-9f19-43c7198a7fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:40.232097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 255/510] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:40 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:40.254404 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16836f2f-1d4c-4fe9-8e09-3e17d17858a3 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:40.265769 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16836f2f-1d4c-4fe9-8e09-3e17d17858a3 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:40.269578 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208d6be-20d0-4456-83f3-c3c627801b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:40.270318 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208d6be-20d0-4456-83f3-c3c627801b67 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:40.270606 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208d6be-20d0-4456-83f3-c3c627801b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:40.270886 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208d6be-20d0-4456-83f3-c3c627801b67 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:40.282168 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208d6be-20d0-4456-83f3-c3c627801b67 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:23:40.288828 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-2208d6be-20d0-4456-83f3-c3c627801b67 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 01:23:40.289879 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 256/511] 10.222.0.20 () {56 vars in 1142 bytes} [Mon Aug 23 01:23:40 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:40.295037 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e874d4b-01fe-4c70-9f19-43c7198a7fae None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:40.303313 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e874d4b-01fe-4c70-9f19-43c7198a7fae None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:40.307195 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6d45f-da8e-44e4-b4ac-d0d2b9600b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:40.307768 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6d45f-da8e-44e4-b4ac-d0d2b9600b2c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:40.308051 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6d45f-da8e-44e4-b4ac-d0d2b9600b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:40.308326 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6d45f-da8e-44e4-b4ac-d0d2b9600b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:40.309060 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6d45f-da8e-44e4-b4ac-d0d2b9600b2c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:40.309417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6d45f-da8e-44e4-b4ac-d0d2b9600b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:40.335177 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6d45f-da8e-44e4-b4ac-d0d2b9600b2c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:40.343130 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 256/512] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Aug 23 01:23:40 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:40.348606 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208d6be-20d0-4456-83f3-c3c627801b67 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:40.357946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208d6be-20d0-4456-83f3-c3c627801b67 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:40.361865 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd6477-f5ae-4939-a4ac-84f579039325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:40.362539 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd6477-f5ae-4939-a4ac-84f579039325 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:40.362825 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd6477-f5ae-4939-a4ac-84f579039325 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:40.363103 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd6477-f5ae-4939-a4ac-84f579039325 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:40.374458 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd6477-f5ae-4939-a4ac-84f579039325 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:40.400277 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd6477-f5ae-4939-a4ac-84f579039325 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:40.417312 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-78bd6477-f5ae-4939-a4ac-84f579039325 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:40.418380 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 257/513] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:23:40.423760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6d45f-da8e-44e4-b4ac-d0d2b9600b2c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:40.432771 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6d45f-da8e-44e4-b4ac-d0d2b9600b2c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:40.437132 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7f980-f894-4591-8371-7596342f7a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:40.437699 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7f980-f894-4591-8371-7596342f7a6c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:40.437984 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7f980-f894-4591-8371-7596342f7a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:40.438262 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7f980-f894-4591-8371-7596342f7a6c admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:40.438927 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7f980-f894-4591-8371-7596342f7a6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:40.439220 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7f980-f894-4591-8371-7596342f7a6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:40.464049 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7f980-f894-4591-8371-7596342f7a6c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:40.476977 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 257/514] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:40.481887 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd6477-f5ae-4939-a4ac-84f579039325 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:40.490896 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd6477-f5ae-4939-a4ac-84f579039325 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:40.494829 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75390925-c029-410b-9d36-b70b59ad62c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:40.495511 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75390925-c029-410b-9d36-b70b59ad62c4 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:40.495797 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75390925-c029-410b-9d36-b70b59ad62c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:40.496077 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75390925-c029-410b-9d36-b70b59ad62c4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:40.508297 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75390925-c029-410b-9d36-b70b59ad62c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:40.534713 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75390925-c029-410b-9d36-b70b59ad62c4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:40.551524 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-75390925-c029-410b-9d36-b70b59ad62c4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 01:23:40.552538 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 258/515] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Aug 23 01:23:40 2021] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:40.557667 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7f980-f894-4591-8371-7596342f7a6c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:40.566558 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7f980-f894-4591-8371-7596342f7a6c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:40.570457 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b7d22-0b13-43b5-82e9-8a679b7e6e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:40.571027 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b7d22-0b13-43b5-82e9-8a679b7e6e4d admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:40.571310 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b7d22-0b13-43b5-82e9-8a679b7e6e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:40.571582 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b7d22-0b13-43b5-82e9-8a679b7e6e4d admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:40.572345 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b7d22-0b13-43b5-82e9-8a679b7e6e4d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:40.572678 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b7d22-0b13-43b5-82e9-8a679b7e6e4d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:40.599178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b7d22-0b13-43b5-82e9-8a679b7e6e4d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:40.626674 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 258/516] 10.222.0.20 () {56 vars in 1155 bytes} [Mon Aug 23 01:23:40 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:40.631794 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75390925-c029-410b-9d36-b70b59ad62c4 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:40.641219 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75390925-c029-410b-9d36-b70b59ad62c4 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:40.645084 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae876b88-a23f-485b-9653-8fb205512383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:40.645635 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae876b88-a23f-485b-9653-8fb205512383 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:40.645923 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae876b88-a23f-485b-9653-8fb205512383 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:40.646204 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae876b88-a23f-485b-9653-8fb205512383 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:40.653725 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae876b88-a23f-485b-9653-8fb205512383 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:40.679171 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae876b88-a23f-485b-9653-8fb205512383 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:40.687934 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 259/517] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:23:40 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:23:40.692893 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b7d22-0b13-43b5-82e9-8a679b7e6e4d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:40.701650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b7d22-0b13-43b5-82e9-8a679b7e6e4d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:40.705548 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2dd7f-02c1-4df4-b891-8360b90f6140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:40.706234 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2dd7f-02c1-4df4-b891-8360b90f6140 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:40.706515 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2dd7f-02c1-4df4-b891-8360b90f6140 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:40.706793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2dd7f-02c1-4df4-b891-8360b90f6140 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:40.718072 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2dd7f-02c1-4df4-b891-8360b90f6140 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:40.743665 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2dd7f-02c1-4df4-b891-8360b90f6140 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:40.760207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-6ac2dd7f-02c1-4df4-b891-8360b90f6140 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:40.761247 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 259/518] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:40.766192 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae876b88-a23f-485b-9653-8fb205512383 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:40.774339 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae876b88-a23f-485b-9653-8fb205512383 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:40.778204 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4eb56-b0f1-4d62-bd80-a80bd209f700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:40.778759 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4eb56-b0f1-4d62-bd80-a80bd209f700 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:40.779042 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4eb56-b0f1-4d62-bd80-a80bd209f700 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:40.779318 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4eb56-b0f1-4d62-bd80-a80bd209f700 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:40.780002 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4eb56-b0f1-4d62-bd80-a80bd209f700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:40.780293 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4eb56-b0f1-4d62-bd80-a80bd209f700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:40.805662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4eb56-b0f1-4d62-bd80-a80bd209f700 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:40.818658 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 260/519] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:40.823556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2dd7f-02c1-4df4-b891-8360b90f6140 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:40.832714 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2dd7f-02c1-4df4-b891-8360b90f6140 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:40.836531 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156af1f-fd2e-42bf-a9ff-d74328ffe09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:40.837236 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156af1f-fd2e-42bf-a9ff-d74328ffe09e admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:40.837518 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156af1f-fd2e-42bf-a9ff-d74328ffe09e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:40.837818 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156af1f-fd2e-42bf-a9ff-d74328ffe09e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:40.848839 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156af1f-fd2e-42bf-a9ff-d74328ffe09e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:40.874668 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156af1f-fd2e-42bf-a9ff-d74328ffe09e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:40.887905 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-a156af1f-fd2e-42bf-a9ff-d74328ffe09e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:23:40.889022 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 260/520] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:23:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:40.900976 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4eb56-b0f1-4d62-bd80-a80bd209f700 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:40.903247 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4eb56-b0f1-4d62-bd80-a80bd209f700 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:40.907722 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa0bf8-7943-4191-b5bd-7000f0e3b1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:40.908231 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa0bf8-7943-4191-b5bd-7000f0e3b1ae admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:40.908515 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa0bf8-7943-4191-b5bd-7000f0e3b1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:40.908825 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa0bf8-7943-4191-b5bd-7000f0e3b1ae admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:40.909546 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa0bf8-7943-4191-b5bd-7000f0e3b1ae admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:40.909843 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa0bf8-7943-4191-b5bd-7000f0e3b1ae admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:40.935599 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa0bf8-7943-4191-b5bd-7000f0e3b1ae admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:40.948117 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 261/521] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:23:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:23:40.953513 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156af1f-fd2e-42bf-a9ff-d74328ffe09e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:40.962427 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156af1f-fd2e-42bf-a9ff-d74328ffe09e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:40.966322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c46f0-df41-4540-9109-37a0dbe06723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:40.966879 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c46f0-df41-4540-9109-37a0dbe06723 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:40.967164 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c46f0-df41-4540-9109-37a0dbe06723 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:40.967931 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c46f0-df41-4540-9109-37a0dbe06723 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:40.968717 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c46f0-df41-4540-9109-37a0dbe06723 admin admin] RBAC: Adding query filter params (role.id=4b08bc68a548443bab31d6b110aa5c96, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=094c5e571da7480584098ba6ebcb70ed) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:40.969018 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c46f0-df41-4540-9109-37a0dbe06723 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:40.995082 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c46f0-df41-4540-9109-37a0dbe06723 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:41.000531 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 261/522] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:23:40 2021] GET /identity/v3/role_assignments?user.id=094c5e571da7480584098ba6ebcb70ed&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=4b08bc68a548443bab31d6b110aa5c96 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:43.018054 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd409dc-0e46-4993-bb59-7868aaf29f98 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:43.018584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd409dc-0e46-4993-bb59-7868aaf29f98 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:43.018680 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd409dc-0e46-4993-bb59-7868aaf29f98 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:43.020280 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 262/523] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:43.025426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fb5ce-0c7b-4c0f-ab5a-4bdd0b0cbf18 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:43.025789 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fb5ce-0c7b-4c0f-ab5a-4bdd0b0cbf18 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:43.025988 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fb5ce-0c7b-4c0f-ab5a-4bdd0b0cbf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:43.048355 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-8b1fb5ce-0c7b-4c0f-ab5a-4bdd0b0cbf18 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:43.049517 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-8b1fb5ce-0c7b-4c0f-ab5a-4bdd0b0cbf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:43.056082 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 262/524] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:43 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:43.080161 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd409dc-0e46-4993-bb59-7868aaf29f98 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:43.091734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd409dc-0e46-4993-bb59-7868aaf29f98 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:43.096493 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449c092-05ed-4310-a69e-fdbde0206252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:43.097225 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449c092-05ed-4310-a69e-fdbde0206252 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:43.097514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449c092-05ed-4310-a69e-fdbde0206252 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:43.097792 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449c092-05ed-4310-a69e-fdbde0206252 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:43.109072 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449c092-05ed-4310-a69e-fdbde0206252 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:43.134770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449c092-05ed-4310-a69e-fdbde0206252 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:43.151668 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-d449c092-05ed-4310-a69e-fdbde0206252 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:43.152735 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 263/525] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:43.158410 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fb5ce-0c7b-4c0f-ab5a-4bdd0b0cbf18 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:43.166773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fb5ce-0c7b-4c0f-ab5a-4bdd0b0cbf18 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:43.170735 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0017921-c4df-4fbd-8cbe-411ab9daa47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:43.171307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0017921-c4df-4fbd-8cbe-411ab9daa47c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:43.171585 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0017921-c4df-4fbd-8cbe-411ab9daa47c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:43.171855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0017921-c4df-4fbd-8cbe-411ab9daa47c admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:43.172525 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0017921-c4df-4fbd-8cbe-411ab9daa47c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:43.172849 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0017921-c4df-4fbd-8cbe-411ab9daa47c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:43.198220 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0017921-c4df-4fbd-8cbe-411ab9daa47c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:43.210959 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 263/526] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:43.216223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449c092-05ed-4310-a69e-fdbde0206252 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:43.225487 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449c092-05ed-4310-a69e-fdbde0206252 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:43.229470 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165227b6-ea8d-4d03-b910-6f5e6463e892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:43.230044 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165227b6-ea8d-4d03-b910-6f5e6463e892 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:43.230331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165227b6-ea8d-4d03-b910-6f5e6463e892 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:43.230608 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165227b6-ea8d-4d03-b910-6f5e6463e892 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:43.231252 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165227b6-ea8d-4d03-b910-6f5e6463e892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:43.256913 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165227b6-ea8d-4d03-b910-6f5e6463e892 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:43.337808 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 264/527] 10.222.0.20 () {60 vars in 1154 bytes} [Mon Aug 23 01:23:43 2021] POST /identity/v3/users => generated 248 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:23:45.290641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b861f82-69e6-4830-b1f3-017bc23aed01 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:45.291150 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b861f82-69e6-4830-b1f3-017bc23aed01 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:45.291268 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b861f82-69e6-4830-b1f3-017bc23aed01 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:45.292907 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 264/528] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:45.298532 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cada2-1d1b-42bd-9ede-a11c2d21de24 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:45.298917 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cada2-1d1b-42bd-9ede-a11c2d21de24 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:45.299108 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cada2-1d1b-42bd-9ede-a11c2d21de24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:45.322813 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-ef5cada2-1d1b-42bd-9ede-a11c2d21de24 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:45.323960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-ef5cada2-1d1b-42bd-9ede-a11c2d21de24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:45.330716 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 265/529] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:45 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:45.353414 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b861f82-69e6-4830-b1f3-017bc23aed01 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:45.365751 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b861f82-69e6-4830-b1f3-017bc23aed01 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:45.369729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebaaded-6844-4712-aa24-be232c87caef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:45.370447 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebaaded-6844-4712-aa24-be232c87caef admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:45.370738 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebaaded-6844-4712-aa24-be232c87caef admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:45.371018 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebaaded-6844-4712-aa24-be232c87caef admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:45.382284 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebaaded-6844-4712-aa24-be232c87caef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:23:45.388542 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-bebaaded-6844-4712-aa24-be232c87caef admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:23:45.389645 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 265/530] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:23:45 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:45.395225 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cada2-1d1b-42bd-9ede-a11c2d21de24 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:45.403716 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cada2-1d1b-42bd-9ede-a11c2d21de24 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:45.408196 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843ec0c-90ca-4f56-a92f-c57c0f28281d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:45.408813 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843ec0c-90ca-4f56-a92f-c57c0f28281d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:45.409104 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843ec0c-90ca-4f56-a92f-c57c0f28281d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:45.409384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843ec0c-90ca-4f56-a92f-c57c0f28281d admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:45.410091 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843ec0c-90ca-4f56-a92f-c57c0f28281d admin admin] RBAC: Adding query filter params (name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:45.410388 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843ec0c-90ca-4f56-a92f-c57c0f28281d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:45.436017 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843ec0c-90ca-4f56-a92f-c57c0f28281d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:45.444305 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 266/531] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:23:45 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:45.449664 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebaaded-6844-4712-aa24-be232c87caef admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:45.459181 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebaaded-6844-4712-aa24-be232c87caef admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:45.463141 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c6c72-7f79-48d1-91b5-a66f4bc992af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:45.463830 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c6c72-7f79-48d1-91b5-a66f4bc992af admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:45.464121 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c6c72-7f79-48d1-91b5-a66f4bc992af admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:45.464399 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c6c72-7f79-48d1-91b5-a66f4bc992af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:45.476004 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c6c72-7f79-48d1-91b5-a66f4bc992af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:45.501778 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c6c72-7f79-48d1-91b5-a66f4bc992af admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:45.518773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-320c6c72-7f79-48d1-91b5-a66f4bc992af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:45.519808 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 266/532] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:45.525071 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843ec0c-90ca-4f56-a92f-c57c0f28281d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:45.534570 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843ec0c-90ca-4f56-a92f-c57c0f28281d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:45.538533 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec71dd-25ea-4041-b443-69e758b56f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:45.539100 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec71dd-25ea-4041-b443-69e758b56f62 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:45.539390 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec71dd-25ea-4041-b443-69e758b56f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:45.539671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec71dd-25ea-4041-b443-69e758b56f62 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:45.540347 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec71dd-25ea-4041-b443-69e758b56f62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:45.540732 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec71dd-25ea-4041-b443-69e758b56f62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:45.566278 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec71dd-25ea-4041-b443-69e758b56f62 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:45.578685 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 267/533] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:45.583596 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c6c72-7f79-48d1-91b5-a66f4bc992af admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:45.593044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c6c72-7f79-48d1-91b5-a66f4bc992af admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:45.597302 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d493f4-ebf2-4121-b120-0f903c0d4ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:45.597991 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d493f4-ebf2-4121-b120-0f903c0d4ace admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:45.598280 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d493f4-ebf2-4121-b120-0f903c0d4ace admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:45.598561 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d493f4-ebf2-4121-b120-0f903c0d4ace admin admin] PATH_INFO: `/v3/users/glance` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:45.611360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d493f4-ebf2-4121-b120-0f903c0d4ace admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:45.636550 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d493f4-ebf2-4121-b120-0f903c0d4ace admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:45.654059 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-82d493f4-ebf2-4121-b120-0f903c0d4ace admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 01:23:45.655740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 267/534] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:23:45 2021] GET /identity/v3/users/glance => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:45.661497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec71dd-25ea-4041-b443-69e758b56f62 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:45.671585 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec71dd-25ea-4041-b443-69e758b56f62 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:45.675579 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acc40e-7801-4787-a4d8-1c42948bc9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:45.676166 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acc40e-7801-4787-a4d8-1c42948bc9ef admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:45.676453 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acc40e-7801-4787-a4d8-1c42948bc9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:45.676774 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acc40e-7801-4787-a4d8-1c42948bc9ef admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:45.677594 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11acc40e-7801-4787-a4d8-1c42948bc9ef admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:45.677900 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11acc40e-7801-4787-a4d8-1c42948bc9ef admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:45.703120 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11acc40e-7801-4787-a4d8-1c42948bc9ef admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:45.731826 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 268/535] 10.222.0.20 () {56 vars in 1159 bytes} [Mon Aug 23 01:23:45 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:23:45.737793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d493f4-ebf2-4121-b120-0f903c0d4ace admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:45.746906 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d493f4-ebf2-4121-b120-0f903c0d4ace admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:45.750860 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66db4b-d1fd-4291-aba8-9f402a5c073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:45.751420 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66db4b-d1fd-4291-aba8-9f402a5c073d admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:45.751735 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66db4b-d1fd-4291-aba8-9f402a5c073d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:45.752018 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66db4b-d1fd-4291-aba8-9f402a5c073d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:45.759454 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66db4b-d1fd-4291-aba8-9f402a5c073d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:45.785599 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66db4b-d1fd-4291-aba8-9f402a5c073d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:45.793808 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 268/536] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:23:45 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:23:45.798795 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acc40e-7801-4787-a4d8-1c42948bc9ef admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:45.807766 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acc40e-7801-4787-a4d8-1c42948bc9ef admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:45.811816 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5afa3-a67b-4401-84ed-6ada94f2ab6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:45.812513 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5afa3-a67b-4401-84ed-6ada94f2ab6f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:45.812834 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5afa3-a67b-4401-84ed-6ada94f2ab6f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:45.813115 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5afa3-a67b-4401-84ed-6ada94f2ab6f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:45.824313 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5afa3-a67b-4401-84ed-6ada94f2ab6f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:45.851007 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5afa3-a67b-4401-84ed-6ada94f2ab6f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:45.867288 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-84b5afa3-a67b-4401-84ed-6ada94f2ab6f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:45.868319 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 269/537] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:45.873526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66db4b-d1fd-4291-aba8-9f402a5c073d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:45.881744 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66db4b-d1fd-4291-aba8-9f402a5c073d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:45.885671 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4143cf-bcd3-46fe-bcde-db063ed43292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:45.891304 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4143cf-bcd3-46fe-bcde-db063ed43292 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:45.891304 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4143cf-bcd3-46fe-bcde-db063ed43292 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:45.891304 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4143cf-bcd3-46fe-bcde-db063ed43292 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:45.891304 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4143cf-bcd3-46fe-bcde-db063ed43292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:45.891304 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4143cf-bcd3-46fe-bcde-db063ed43292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:45.913543 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4143cf-bcd3-46fe-bcde-db063ed43292 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:45.926003 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 269/538] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:23:45.931086 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5afa3-a67b-4401-84ed-6ada94f2ab6f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:45.940195 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5afa3-a67b-4401-84ed-6ada94f2ab6f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:45.944185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46e9ec-7e48-4651-a914-09866efb439f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:45.944904 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46e9ec-7e48-4651-a914-09866efb439f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:45.945193 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46e9ec-7e48-4651-a914-09866efb439f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:45.945478 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46e9ec-7e48-4651-a914-09866efb439f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:45.954713 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46e9ec-7e48-4651-a914-09866efb439f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:45.980998 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46e9ec-7e48-4651-a914-09866efb439f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:45.994985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-3a46e9ec-7e48-4651-a914-09866efb439f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:23:45.996068 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 270/539] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:23:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:23:46.001736 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4143cf-bcd3-46fe-bcde-db063ed43292 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:46.010841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4143cf-bcd3-46fe-bcde-db063ed43292 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:46.015307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3b952-3d66-43ae-830c-7a16a1447f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:46.015878 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3b952-3d66-43ae-830c-7a16a1447f9e admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:46.016165 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3b952-3d66-43ae-830c-7a16a1447f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:46.016445 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3b952-3d66-43ae-830c-7a16a1447f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:46.017208 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3b952-3d66-43ae-830c-7a16a1447f9e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:46.017507 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3b952-3d66-43ae-830c-7a16a1447f9e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:46.043189 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3b952-3d66-43ae-830c-7a16a1447f9e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:46.055636 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 270/540] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:23:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:46.060838 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46e9ec-7e48-4651-a914-09866efb439f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:46.069840 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46e9ec-7e48-4651-a914-09866efb439f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:46.073862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b260af-82fa-40b6-888a-9f1034bd8cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:46.074416 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b260af-82fa-40b6-888a-9f1034bd8cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:46.074702 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b260af-82fa-40b6-888a-9f1034bd8cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:46.074985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b260af-82fa-40b6-888a-9f1034bd8cb7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:46.075751 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b260af-82fa-40b6-888a-9f1034bd8cb7 admin admin] RBAC: Adding query filter params (role.id=aa34949eb3ac4431991f6c257fca79a9, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=913cd471ba494382af7dda858b9010c2) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:46.076056 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b260af-82fa-40b6-888a-9f1034bd8cb7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:46.102633 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b260af-82fa-40b6-888a-9f1034bd8cb7 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:46.107777 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 271/541] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:23:46 2021] GET /identity/v3/role_assignments?user.id=913cd471ba494382af7dda858b9010c2&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=aa34949eb3ac4431991f6c257fca79a9 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:48.020331 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b1580-e071-402a-8111-7dc4faf22d40 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:48.020970 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b1580-e071-402a-8111-7dc4faf22d40 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:48.020970 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b1580-e071-402a-8111-7dc4faf22d40 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:48.022576 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 271/542] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:48.027524 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4091441-cac9-4964-86e3-a047ba6331b8 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:48.027929 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4091441-cac9-4964-86e3-a047ba6331b8 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:48.028100 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4091441-cac9-4964-86e3-a047ba6331b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:48.050800 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-a4091441-cac9-4964-86e3-a047ba6331b8 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:48.051931 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a4091441-cac9-4964-86e3-a047ba6331b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:48.058584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 272/543] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:48 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:48.080204 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b1580-e071-402a-8111-7dc4faf22d40 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:48.091391 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b1580-e071-402a-8111-7dc4faf22d40 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:48.095239 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83febe7-620e-4daf-a981-243a6daacb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:48.096184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83febe7-620e-4daf-a981-243a6daacb91 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:48.096467 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83febe7-620e-4daf-a981-243a6daacb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:48.096768 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83febe7-620e-4daf-a981-243a6daacb91 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:48.107492 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83febe7-620e-4daf-a981-243a6daacb91 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:23:48.114296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-b83febe7-620e-4daf-a981-243a6daacb91 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:23:48.115336 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 272/544] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:23:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:48.120532 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4091441-cac9-4964-86e3-a047ba6331b8 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:48.128950 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4091441-cac9-4964-86e3-a047ba6331b8 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:48.132915 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626b09c-ba27-49d1-884e-ea53d9d141f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:48.133488 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626b09c-ba27-49d1-884e-ea53d9d141f3 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:48.133778 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626b09c-ba27-49d1-884e-ea53d9d141f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:48.134061 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626b09c-ba27-49d1-884e-ea53d9d141f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:48.134761 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626b09c-ba27-49d1-884e-ea53d9d141f3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:48.135060 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626b09c-ba27-49d1-884e-ea53d9d141f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:48.161141 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626b09c-ba27-49d1-884e-ea53d9d141f3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:48.169253 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 273/545] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:23:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:48.174217 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83febe7-620e-4daf-a981-243a6daacb91 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:48.183499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83febe7-620e-4daf-a981-243a6daacb91 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:48.187413 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91a5bb-4cb6-48ac-8122-b5446bc63d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:48.188082 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91a5bb-4cb6-48ac-8122-b5446bc63d53 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:48.188366 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91a5bb-4cb6-48ac-8122-b5446bc63d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:48.188680 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91a5bb-4cb6-48ac-8122-b5446bc63d53 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:48.199405 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91a5bb-4cb6-48ac-8122-b5446bc63d53 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:48.225845 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91a5bb-4cb6-48ac-8122-b5446bc63d53 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:48.242613 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-2c91a5bb-4cb6-48ac-8122-b5446bc63d53 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:48.243623 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 273/546] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:48.248634 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626b09c-ba27-49d1-884e-ea53d9d141f3 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:48.257593 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626b09c-ba27-49d1-884e-ea53d9d141f3 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:48.261555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69934a-e5ea-47ba-888a-dad1b89ca080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:48.262114 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69934a-e5ea-47ba-888a-dad1b89ca080 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:48.262402 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69934a-e5ea-47ba-888a-dad1b89ca080 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:48.262685 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69934a-e5ea-47ba-888a-dad1b89ca080 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:48.263351 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69934a-e5ea-47ba-888a-dad1b89ca080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:48.263647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69934a-e5ea-47ba-888a-dad1b89ca080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:48.289163 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69934a-e5ea-47ba-888a-dad1b89ca080 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:48.302047 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 274/547] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:48.306897 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91a5bb-4cb6-48ac-8122-b5446bc63d53 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:48.315719 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91a5bb-4cb6-48ac-8122-b5446bc63d53 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:48.319606 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e2177-abc2-42cb-8d58-e1e436b4f89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:48.320283 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e2177-abc2-42cb-8d58-e1e436b4f89d admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:48.320587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e2177-abc2-42cb-8d58-e1e436b4f89d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:48.320877 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e2177-abc2-42cb-8d58-e1e436b4f89d admin admin] PATH_INFO: `/v3/users/glance` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:48.333546 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e2177-abc2-42cb-8d58-e1e436b4f89d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:48.359461 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e2177-abc2-42cb-8d58-e1e436b4f89d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:48.376938 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-fe3e2177-abc2-42cb-8d58-e1e436b4f89d admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 01:23:48.377974 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 274/548] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:23:48 2021] GET /identity/v3/users/glance => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:48.383152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69934a-e5ea-47ba-888a-dad1b89ca080 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:48.392865 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69934a-e5ea-47ba-888a-dad1b89ca080 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:48.396818 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c4b70-90aa-4192-82dc-a3eb46199d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:48.397395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c4b70-90aa-4192-82dc-a3eb46199d5e admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:48.397681 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c4b70-90aa-4192-82dc-a3eb46199d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:48.397962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c4b70-90aa-4192-82dc-a3eb46199d5e admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:48.398738 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c4b70-90aa-4192-82dc-a3eb46199d5e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:48.399040 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c4b70-90aa-4192-82dc-a3eb46199d5e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:48.424259 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c4b70-90aa-4192-82dc-a3eb46199d5e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:48.452869 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 275/549] 10.222.0.20 () {56 vars in 1159 bytes} [Mon Aug 23 01:23:48 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:48.458158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e2177-abc2-42cb-8d58-e1e436b4f89d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:48.467627 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e2177-abc2-42cb-8d58-e1e436b4f89d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:48.471796 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d452c-2863-44f5-8a0a-437a5ebcf005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:48.472727 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d452c-2863-44f5-8a0a-437a5ebcf005 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:48.473013 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d452c-2863-44f5-8a0a-437a5ebcf005 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:48.473289 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d452c-2863-44f5-8a0a-437a5ebcf005 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:48.485882 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d452c-2863-44f5-8a0a-437a5ebcf005 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:48.515165 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d452c-2863-44f5-8a0a-437a5ebcf005 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:48.531737 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-b58d452c-2863-44f5-8a0a-437a5ebcf005 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:48.532796 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 275/550] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:48.538021 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c4b70-90aa-4192-82dc-a3eb46199d5e admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:48.547758 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c4b70-90aa-4192-82dc-a3eb46199d5e admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:48.551609 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bc322-570a-4d16-9688-5b8c23c5275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:48.552180 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bc322-570a-4d16-9688-5b8c23c5275a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:48.552467 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bc322-570a-4d16-9688-5b8c23c5275a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:48.552773 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bc322-570a-4d16-9688-5b8c23c5275a admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:48.553447 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bc322-570a-4d16-9688-5b8c23c5275a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:48.553743 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bc322-570a-4d16-9688-5b8c23c5275a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:48.578923 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bc322-570a-4d16-9688-5b8c23c5275a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:48.590591 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 276/551] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:48.596325 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d452c-2863-44f5-8a0a-437a5ebcf005 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:48.605289 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d452c-2863-44f5-8a0a-437a5ebcf005 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:48.609817 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9d087-3f77-41b3-a343-00ce9b95acbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:48.610510 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9d087-3f77-41b3-a343-00ce9b95acbb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:48.610793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9d087-3f77-41b3-a343-00ce9b95acbb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:48.611069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9d087-3f77-41b3-a343-00ce9b95acbb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:48.620917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9d087-3f77-41b3-a343-00ce9b95acbb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:48.645850 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9d087-3f77-41b3-a343-00ce9b95acbb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:48.659348 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-f2a9d087-3f77-41b3-a343-00ce9b95acbb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:23:48.660356 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 276/552] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:23:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:23:48.665527 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bc322-570a-4d16-9688-5b8c23c5275a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:48.675049 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bc322-570a-4d16-9688-5b8c23c5275a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:48.679026 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95da1a-5602-4b5d-8177-5fcdc6134401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:48.679592 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95da1a-5602-4b5d-8177-5fcdc6134401 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:48.679880 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95da1a-5602-4b5d-8177-5fcdc6134401 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:48.680159 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95da1a-5602-4b5d-8177-5fcdc6134401 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:48.680918 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95da1a-5602-4b5d-8177-5fcdc6134401 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:48.681217 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95da1a-5602-4b5d-8177-5fcdc6134401 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:48.706364 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95da1a-5602-4b5d-8177-5fcdc6134401 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:48.719390 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 277/553] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:23:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:23:48.724848 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9d087-3f77-41b3-a343-00ce9b95acbb admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:48.734204 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9d087-3f77-41b3-a343-00ce9b95acbb admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:48.738110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce51617-49a9-41f7-9c5a-ec22adc79767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:48.738883 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce51617-49a9-41f7-9c5a-ec22adc79767 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:48.739167 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce51617-49a9-41f7-9c5a-ec22adc79767 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:48.739445 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce51617-49a9-41f7-9c5a-ec22adc79767 admin admin] PATH_INFO: `/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/913cd471ba494382af7dda858b9010c2/roles/aa34949eb3ac4431991f6c257fca79a9` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:48.758387 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce51617-49a9-41f7-9c5a-ec22adc79767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2728fddda1c4691b33daad4fa4ef3d2, user_id=913cd471ba494382af7dda858b9010c2, role_id=aa34949eb3ac4431991f6c257fca79a9)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:48.785417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce51617-49a9-41f7-9c5a-ec22adc79767 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:48.863158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 277/554] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:23:48 2021] PUT /identity/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/913cd471ba494382af7dda858b9010c2/roles/aa34949eb3ac4431991f6c257fca79a9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:23:50.777418 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32da33e-e81b-40c1-b29e-490151aeeb0f None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:50.777960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32da33e-e81b-40c1-b29e-490151aeeb0f None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:50.777960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32da33e-e81b-40c1-b29e-490151aeeb0f None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:50.780071 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 278/555] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:50.785194 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62950a6e-3d61-495e-bee1-806f1d99e150 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:50.785570 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62950a6e-3d61-495e-bee1-806f1d99e150 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:50.785764 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62950a6e-3d61-495e-bee1-806f1d99e150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:50.808110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-62950a6e-3d61-495e-bee1-806f1d99e150 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:50.809259 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-62950a6e-3d61-495e-bee1-806f1d99e150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:50.870315 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 278/556] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:50 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:50.893446 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32da33e-e81b-40c1-b29e-490151aeeb0f None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:50.905016 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32da33e-e81b-40c1-b29e-490151aeeb0f None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:50.908812 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b3c91-7738-47f4-86f2-0401e57f0d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:50.909514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b3c91-7738-47f4-86f2-0401e57f0d9a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:50.909802 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b3c91-7738-47f4-86f2-0401e57f0d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:50.910080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b3c91-7738-47f4-86f2-0401e57f0d9a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:50.920949 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b3c91-7738-47f4-86f2-0401e57f0d9a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:23:50.927144 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-a44b3c91-7738-47f4-86f2-0401e57f0d9a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:23:50.928195 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 279/557] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:23:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:50.933510 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62950a6e-3d61-495e-bee1-806f1d99e150 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:50.942351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62950a6e-3d61-495e-bee1-806f1d99e150 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:50.946316 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda080e-8bc3-4ab3-aa61-8cc501157522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:50.946894 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda080e-8bc3-4ab3-aa61-8cc501157522 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:50.947183 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda080e-8bc3-4ab3-aa61-8cc501157522 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:50.947463 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda080e-8bc3-4ab3-aa61-8cc501157522 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:50.948162 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda080e-8bc3-4ab3-aa61-8cc501157522 admin admin] RBAC: Adding query filter params (name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:50.948462 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda080e-8bc3-4ab3-aa61-8cc501157522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:50.974067 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda080e-8bc3-4ab3-aa61-8cc501157522 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:50.982131 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 279/558] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:23:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:50.987903 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b3c91-7738-47f4-86f2-0401e57f0d9a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:50.997294 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b3c91-7738-47f4-86f2-0401e57f0d9a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:51.001246 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c266c-09bf-4079-849e-4caa8091a197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:51.001922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c266c-09bf-4079-849e-4caa8091a197 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:51.002207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c266c-09bf-4079-849e-4caa8091a197 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:51.002485 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c266c-09bf-4079-849e-4caa8091a197 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:51.013302 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c266c-09bf-4079-849e-4caa8091a197 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:51.039633 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c266c-09bf-4079-849e-4caa8091a197 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:51.057559 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-7d4c266c-09bf-4079-849e-4caa8091a197 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:51.058572 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 280/559] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:51.063606 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda080e-8bc3-4ab3-aa61-8cc501157522 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:51.072467 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda080e-8bc3-4ab3-aa61-8cc501157522 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:51.076952 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92993d8f-cb40-4baa-8c2b-b7b21c2b5d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:51.077517 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92993d8f-cb40-4baa-8c2b-b7b21c2b5d30 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:51.077802 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92993d8f-cb40-4baa-8c2b-b7b21c2b5d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:51.078079 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92993d8f-cb40-4baa-8c2b-b7b21c2b5d30 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:51.078777 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92993d8f-cb40-4baa-8c2b-b7b21c2b5d30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:51.079075 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92993d8f-cb40-4baa-8c2b-b7b21c2b5d30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:51.104632 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92993d8f-cb40-4baa-8c2b-b7b21c2b5d30 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:51.116842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 280/560] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:51.121777 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c266c-09bf-4079-849e-4caa8091a197 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:51.130620 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c266c-09bf-4079-849e-4caa8091a197 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:51.134566 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7316b2-7f2d-4ece-a196-9cfe530cdbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:51.135243 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7316b2-7f2d-4ece-a196-9cfe530cdbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:51.135527 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7316b2-7f2d-4ece-a196-9cfe530cdbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:51.135803 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7316b2-7f2d-4ece-a196-9cfe530cdbb5 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:51.148473 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7316b2-7f2d-4ece-a196-9cfe530cdbb5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:51.174391 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7316b2-7f2d-4ece-a196-9cfe530cdbb5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:51.191523 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-5c7316b2-7f2d-4ece-a196-9cfe530cdbb5 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 01:23:51.192528 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 281/561] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:23:51 2021] GET /identity/v3/users/glance => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:51.197593 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92993d8f-cb40-4baa-8c2b-b7b21c2b5d30 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:51.206970 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92993d8f-cb40-4baa-8c2b-b7b21c2b5d30 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:51.210942 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f7069-9840-44d7-94e9-e3c3466e3d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:51.211518 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f7069-9840-44d7-94e9-e3c3466e3d46 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:51.211807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f7069-9840-44d7-94e9-e3c3466e3d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:51.212085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f7069-9840-44d7-94e9-e3c3466e3d46 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:51.212884 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f7069-9840-44d7-94e9-e3c3466e3d46 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:51.213186 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f7069-9840-44d7-94e9-e3c3466e3d46 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:51.239030 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f7069-9840-44d7-94e9-e3c3466e3d46 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:51.268169 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 281/562] 10.222.0.20 () {56 vars in 1159 bytes} [Mon Aug 23 01:23:51 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:51.273368 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7316b2-7f2d-4ece-a196-9cfe530cdbb5 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:51.282882 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7316b2-7f2d-4ece-a196-9cfe530cdbb5 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:51.286822 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116734c-fa4a-4ed8-93ca-a1d317ffa685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:51.287370 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116734c-fa4a-4ed8-93ca-a1d317ffa685 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:51.287654 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116734c-fa4a-4ed8-93ca-a1d317ffa685 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:51.287931 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116734c-fa4a-4ed8-93ca-a1d317ffa685 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:51.295343 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116734c-fa4a-4ed8-93ca-a1d317ffa685 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:51.320209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116734c-fa4a-4ed8-93ca-a1d317ffa685 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:51.328802 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 282/563] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:23:51 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:23:51.333782 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f7069-9840-44d7-94e9-e3c3466e3d46 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:51.342728 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f7069-9840-44d7-94e9-e3c3466e3d46 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:51.347001 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d66bdf-41eb-4f90-b146-f0b6dc9fa6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:51.347694 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d66bdf-41eb-4f90-b146-f0b6dc9fa6ba admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:51.347982 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d66bdf-41eb-4f90-b146-f0b6dc9fa6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:51.348265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d66bdf-41eb-4f90-b146-f0b6dc9fa6ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:51.359428 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d66bdf-41eb-4f90-b146-f0b6dc9fa6ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:51.385018 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d66bdf-41eb-4f90-b146-f0b6dc9fa6ba admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:51.401806 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-b4d66bdf-41eb-4f90-b146-f0b6dc9fa6ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:51.402860 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 282/564] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:51.409156 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116734c-fa4a-4ed8-93ca-a1d317ffa685 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:51.417497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116734c-fa4a-4ed8-93ca-a1d317ffa685 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:51.422113 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4781c-5227-4b89-91fa-28582e0c851d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:51.422681 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4781c-5227-4b89-91fa-28582e0c851d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:51.422963 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4781c-5227-4b89-91fa-28582e0c851d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:51.423239 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4781c-5227-4b89-91fa-28582e0c851d admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:51.423905 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4781c-5227-4b89-91fa-28582e0c851d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:51.424198 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4781c-5227-4b89-91fa-28582e0c851d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:51.449222 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4781c-5227-4b89-91fa-28582e0c851d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:51.461607 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 283/565] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:23:51.466730 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d66bdf-41eb-4f90-b146-f0b6dc9fa6ba admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:51.476580 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d66bdf-41eb-4f90-b146-f0b6dc9fa6ba admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:51.480552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd85f12-d202-4e3a-842d-39eca10143d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:51.481275 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd85f12-d202-4e3a-842d-39eca10143d9 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:51.481563 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd85f12-d202-4e3a-842d-39eca10143d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:51.481842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd85f12-d202-4e3a-842d-39eca10143d9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:51.491112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd85f12-d202-4e3a-842d-39eca10143d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:51.516286 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd85f12-d202-4e3a-842d-39eca10143d9 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:51.529347 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-bcd85f12-d202-4e3a-842d-39eca10143d9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:23:51.530864 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 283/566] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:23:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:51.536483 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4781c-5227-4b89-91fa-28582e0c851d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:51.546404 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4781c-5227-4b89-91fa-28582e0c851d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:51.550352 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283edeb5-e52d-4ff3-a186-df6351f80737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:51.550922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283edeb5-e52d-4ff3-a186-df6351f80737 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:51.551208 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283edeb5-e52d-4ff3-a186-df6351f80737 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:51.551488 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283edeb5-e52d-4ff3-a186-df6351f80737 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:51.552217 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283edeb5-e52d-4ff3-a186-df6351f80737 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:51.552519 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283edeb5-e52d-4ff3-a186-df6351f80737 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:51.577603 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283edeb5-e52d-4ff3-a186-df6351f80737 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:51.590134 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 284/567] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:23:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:51.596292 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd85f12-d202-4e3a-842d-39eca10143d9 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:51.605288 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd85f12-d202-4e3a-842d-39eca10143d9 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:51.609802 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d7674-8c09-429a-8eb8-240e99e93bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:51.610366 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d7674-8c09-429a-8eb8-240e99e93bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:51.610651 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d7674-8c09-429a-8eb8-240e99e93bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:51.610928 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d7674-8c09-429a-8eb8-240e99e93bf7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:51.611699 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d7674-8c09-429a-8eb8-240e99e93bf7 admin admin] RBAC: Adding query filter params (role.id=aa34949eb3ac4431991f6c257fca79a9, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=913cd471ba494382af7dda858b9010c2) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:51.612000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d7674-8c09-429a-8eb8-240e99e93bf7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:51.637305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d7674-8c09-429a-8eb8-240e99e93bf7 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:51.642797 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 284/568] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:23:51 2021] GET /identity/v3/role_assignments?user.id=913cd471ba494382af7dda858b9010c2&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=aa34949eb3ac4431991f6c257fca79a9 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:53.615673 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d917213-2367-45a8-b634-13a9913aaddf None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:53.616203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d917213-2367-45a8-b634-13a9913aaddf None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:53.616307 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d917213-2367-45a8-b634-13a9913aaddf None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:53.617922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 285/569] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:53.623793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e579d54-8543-4545-9e77-11b5a273034c None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:53.624159 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e579d54-8543-4545-9e77-11b5a273034c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:53.624357 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e579d54-8543-4545-9e77-11b5a273034c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:53.647130 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-0e579d54-8543-4545-9e77-11b5a273034c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:53.648244 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0e579d54-8543-4545-9e77-11b5a273034c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:53.654810 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 285/570] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:53 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:23:53.677355 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d917213-2367-45a8-b634-13a9913aaddf None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:53.689237 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d917213-2367-45a8-b634-13a9913aaddf None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:53.693034 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b573287-936d-4766-a0cd-f85220199675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:53.693730 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b573287-936d-4766-a0cd-f85220199675 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:53.694016 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b573287-936d-4766-a0cd-f85220199675 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:53.694296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b573287-936d-4766-a0cd-f85220199675 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:53.706040 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b573287-936d-4766-a0cd-f85220199675 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:53.731442 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b573287-936d-4766-a0cd-f85220199675 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:53.747589 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-4b573287-936d-4766-a0cd-f85220199675 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:53.749183 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 286/571] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:53.754900 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e579d54-8543-4545-9e77-11b5a273034c None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:53.763179 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e579d54-8543-4545-9e77-11b5a273034c None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:53.767608 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3f2b9-45ba-4443-9843-fe21f372a712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:53.768179 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3f2b9-45ba-4443-9843-fe21f372a712 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:53.768462 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3f2b9-45ba-4443-9843-fe21f372a712 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:53.768771 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3f2b9-45ba-4443-9843-fe21f372a712 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:53.769435 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3f2b9-45ba-4443-9843-fe21f372a712 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:53.769729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3f2b9-45ba-4443-9843-fe21f372a712 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:53.794341 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3f2b9-45ba-4443-9843-fe21f372a712 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:53.806420 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 286/572] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:53.812122 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b573287-936d-4766-a0cd-f85220199675 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:53.821053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b573287-936d-4766-a0cd-f85220199675 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:53.824948 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25980b-1e88-4745-bc07-f0c8f8758f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:53.825516 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25980b-1e88-4745-bc07-f0c8f8758f5b admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:53.825805 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25980b-1e88-4745-bc07-f0c8f8758f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:53.826086 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25980b-1e88-4745-bc07-f0c8f8758f5b admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:53.827310 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25980b-1e88-4745-bc07-f0c8f8758f5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:53.852653 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25980b-1e88-4745-bc07-f0c8f8758f5b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:53.953182 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 287/573] 10.222.0.20 () {60 vars in 1154 bytes} [Mon Aug 23 01:23:53 2021] POST /identity/v3/users => generated 254 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:23:55.900501 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf2630-9490-4014-ab17-2209d4fc3ff8 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:55.901057 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf2630-9490-4014-ab17-2209d4fc3ff8 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:55.901152 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf2630-9490-4014-ab17-2209d4fc3ff8 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:55.902739 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 287/574] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:55.908262 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ae302-cc49-41d0-a57e-c9b8e6ba713f None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:55.908693 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ae302-cc49-41d0-a57e-c9b8e6ba713f None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:55.908856 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ae302-cc49-41d0-a57e-c9b8e6ba713f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:55.930728 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-2f8ae302-cc49-41d0-a57e-c9b8e6ba713f None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:55.931855 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2f8ae302-cc49-41d0-a57e-c9b8e6ba713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:55.938431 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 288/575] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:55 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:55.959778 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf2630-9490-4014-ab17-2209d4fc3ff8 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:55.971703 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf2630-9490-4014-ab17-2209d4fc3ff8 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:55.975484 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1deaae0-73eb-4c17-998a-151d91a65b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:55.976172 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1deaae0-73eb-4c17-998a-151d91a65b8e admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:55.976456 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1deaae0-73eb-4c17-998a-151d91a65b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:55.976766 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1deaae0-73eb-4c17-998a-151d91a65b8e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:55.987550 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1deaae0-73eb-4c17-998a-151d91a65b8e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:23:55.993740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-e1deaae0-73eb-4c17-998a-151d91a65b8e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:23:55.994768 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 288/576] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:23:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:56.000458 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ae302-cc49-41d0-a57e-c9b8e6ba713f None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:56.008694 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ae302-cc49-41d0-a57e-c9b8e6ba713f None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:56.012581 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f3e46-b12e-455c-b717-504222ee2b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:56.013221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f3e46-b12e-455c-b717-504222ee2b66 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:56.013508 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f3e46-b12e-455c-b717-504222ee2b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:56.014357 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f3e46-b12e-455c-b717-504222ee2b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:56.015055 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f3e46-b12e-455c-b717-504222ee2b66 admin admin] RBAC: Adding query filter params (name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:56.015353 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f3e46-b12e-455c-b717-504222ee2b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:56.040341 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f3e46-b12e-455c-b717-504222ee2b66 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:56.048404 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 289/577] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:23:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:56.053325 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1deaae0-73eb-4c17-998a-151d91a65b8e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:56.065092 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1deaae0-73eb-4c17-998a-151d91a65b8e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:56.068989 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8a7f8-33c3-4ce9-8052-05d7ac12e232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:56.069659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8a7f8-33c3-4ce9-8052-05d7ac12e232 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:56.069937 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8a7f8-33c3-4ce9-8052-05d7ac12e232 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:56.070206 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8a7f8-33c3-4ce9-8052-05d7ac12e232 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:56.081235 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8a7f8-33c3-4ce9-8052-05d7ac12e232 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:56.106782 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8a7f8-33c3-4ce9-8052-05d7ac12e232 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:56.123903 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-aaa8a7f8-33c3-4ce9-8052-05d7ac12e232 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:56.124927 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 289/578] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:56.130012 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f3e46-b12e-455c-b717-504222ee2b66 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:56.138911 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f3e46-b12e-455c-b717-504222ee2b66 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:56.142865 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3467e3a-e4f5-4d35-9010-e339309dc9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:56.143423 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3467e3a-e4f5-4d35-9010-e339309dc9ef admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:56.143707 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3467e3a-e4f5-4d35-9010-e339309dc9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:56.143986 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3467e3a-e4f5-4d35-9010-e339309dc9ef admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:56.144692 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3467e3a-e4f5-4d35-9010-e339309dc9ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:56.144992 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3467e3a-e4f5-4d35-9010-e339309dc9ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:56.171067 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3467e3a-e4f5-4d35-9010-e339309dc9ef admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:56.183221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 290/579] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:56.187999 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8a7f8-33c3-4ce9-8052-05d7ac12e232 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:56.196740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8a7f8-33c3-4ce9-8052-05d7ac12e232 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:56.200595 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a89cb1-fca7-41d5-a302-cc42aafca2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:56.201281 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a89cb1-fca7-41d5-a302-cc42aafca2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:56.201567 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a89cb1-fca7-41d5-a302-cc42aafca2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:56.201840 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a89cb1-fca7-41d5-a302-cc42aafca2b1 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:56.213881 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a89cb1-fca7-41d5-a302-cc42aafca2b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:56.239726 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a89cb1-fca7-41d5-a302-cc42aafca2b1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:56.257263 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-62a89cb1-fca7-41d5-a302-cc42aafca2b1 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 01:23:56.258264 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 290/580] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Aug 23 01:23:56 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:56.263329 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3467e3a-e4f5-4d35-9010-e339309dc9ef admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:56.272726 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3467e3a-e4f5-4d35-9010-e339309dc9ef admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:56.276682 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1654c3-50a5-44a1-a30b-5b567eba0381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:56.277252 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1654c3-50a5-44a1-a30b-5b567eba0381 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:56.277538 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1654c3-50a5-44a1-a30b-5b567eba0381 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:56.277818 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1654c3-50a5-44a1-a30b-5b567eba0381 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:56.278583 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1654c3-50a5-44a1-a30b-5b567eba0381 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:56.278881 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1654c3-50a5-44a1-a30b-5b567eba0381 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:56.304611 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1654c3-50a5-44a1-a30b-5b567eba0381 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:56.332765 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 291/581] 10.222.0.20 () {56 vars in 1171 bytes} [Mon Aug 23 01:23:56 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:56.337733 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a89cb1-fca7-41d5-a302-cc42aafca2b1 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:56.346764 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a89cb1-fca7-41d5-a302-cc42aafca2b1 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:56.350602 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de06fe-9acc-4fbd-979c-f7a1bdde6f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:56.351144 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de06fe-9acc-4fbd-979c-f7a1bdde6f56 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:56.351427 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de06fe-9acc-4fbd-979c-f7a1bdde6f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:56.351704 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de06fe-9acc-4fbd-979c-f7a1bdde6f56 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:56.359787 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de06fe-9acc-4fbd-979c-f7a1bdde6f56 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:56.385285 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de06fe-9acc-4fbd-979c-f7a1bdde6f56 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:56.393480 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 291/582] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:23:56 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:23:56.398468 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1654c3-50a5-44a1-a30b-5b567eba0381 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:56.407387 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1654c3-50a5-44a1-a30b-5b567eba0381 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:56.411312 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199a67e-1073-4fcf-a2d3-4fc0f62c43e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:56.412013 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199a67e-1073-4fcf-a2d3-4fc0f62c43e6 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:56.412300 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199a67e-1073-4fcf-a2d3-4fc0f62c43e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:56.412602 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199a67e-1073-4fcf-a2d3-4fc0f62c43e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:56.424271 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199a67e-1073-4fcf-a2d3-4fc0f62c43e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:56.449920 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199a67e-1073-4fcf-a2d3-4fc0f62c43e6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:56.466093 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-3199a67e-1073-4fcf-a2d3-4fc0f62c43e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:56.467166 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 292/583] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:23:56.472853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de06fe-9acc-4fbd-979c-f7a1bdde6f56 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:56.481159 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de06fe-9acc-4fbd-979c-f7a1bdde6f56 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:56.485635 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc2c86-703b-4d66-9756-e6949a86786a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:56.486206 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc2c86-703b-4d66-9756-e6949a86786a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:56.486492 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc2c86-703b-4d66-9756-e6949a86786a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:56.486772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc2c86-703b-4d66-9756-e6949a86786a admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:56.487444 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc2c86-703b-4d66-9756-e6949a86786a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:56.487743 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc2c86-703b-4d66-9756-e6949a86786a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:56.513159 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc2c86-703b-4d66-9756-e6949a86786a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:56.525621 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 292/584] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:56.530501 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199a67e-1073-4fcf-a2d3-4fc0f62c43e6 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:56.539414 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199a67e-1073-4fcf-a2d3-4fc0f62c43e6 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:56.543302 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661a8a7-75af-4b5c-8d42-b39a440836a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:56.543985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661a8a7-75af-4b5c-8d42-b39a440836a1 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:56.544270 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661a8a7-75af-4b5c-8d42-b39a440836a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:56.544549 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661a8a7-75af-4b5c-8d42-b39a440836a1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:56.553693 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661a8a7-75af-4b5c-8d42-b39a440836a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:56.579486 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661a8a7-75af-4b5c-8d42-b39a440836a1 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:56.593070 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-9661a8a7-75af-4b5c-8d42-b39a440836a1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:23:56.594081 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 293/585] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:23:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:23:56.599438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc2c86-703b-4d66-9756-e6949a86786a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:56.609000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc2c86-703b-4d66-9756-e6949a86786a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:56.612963 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbcb0e-30bb-4d47-ad68-c8c2c3209c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:56.613529 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbcb0e-30bb-4d47-ad68-c8c2c3209c2b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:56.613817 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbcb0e-30bb-4d47-ad68-c8c2c3209c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:56.614099 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbcb0e-30bb-4d47-ad68-c8c2c3209c2b admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:56.614822 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbcb0e-30bb-4d47-ad68-c8c2c3209c2b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:56.615123 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbcb0e-30bb-4d47-ad68-c8c2c3209c2b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:56.640211 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbcb0e-30bb-4d47-ad68-c8c2c3209c2b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:56.652976 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 293/586] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:23:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:23:56.659051 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661a8a7-75af-4b5c-8d42-b39a440836a1 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:56.668271 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661a8a7-75af-4b5c-8d42-b39a440836a1 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:56.672275 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eab8cf-b43b-4268-a247-136bb265d1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:56.673409 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eab8cf-b43b-4268-a247-136bb265d1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:56.673702 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eab8cf-b43b-4268-a247-136bb265d1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:56.673983 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eab8cf-b43b-4268-a247-136bb265d1c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:56.674801 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eab8cf-b43b-4268-a247-136bb265d1c7 admin admin] RBAC: Adding query filter params (role.id=aa34949eb3ac4431991f6c257fca79a9, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=8f0dd32880d14ec9990bc09685d26326) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:56.675058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eab8cf-b43b-4268-a247-136bb265d1c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:56.700409 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eab8cf-b43b-4268-a247-136bb265d1c7 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:56.705703 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 294/587] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:23:56 2021] GET /identity/v3/role_assignments?user.id=8f0dd32880d14ec9990bc09685d26326&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=aa34949eb3ac4431991f6c257fca79a9 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:58.617911 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63df4a9-f96f-4741-913c-fcb177950715 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:58.618404 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63df4a9-f96f-4741-913c-fcb177950715 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:58.618484 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63df4a9-f96f-4741-913c-fcb177950715 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:58.620140 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 294/588] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:23:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:23:58.625392 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23310da-b7ba-497c-ad97-68b56573dc9e None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:58.625755 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23310da-b7ba-497c-ad97-68b56573dc9e None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:58.625969 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23310da-b7ba-497c-ad97-68b56573dc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:58.649910 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-e23310da-b7ba-497c-ad97-68b56573dc9e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:23:58.651045 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-e23310da-b7ba-497c-ad97-68b56573dc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:23:58.658395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 295/589] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:23:58 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:23:58.679853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63df4a9-f96f-4741-913c-fcb177950715 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:58.691138 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63df4a9-f96f-4741-913c-fcb177950715 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:58.694952 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d76a9-2a1f-41de-84bd-f8c7929867c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:58.695652 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d76a9-2a1f-41de-84bd-f8c7929867c5 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:58.695943 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d76a9-2a1f-41de-84bd-f8c7929867c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:58.696225 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d76a9-2a1f-41de-84bd-f8c7929867c5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:58.707543 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d76a9-2a1f-41de-84bd-f8c7929867c5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:23:58.713855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-035d76a9-2a1f-41de-84bd-f8c7929867c5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:23:58.714895 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 295/590] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:23:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:58.721090 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23310da-b7ba-497c-ad97-68b56573dc9e None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:58.729378 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23310da-b7ba-497c-ad97-68b56573dc9e None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:58.733346 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d9f1b-805c-446d-a5de-79ee34ae8583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:58.733920 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d9f1b-805c-446d-a5de-79ee34ae8583 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:58.734206 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d9f1b-805c-446d-a5de-79ee34ae8583 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:58.734485 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d9f1b-805c-446d-a5de-79ee34ae8583 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:58.735187 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d9f1b-805c-446d-a5de-79ee34ae8583 admin admin] RBAC: Adding query filter params (name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:58.735484 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d9f1b-805c-446d-a5de-79ee34ae8583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:58.760492 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d9f1b-805c-446d-a5de-79ee34ae8583 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:58.769166 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 296/591] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:23:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:58.774117 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d76a9-2a1f-41de-84bd-f8c7929867c5 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:58.784051 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d76a9-2a1f-41de-84bd-f8c7929867c5 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:58.787916 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce820f-7d4f-45e0-84bb-188bec8457ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:58.788612 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce820f-7d4f-45e0-84bb-188bec8457ad admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:58.788899 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce820f-7d4f-45e0-84bb-188bec8457ad admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:58.789175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce820f-7d4f-45e0-84bb-188bec8457ad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:58.799914 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce820f-7d4f-45e0-84bb-188bec8457ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:58.824960 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce820f-7d4f-45e0-84bb-188bec8457ad admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:58.842657 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-1cce820f-7d4f-45e0-84bb-188bec8457ad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:58.843658 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 296/592] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:23:58.848986 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d9f1b-805c-446d-a5de-79ee34ae8583 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:58.857958 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d9f1b-805c-446d-a5de-79ee34ae8583 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:58.861938 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cc195-f179-4c44-a429-6a1b8483c40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:58.862504 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cc195-f179-4c44-a429-6a1b8483c40d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:58.862794 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cc195-f179-4c44-a429-6a1b8483c40d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:58.863077 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cc195-f179-4c44-a429-6a1b8483c40d admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:58.863754 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cc195-f179-4c44-a429-6a1b8483c40d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:58.864054 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cc195-f179-4c44-a429-6a1b8483c40d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:58.890745 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cc195-f179-4c44-a429-6a1b8483c40d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:58.903295 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 297/593] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:58.908525 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce820f-7d4f-45e0-84bb-188bec8457ad admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:58.917878 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce820f-7d4f-45e0-84bb-188bec8457ad admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:58.921901 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9fbcc-5d3e-4e0a-a0f1-4ad8096858bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:58.922614 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9fbcc-5d3e-4e0a-a0f1-4ad8096858bd admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:58.922958 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9fbcc-5d3e-4e0a-a0f1-4ad8096858bd admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:58.923240 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9fbcc-5d3e-4e0a-a0f1-4ad8096858bd admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:58.936056 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9fbcc-5d3e-4e0a-a0f1-4ad8096858bd admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:58.961682 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9fbcc-5d3e-4e0a-a0f1-4ad8096858bd admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:58.979475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-d0e9fbcc-5d3e-4e0a-a0f1-4ad8096858bd admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 01:23:58.980518 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 297/594] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Aug 23 01:23:58 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:23:58.985886 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cc195-f179-4c44-a429-6a1b8483c40d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:58.995164 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cc195-f179-4c44-a429-6a1b8483c40d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:58.999734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313fd23-1a01-4da8-be73-b3d6545d545a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:59.000358 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313fd23-1a01-4da8-be73-b3d6545d545a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:59.000677 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313fd23-1a01-4da8-be73-b3d6545d545a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:59.000962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313fd23-1a01-4da8-be73-b3d6545d545a admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:59.001747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313fd23-1a01-4da8-be73-b3d6545d545a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:59.002049 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313fd23-1a01-4da8-be73-b3d6545d545a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:59.028142 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313fd23-1a01-4da8-be73-b3d6545d545a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:59.056473 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 298/595] 10.222.0.20 () {56 vars in 1171 bytes} [Mon Aug 23 01:23:58 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:59.062405 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9fbcc-5d3e-4e0a-a0f1-4ad8096858bd admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:59.071675 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9fbcc-5d3e-4e0a-a0f1-4ad8096858bd admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:59.075572 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e34b6-0ddb-4fd3-a5de-f301d58a9c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:59.076940 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e34b6-0ddb-4fd3-a5de-f301d58a9c02 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:59.077263 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e34b6-0ddb-4fd3-a5de-f301d58a9c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:59.077540 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e34b6-0ddb-4fd3-a5de-f301d58a9c02 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:59.089368 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e34b6-0ddb-4fd3-a5de-f301d58a9c02 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:59.114354 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e34b6-0ddb-4fd3-a5de-f301d58a9c02 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:59.130880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-f64e34b6-0ddb-4fd3-a5de-f301d58a9c02 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:23:59.131919 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 298/596] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:23:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:59.137263 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313fd23-1a01-4da8-be73-b3d6545d545a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:59.146907 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313fd23-1a01-4da8-be73-b3d6545d545a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:59.150826 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433698c-a2ba-4b02-85d8-497713e1eb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:59.151396 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433698c-a2ba-4b02-85d8-497713e1eb80 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:59.151680 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433698c-a2ba-4b02-85d8-497713e1eb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:59.151958 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433698c-a2ba-4b02-85d8-497713e1eb80 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:59.152666 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433698c-a2ba-4b02-85d8-497713e1eb80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:59.152962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433698c-a2ba-4b02-85d8-497713e1eb80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:59.177776 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433698c-a2ba-4b02-85d8-497713e1eb80 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:59.189849 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 299/597] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:23:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:23:59.194692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e34b6-0ddb-4fd3-a5de-f301d58a9c02 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:59.204321 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e34b6-0ddb-4fd3-a5de-f301d58a9c02 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:59.208018 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec0ba4-0675-4fcf-bc36-d3708778de8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:59.208747 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec0ba4-0675-4fcf-bc36-d3708778de8e admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:59.209031 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec0ba4-0675-4fcf-bc36-d3708778de8e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:59.209308 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec0ba4-0675-4fcf-bc36-d3708778de8e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:59.218327 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec0ba4-0675-4fcf-bc36-d3708778de8e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:59.244197 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec0ba4-0675-4fcf-bc36-d3708778de8e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:59.258909 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-dbec0ba4-0675-4fcf-bc36-d3708778de8e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:23:59.264634 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 299/598] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:23:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:23:59.265915 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433698c-a2ba-4b02-85d8-497713e1eb80 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:59.275121 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433698c-a2ba-4b02-85d8-497713e1eb80 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:59.279045 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a097d-89a1-44a9-9b08-a32fb29aea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:59.279645 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a097d-89a1-44a9-9b08-a32fb29aea24 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:59.279930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a097d-89a1-44a9-9b08-a32fb29aea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:59.280210 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a097d-89a1-44a9-9b08-a32fb29aea24 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:59.280973 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a097d-89a1-44a9-9b08-a32fb29aea24 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:23:59.281280 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a097d-89a1-44a9-9b08-a32fb29aea24 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:59.307048 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a097d-89a1-44a9-9b08-a32fb29aea24 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:59.321192 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 300/599] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:23:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:23:59.326801 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec0ba4-0675-4fcf-bc36-d3708778de8e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:23:59.342818 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec0ba4-0675-4fcf-bc36-d3708778de8e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:23:59.346989 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b859b1c-48e7-4899-93fe-cebf87bc787b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:23:59.347789 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b859b1c-48e7-4899-93fe-cebf87bc787b admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:23:59.348072 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b859b1c-48e7-4899-93fe-cebf87bc787b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:23:59.348345 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b859b1c-48e7-4899-93fe-cebf87bc787b admin admin] PATH_INFO: `/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/8f0dd32880d14ec9990bc09685d26326/roles/aa34949eb3ac4431991f6c257fca79a9` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:23:59.369494 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b859b1c-48e7-4899-93fe-cebf87bc787b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2728fddda1c4691b33daad4fa4ef3d2, user_id=8f0dd32880d14ec9990bc09685d26326, role_id=aa34949eb3ac4431991f6c257fca79a9)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:23:59.396682 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b859b1c-48e7-4899-93fe-cebf87bc787b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:23:59.467676 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 300/600] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:23:59 2021] PUT /identity/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/8f0dd32880d14ec9990bc09685d26326/roles/aa34949eb3ac4431991f6c257fca79a9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:24:01.392704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193382f4-b9db-4f62-a28c-1c239363b139 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:01.393221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193382f4-b9db-4f62-a28c-1c239363b139 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:01.393310 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193382f4-b9db-4f62-a28c-1c239363b139 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:01.394987 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 301/601] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:01.400010 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fcaf0-8061-45e7-aba8-025deb4b4837 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:01.400381 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fcaf0-8061-45e7-aba8-025deb4b4837 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:01.400583 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fcaf0-8061-45e7-aba8-025deb4b4837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:01.422223 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-6f6fcaf0-8061-45e7-aba8-025deb4b4837 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:01.423343 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-6f6fcaf0-8061-45e7-aba8-025deb4b4837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:01.486403 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 301/602] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:01 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:01.509274 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193382f4-b9db-4f62-a28c-1c239363b139 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:01.520613 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193382f4-b9db-4f62-a28c-1c239363b139 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:01.524430 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76fc42-5ac2-4ca9-884b-d9deefdd947a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:01.525180 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76fc42-5ac2-4ca9-884b-d9deefdd947a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:01.525472 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76fc42-5ac2-4ca9-884b-d9deefdd947a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:01.525755 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76fc42-5ac2-4ca9-884b-d9deefdd947a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:01.536701 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76fc42-5ac2-4ca9-884b-d9deefdd947a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:24:01.543010 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-cc76fc42-5ac2-4ca9-884b-d9deefdd947a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:24:01.544062 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 302/603] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:24:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:01.549747 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fcaf0-8061-45e7-aba8-025deb4b4837 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:01.557978 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fcaf0-8061-45e7-aba8-025deb4b4837 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:01.562469 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed119f2-6214-4607-8aab-a736d37aefd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:01.563047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed119f2-6214-4607-8aab-a736d37aefd0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:01.563340 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed119f2-6214-4607-8aab-a736d37aefd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:01.563622 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed119f2-6214-4607-8aab-a736d37aefd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:01.564320 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed119f2-6214-4607-8aab-a736d37aefd0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:01.564652 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed119f2-6214-4607-8aab-a736d37aefd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:01.589495 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed119f2-6214-4607-8aab-a736d37aefd0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:01.597852 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 302/604] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:24:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:01.602997 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76fc42-5ac2-4ca9-884b-d9deefdd947a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:01.612910 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76fc42-5ac2-4ca9-884b-d9deefdd947a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:01.616885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dc529-2982-4296-93b6-32a61a30d05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:01.617563 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dc529-2982-4296-93b6-32a61a30d05a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:01.617848 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dc529-2982-4296-93b6-32a61a30d05a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:01.618127 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dc529-2982-4296-93b6-32a61a30d05a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:01.629492 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40dc529-2982-4296-93b6-32a61a30d05a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:01.654732 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40dc529-2982-4296-93b6-32a61a30d05a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:01.671998 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-a40dc529-2982-4296-93b6-32a61a30d05a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:24:01.673059 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 303/605] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:24:01.678806 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed119f2-6214-4607-8aab-a736d37aefd0 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:01.688287 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed119f2-6214-4607-8aab-a736d37aefd0 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:01.692177 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91ce05-72e5-4bc9-aa67-85ce98bd432e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:01.692773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91ce05-72e5-4bc9-aa67-85ce98bd432e admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:01.693059 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91ce05-72e5-4bc9-aa67-85ce98bd432e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:01.693332 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91ce05-72e5-4bc9-aa67-85ce98bd432e admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:01.693994 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91ce05-72e5-4bc9-aa67-85ce98bd432e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:01.694286 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91ce05-72e5-4bc9-aa67-85ce98bd432e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:01.719162 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91ce05-72e5-4bc9-aa67-85ce98bd432e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:01.731433 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 303/606] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:24:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:01.736970 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dc529-2982-4296-93b6-32a61a30d05a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:01.745824 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dc529-2982-4296-93b6-32a61a30d05a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:01.750299 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63fea6-7c0d-4e88-b613-156245af2f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:01.750995 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63fea6-7c0d-4e88-b613-156245af2f2b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:01.751281 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63fea6-7c0d-4e88-b613-156245af2f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:01.751559 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63fea6-7c0d-4e88-b613-156245af2f2b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:01.763746 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63fea6-7c0d-4e88-b613-156245af2f2b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:01.789058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63fea6-7c0d-4e88-b613-156245af2f2b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:01.806804 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-2d63fea6-7c0d-4e88-b613-156245af2f2b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 01:24:01.807815 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 304/607] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Aug 23 01:24:01 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:24:01.813600 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91ce05-72e5-4bc9-aa67-85ce98bd432e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:01.822631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91ce05-72e5-4bc9-aa67-85ce98bd432e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:01.826554 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461c156-f10a-4887-969a-8f71f3ae5379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:01.827119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461c156-f10a-4887-969a-8f71f3ae5379 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:01.827401 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461c156-f10a-4887-969a-8f71f3ae5379 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:01.827678 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461c156-f10a-4887-969a-8f71f3ae5379 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:01.828437 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461c156-f10a-4887-969a-8f71f3ae5379 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:01.828770 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461c156-f10a-4887-969a-8f71f3ae5379 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:01.854781 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461c156-f10a-4887-969a-8f71f3ae5379 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:01.883110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 304/608] 10.222.0.20 () {56 vars in 1171 bytes} [Mon Aug 23 01:24:01 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:01.888146 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63fea6-7c0d-4e88-b613-156245af2f2b admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:01.897137 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63fea6-7c0d-4e88-b613-156245af2f2b admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:01.901119 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04175a9-a0cf-4d82-bca9-829e7eaec5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:01.901671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04175a9-a0cf-4d82-bca9-829e7eaec5fa admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:01.901959 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04175a9-a0cf-4d82-bca9-829e7eaec5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:01.902239 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04175a9-a0cf-4d82-bca9-829e7eaec5fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:01.910409 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04175a9-a0cf-4d82-bca9-829e7eaec5fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:01.936317 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04175a9-a0cf-4d82-bca9-829e7eaec5fa admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:01.944729 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 305/609] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:24:01 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:24:01.949938 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461c156-f10a-4887-969a-8f71f3ae5379 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:01.958938 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461c156-f10a-4887-969a-8f71f3ae5379 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:01.962839 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b98815-39b4-456d-b4d9-17228cca5855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:01.963532 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b98815-39b4-456d-b4d9-17228cca5855 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:01.963815 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b98815-39b4-456d-b4d9-17228cca5855 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:01.964094 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b98815-39b4-456d-b4d9-17228cca5855 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:01.975972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b98815-39b4-456d-b4d9-17228cca5855 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:02.001500 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b98815-39b4-456d-b4d9-17228cca5855 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:02.017563 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-22b98815-39b4-456d-b4d9-17228cca5855 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:24:02.018603 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 305/610] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:02.023962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04175a9-a0cf-4d82-bca9-829e7eaec5fa admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:02.033021 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04175a9-a0cf-4d82-bca9-829e7eaec5fa admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:02.037034 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90b9ec-09f4-401a-8ddc-1130af3aab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:02.037610 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90b9ec-09f4-401a-8ddc-1130af3aab89 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:02.037900 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90b9ec-09f4-401a-8ddc-1130af3aab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:02.038182 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90b9ec-09f4-401a-8ddc-1130af3aab89 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:02.038859 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90b9ec-09f4-401a-8ddc-1130af3aab89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:02.039157 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90b9ec-09f4-401a-8ddc-1130af3aab89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:02.064612 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90b9ec-09f4-401a-8ddc-1130af3aab89 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:02.077185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 306/611] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:24:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:02.082143 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b98815-39b4-456d-b4d9-17228cca5855 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:02.091240 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b98815-39b4-456d-b4d9-17228cca5855 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:02.095831 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21788d-bef0-4333-9b89-f655da2ac42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:02.096516 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21788d-bef0-4333-9b89-f655da2ac42a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:02.096822 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21788d-bef0-4333-9b89-f655da2ac42a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:02.097094 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21788d-bef0-4333-9b89-f655da2ac42a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:02.105585 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21788d-bef0-4333-9b89-f655da2ac42a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:02.131443 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21788d-bef0-4333-9b89-f655da2ac42a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:02.144410 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-9c21788d-bef0-4333-9b89-f655da2ac42a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:24:02.145434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 306/612] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:24:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:02.150560 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90b9ec-09f4-401a-8ddc-1130af3aab89 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:02.159954 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90b9ec-09f4-401a-8ddc-1130af3aab89 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:02.163949 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e249cb-5032-421f-af92-615efcdd70fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:02.164457 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e249cb-5032-421f-af92-615efcdd70fc admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:02.164772 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e249cb-5032-421f-af92-615efcdd70fc admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:02.165057 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e249cb-5032-421f-af92-615efcdd70fc admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:02.165808 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e249cb-5032-421f-af92-615efcdd70fc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:02.166108 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e249cb-5032-421f-af92-615efcdd70fc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:02.191784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e249cb-5032-421f-af92-615efcdd70fc admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:02.204294 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 307/613] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:24:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:02.209706 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21788d-bef0-4333-9b89-f655da2ac42a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:02.219083 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21788d-bef0-4333-9b89-f655da2ac42a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:02.223285 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0aa25-5133-41dd-b897-5df74d0671c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:02.223846 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0aa25-5133-41dd-b897-5df74d0671c1 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:02.224135 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0aa25-5133-41dd-b897-5df74d0671c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:02.224417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0aa25-5133-41dd-b897-5df74d0671c1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:02.225219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0aa25-5133-41dd-b897-5df74d0671c1 admin admin] RBAC: Adding query filter params (role.id=aa34949eb3ac4431991f6c257fca79a9, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=8f0dd32880d14ec9990bc09685d26326) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:02.225526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0aa25-5133-41dd-b897-5df74d0671c1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:02.251211 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0aa25-5133-41dd-b897-5df74d0671c1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:02.256733 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 307/614] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:24:02 2021] GET /identity/v3/role_assignments?user.id=8f0dd32880d14ec9990bc09685d26326&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=aa34949eb3ac4431991f6c257fca79a9 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:04.228448 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687ec7f-ec63-47fb-876d-2b3016cf0d9e None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:04.228998 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687ec7f-ec63-47fb-876d-2b3016cf0d9e None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:04.229081 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687ec7f-ec63-47fb-876d-2b3016cf0d9e None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:04.230747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 308/615] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:04.235907 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a636ec4-7184-4b5e-bf9b-135b102e1d9e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:04.236298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a636ec4-7184-4b5e-bf9b-135b102e1d9e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:04.236475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a636ec4-7184-4b5e-bf9b-135b102e1d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:04.259028 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-0a636ec4-7184-4b5e-bf9b-135b102e1d9e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:04.260158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0a636ec4-7184-4b5e-bf9b-135b102e1d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:04.267385 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 308/616] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:04 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:04.289490 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687ec7f-ec63-47fb-876d-2b3016cf0d9e None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:04.300861 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687ec7f-ec63-47fb-876d-2b3016cf0d9e None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:04.304721 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d934f-3b60-4d28-86b0-de05b33ec381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:04.305435 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d934f-3b60-4d28-86b0-de05b33ec381 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:04.305725 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d934f-3b60-4d28-86b0-de05b33ec381 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:04.306008 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d934f-3b60-4d28-86b0-de05b33ec381 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:04.317472 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d934f-3b60-4d28-86b0-de05b33ec381 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:24:04.324125 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-af9d934f-3b60-4d28-86b0-de05b33ec381 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 01:24:04.325198 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 309/617] 10.222.0.20 () {56 vars in 1142 bytes} [Mon Aug 23 01:24:04 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:04.331136 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a636ec4-7184-4b5e-bf9b-135b102e1d9e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:04.339362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a636ec4-7184-4b5e-bf9b-135b102e1d9e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:04.343271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119dff1c-3e16-4e86-a044-fb846af77831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:04.343843 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dff1c-3e16-4e86-a044-fb846af77831 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:04.344132 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dff1c-3e16-4e86-a044-fb846af77831 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:04.344412 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dff1c-3e16-4e86-a044-fb846af77831 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:04.345150 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119dff1c-3e16-4e86-a044-fb846af77831 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:04.345702 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119dff1c-3e16-4e86-a044-fb846af77831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:04.370415 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119dff1c-3e16-4e86-a044-fb846af77831 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:04.378969 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 309/618] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Aug 23 01:24:04 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:04.384362 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d934f-3b60-4d28-86b0-de05b33ec381 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:04.394326 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d934f-3b60-4d28-86b0-de05b33ec381 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:04.398266 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce5eef-785a-4a90-befa-8765b097cb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:04.398951 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce5eef-785a-4a90-befa-8765b097cb26 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:04.399235 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce5eef-785a-4a90-befa-8765b097cb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:04.399514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce5eef-785a-4a90-befa-8765b097cb26 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:04.410453 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce5eef-785a-4a90-befa-8765b097cb26 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:04.436024 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce5eef-785a-4a90-befa-8765b097cb26 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:04.453822 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-7fce5eef-785a-4a90-befa-8765b097cb26 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:24:04.454855 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 310/619] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:24:04.460149 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119dff1c-3e16-4e86-a044-fb846af77831 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:04.469212 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119dff1c-3e16-4e86-a044-fb846af77831 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:04.473381 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c96a97-2cdf-4adb-9a1a-2c8f0a947c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:04.473951 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c96a97-2cdf-4adb-9a1a-2c8f0a947c14 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:04.474238 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c96a97-2cdf-4adb-9a1a-2c8f0a947c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:04.474519 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c96a97-2cdf-4adb-9a1a-2c8f0a947c14 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:04.475191 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c96a97-2cdf-4adb-9a1a-2c8f0a947c14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:04.475489 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c96a97-2cdf-4adb-9a1a-2c8f0a947c14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:04.502685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c96a97-2cdf-4adb-9a1a-2c8f0a947c14 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:04.517176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 310/620] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:24:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:04.522474 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce5eef-785a-4a90-befa-8765b097cb26 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:04.531482 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce5eef-785a-4a90-befa-8765b097cb26 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:04.535377 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9deb54-628f-44f2-8629-98d6e127761d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:04.536089 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9deb54-628f-44f2-8629-98d6e127761d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:04.536372 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9deb54-628f-44f2-8629-98d6e127761d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:04.536678 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9deb54-628f-44f2-8629-98d6e127761d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:04.551139 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9deb54-628f-44f2-8629-98d6e127761d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:04.576975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9deb54-628f-44f2-8629-98d6e127761d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:04.594134 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-6f9deb54-628f-44f2-8629-98d6e127761d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 01:24:04.595155 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 311/621] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Aug 23 01:24:04 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:04.601084 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c96a97-2cdf-4adb-9a1a-2c8f0a947c14 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:04.610754 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c96a97-2cdf-4adb-9a1a-2c8f0a947c14 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:04.614748 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0186d3-bce0-415d-aa2d-754aeaced6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:04.615335 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0186d3-bce0-415d-aa2d-754aeaced6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:04.615625 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0186d3-bce0-415d-aa2d-754aeaced6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:04.615906 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0186d3-bce0-415d-aa2d-754aeaced6a1 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:04.616725 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0186d3-bce0-415d-aa2d-754aeaced6a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:04.617029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0186d3-bce0-415d-aa2d-754aeaced6a1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:04.643040 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0186d3-bce0-415d-aa2d-754aeaced6a1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:04.671344 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 311/622] 10.222.0.20 () {56 vars in 1171 bytes} [Mon Aug 23 01:24:04 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:24:04.676509 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9deb54-628f-44f2-8629-98d6e127761d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:04.686435 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9deb54-628f-44f2-8629-98d6e127761d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:04.690347 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ae969-5178-46f0-8fa0-487d6e86b453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:04.690897 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ae969-5178-46f0-8fa0-487d6e86b453 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:04.691182 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ae969-5178-46f0-8fa0-487d6e86b453 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:04.691458 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ae969-5178-46f0-8fa0-487d6e86b453 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:04.698792 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ae969-5178-46f0-8fa0-487d6e86b453 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:04.723864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ae969-5178-46f0-8fa0-487d6e86b453 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:04.731928 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 312/623] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:24:04 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:24:04.737412 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0186d3-bce0-415d-aa2d-754aeaced6a1 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:04.746274 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0186d3-bce0-415d-aa2d-754aeaced6a1 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:04.750809 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e379f7-801e-483e-8597-aee3b2df128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:04.751508 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e379f7-801e-483e-8597-aee3b2df128c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:04.751797 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e379f7-801e-483e-8597-aee3b2df128c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:04.752080 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e379f7-801e-483e-8597-aee3b2df128c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:04.763289 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e379f7-801e-483e-8597-aee3b2df128c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:04.788389 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e379f7-801e-483e-8597-aee3b2df128c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:04.805292 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-c5e379f7-801e-483e-8597-aee3b2df128c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:24:04.806362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 312/624] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:04.812196 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ae969-5178-46f0-8fa0-487d6e86b453 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:04.820637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ae969-5178-46f0-8fa0-487d6e86b453 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:04.824621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52303f-60d8-4360-b883-066db450f6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:04.825186 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52303f-60d8-4360-b883-066db450f6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:04.825470 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52303f-60d8-4360-b883-066db450f6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:04.825745 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52303f-60d8-4360-b883-066db450f6c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:04.826411 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52303f-60d8-4360-b883-066db450f6c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:04.826703 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52303f-60d8-4360-b883-066db450f6c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:04.852903 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52303f-60d8-4360-b883-066db450f6c7 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:04.865883 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 313/625] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:24:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:04.870926 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e379f7-801e-483e-8597-aee3b2df128c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:04.880031 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e379f7-801e-483e-8597-aee3b2df128c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:04.883938 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e9a46-a49a-4955-817a-e68125ce4755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:04.884663 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e9a46-a49a-4955-817a-e68125ce4755 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:04.884975 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e9a46-a49a-4955-817a-e68125ce4755 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:04.889651 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e9a46-a49a-4955-817a-e68125ce4755 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:04.895604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e9a46-a49a-4955-817a-e68125ce4755 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:04.922176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e9a46-a49a-4955-817a-e68125ce4755 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:04.935703 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-f21e9a46-a49a-4955-817a-e68125ce4755 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:24:04.936768 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 313/626] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:24:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:04.942255 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52303f-60d8-4360-b883-066db450f6c7 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:04.951529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52303f-60d8-4360-b883-066db450f6c7 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:04.955495 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9022e87-254e-4693-ad14-d3062e939530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:04.956057 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9022e87-254e-4693-ad14-d3062e939530 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:04.956339 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9022e87-254e-4693-ad14-d3062e939530 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:04.956649 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9022e87-254e-4693-ad14-d3062e939530 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:04.957378 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9022e87-254e-4693-ad14-d3062e939530 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:04.957708 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9022e87-254e-4693-ad14-d3062e939530 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:04.984163 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9022e87-254e-4693-ad14-d3062e939530 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:04.996687 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 314/627] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:24:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:05.002132 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e9a46-a49a-4955-817a-e68125ce4755 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:05.011148 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e9a46-a49a-4955-817a-e68125ce4755 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:05.015073 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688564fd-39e1-4366-9c43-3eba824fb30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:05.015581 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688564fd-39e1-4366-9c43-3eba824fb30a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:05.015869 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688564fd-39e1-4366-9c43-3eba824fb30a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:05.016150 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688564fd-39e1-4366-9c43-3eba824fb30a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:05.016943 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688564fd-39e1-4366-9c43-3eba824fb30a admin admin] RBAC: Adding query filter params (role.id=4b08bc68a548443bab31d6b110aa5c96, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=8f0dd32880d14ec9990bc09685d26326) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:05.017246 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688564fd-39e1-4366-9c43-3eba824fb30a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:05.042932 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688564fd-39e1-4366-9c43-3eba824fb30a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:05.048508 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 314/628] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:24:05 2021] GET /identity/v3/role_assignments?user.id=8f0dd32880d14ec9990bc09685d26326&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=4b08bc68a548443bab31d6b110aa5c96 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:06.942221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700149e-d0f0-42a6-a460-4b4166b3669b None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:06.942720 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700149e-d0f0-42a6-a460-4b4166b3669b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:06.942802 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700149e-d0f0-42a6-a460-4b4166b3669b None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:06.944428 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 315/629] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:06.949498 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c73dc-27ec-44d6-b8fc-7572006cf745 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:06.949914 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c73dc-27ec-44d6-b8fc-7572006cf745 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:06.950065 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c73dc-27ec-44d6-b8fc-7572006cf745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:06.973204 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-5c9c73dc-27ec-44d6-b8fc-7572006cf745 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:06.974334 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-5c9c73dc-27ec-44d6-b8fc-7572006cf745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:06.980873 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 315/630] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:06 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:07.001627 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700149e-d0f0-42a6-a460-4b4166b3669b None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:07.012966 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700149e-d0f0-42a6-a460-4b4166b3669b None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:07.017283 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a287d6-7c15-4909-bcc6-a32e0a1607a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:07.017990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a287d6-7c15-4909-bcc6-a32e0a1607a5 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:07.018274 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a287d6-7c15-4909-bcc6-a32e0a1607a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:07.018547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a287d6-7c15-4909-bcc6-a32e0a1607a5 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:07.029858 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a287d6-7c15-4909-bcc6-a32e0a1607a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:24:07.036406 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-91a287d6-7c15-4909-bcc6-a32e0a1607a5 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 01:24:07.037473 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 316/631] 10.222.0.20 () {56 vars in 1142 bytes} [Mon Aug 23 01:24:07 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:07.042783 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c73dc-27ec-44d6-b8fc-7572006cf745 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:07.051071 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c73dc-27ec-44d6-b8fc-7572006cf745 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:07.054946 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfbe35-7ff5-463e-8990-e06b78c0aced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:07.055524 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfbe35-7ff5-463e-8990-e06b78c0aced admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:07.055811 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfbe35-7ff5-463e-8990-e06b78c0aced admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:07.056091 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfbe35-7ff5-463e-8990-e06b78c0aced admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:07.056820 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbfbe35-7ff5-463e-8990-e06b78c0aced admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:07.057118 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbfbe35-7ff5-463e-8990-e06b78c0aced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:07.082351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbfbe35-7ff5-463e-8990-e06b78c0aced admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:07.090338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 316/632] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Aug 23 01:24:07 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:07.096189 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a287d6-7c15-4909-bcc6-a32e0a1607a5 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:07.105593 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a287d6-7c15-4909-bcc6-a32e0a1607a5 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:07.109538 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fc841-50b4-4c1c-9812-6a7ebf23c3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:07.110218 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fc841-50b4-4c1c-9812-6a7ebf23c3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:07.110504 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fc841-50b4-4c1c-9812-6a7ebf23c3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:07.110783 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fc841-50b4-4c1c-9812-6a7ebf23c3a2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:07.121599 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fc841-50b4-4c1c-9812-6a7ebf23c3a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:07.147790 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fc841-50b4-4c1c-9812-6a7ebf23c3a2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:07.164679 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-213fc841-50b4-4c1c-9812-6a7ebf23c3a2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:24:07.165698 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 317/633] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:07.170670 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfbe35-7ff5-463e-8990-e06b78c0aced admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:07.179452 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfbe35-7ff5-463e-8990-e06b78c0aced admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:07.183545 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd083aa-04fe-41dd-aa4d-86baede9a9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:07.184121 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd083aa-04fe-41dd-aa4d-86baede9a9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:07.184407 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd083aa-04fe-41dd-aa4d-86baede9a9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:07.184722 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd083aa-04fe-41dd-aa4d-86baede9a9a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:07.185884 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd083aa-04fe-41dd-aa4d-86baede9a9a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:07.186177 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd083aa-04fe-41dd-aa4d-86baede9a9a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:07.211450 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd083aa-04fe-41dd-aa4d-86baede9a9a9 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:07.223955 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 317/634] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:24:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:07.228950 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fc841-50b4-4c1c-9812-6a7ebf23c3a2 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:07.237778 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fc841-50b4-4c1c-9812-6a7ebf23c3a2 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:07.241734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c6ba0-eedd-4442-83a6-a36ce3dfd155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:07.242428 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c6ba0-eedd-4442-83a6-a36ce3dfd155 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:07.242717 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c6ba0-eedd-4442-83a6-a36ce3dfd155 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:07.242997 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c6ba0-eedd-4442-83a6-a36ce3dfd155 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:07.255732 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c6ba0-eedd-4442-83a6-a36ce3dfd155 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:07.281630 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c6ba0-eedd-4442-83a6-a36ce3dfd155 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:07.298983 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-714c6ba0-eedd-4442-83a6-a36ce3dfd155 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 01:24:07.299993 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 318/635] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Aug 23 01:24:07 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:24:07.304977 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd083aa-04fe-41dd-aa4d-86baede9a9a9 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:07.314322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd083aa-04fe-41dd-aa4d-86baede9a9a9 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:07.318233 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b381040-5610-4498-9497-1388d57a44d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:07.318801 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b381040-5610-4498-9497-1388d57a44d7 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:07.319086 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b381040-5610-4498-9497-1388d57a44d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:07.319360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b381040-5610-4498-9497-1388d57a44d7 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:07.320126 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b381040-5610-4498-9497-1388d57a44d7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:07.320423 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b381040-5610-4498-9497-1388d57a44d7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:07.346101 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b381040-5610-4498-9497-1388d57a44d7 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:07.375446 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 318/636] 10.222.0.20 () {56 vars in 1171 bytes} [Mon Aug 23 01:24:07 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:07.380482 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c6ba0-eedd-4442-83a6-a36ce3dfd155 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:07.390098 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c6ba0-eedd-4442-83a6-a36ce3dfd155 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:07.393980 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d424a9-76e4-4699-b65a-e675df69a87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:07.394669 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d424a9-76e4-4699-b65a-e675df69a87a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:07.394953 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d424a9-76e4-4699-b65a-e675df69a87a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:07.395232 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d424a9-76e4-4699-b65a-e675df69a87a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:07.407075 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d424a9-76e4-4699-b65a-e675df69a87a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:07.432133 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d424a9-76e4-4699-b65a-e675df69a87a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:07.448807 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-f6d424a9-76e4-4699-b65a-e675df69a87a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:24:07.449844 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 319/637] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:07.455128 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b381040-5610-4498-9497-1388d57a44d7 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:07.464228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b381040-5610-4498-9497-1388d57a44d7 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:07.468627 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b9777-501b-44ab-a797-eda9fe63e797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:07.469202 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b9777-501b-44ab-a797-eda9fe63e797 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:07.469486 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b9777-501b-44ab-a797-eda9fe63e797 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:07.469762 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b9777-501b-44ab-a797-eda9fe63e797 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:07.470683 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b9777-501b-44ab-a797-eda9fe63e797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:07.470973 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b9777-501b-44ab-a797-eda9fe63e797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:07.496508 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b9777-501b-44ab-a797-eda9fe63e797 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:07.508073 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 319/638] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:24:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:07.512919 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d424a9-76e4-4699-b65a-e675df69a87a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:07.522332 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d424a9-76e4-4699-b65a-e675df69a87a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:07.526260 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684ef18-ef25-42f4-8a6a-21eb7844bd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:07.526948 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684ef18-ef25-42f4-8a6a-21eb7844bd3a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:07.527233 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684ef18-ef25-42f4-8a6a-21eb7844bd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:07.527508 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684ef18-ef25-42f4-8a6a-21eb7844bd3a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:07.536706 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684ef18-ef25-42f4-8a6a-21eb7844bd3a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:07.561817 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684ef18-ef25-42f4-8a6a-21eb7844bd3a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:07.574806 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-8684ef18-ef25-42f4-8a6a-21eb7844bd3a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:24:07.576335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 320/639] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:24:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:07.581317 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b9777-501b-44ab-a797-eda9fe63e797 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:07.590179 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b9777-501b-44ab-a797-eda9fe63e797 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:07.594732 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a9829-50c8-49c0-bca2-2100d90cf0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:07.595541 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a9829-50c8-49c0-bca2-2100d90cf0fb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:07.595825 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a9829-50c8-49c0-bca2-2100d90cf0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:07.596100 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a9829-50c8-49c0-bca2-2100d90cf0fb admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:07.596860 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a9829-50c8-49c0-bca2-2100d90cf0fb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:07.597159 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a9829-50c8-49c0-bca2-2100d90cf0fb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:07.622189 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a9829-50c8-49c0-bca2-2100d90cf0fb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:07.634625 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 320/640] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:24:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:24:07.640380 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684ef18-ef25-42f4-8a6a-21eb7844bd3a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:07.649219 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684ef18-ef25-42f4-8a6a-21eb7844bd3a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:07.653116 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0fdc5-59f4-4c4c-8672-062b427c8fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:07.653970 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0fdc5-59f4-4c4c-8672-062b427c8fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:07.654257 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0fdc5-59f4-4c4c-8672-062b427c8fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:07.654537 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0fdc5-59f4-4c4c-8672-062b427c8fbe admin admin] PATH_INFO: `/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/8f0dd32880d14ec9990bc09685d26326/roles/4b08bc68a548443bab31d6b110aa5c96` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:07.656448 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0fdc5-59f4-4c4c-8672-062b427c8fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2728fddda1c4691b33daad4fa4ef3d2, user_id=8f0dd32880d14ec9990bc09685d26326, role_id=4b08bc68a548443bab31d6b110aa5c96)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:07.682977 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0fdc5-59f4-4c4c-8672-062b427c8fbe admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:07.746511 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 321/641] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:24:07 2021] PUT /identity/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/8f0dd32880d14ec9990bc09685d26326/roles/4b08bc68a548443bab31d6b110aa5c96 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:24:09.652875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e0677-dbc5-49f1-81ba-31e59ef86748 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:09.653377 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e0677-dbc5-49f1-81ba-31e59ef86748 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:09.653462 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e0677-dbc5-49f1-81ba-31e59ef86748 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:09.655590 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 321/642] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:09.660596 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c99af8-eaeb-43be-87c7-73cebc059dd0 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:09.660989 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c99af8-eaeb-43be-87c7-73cebc059dd0 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:09.661157 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c99af8-eaeb-43be-87c7-73cebc059dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:09.683832 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-57c99af8-eaeb-43be-87c7-73cebc059dd0 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:09.684935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-57c99af8-eaeb-43be-87c7-73cebc059dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:09.746479 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 322/643] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:09 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:09.768827 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e0677-dbc5-49f1-81ba-31e59ef86748 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:09.780659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e0677-dbc5-49f1-81ba-31e59ef86748 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:09.784434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051c5ab-a9a1-47e1-bfe2-0765749e7e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:09.785176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051c5ab-a9a1-47e1-bfe2-0765749e7e98 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:09.785461 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051c5ab-a9a1-47e1-bfe2-0765749e7e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:09.785739 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051c5ab-a9a1-47e1-bfe2-0765749e7e98 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:09.796494 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051c5ab-a9a1-47e1-bfe2-0765749e7e98 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:24:09.803187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-8051c5ab-a9a1-47e1-bfe2-0765749e7e98 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 01:24:09.804230 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 322/644] 10.222.0.20 () {56 vars in 1142 bytes} [Mon Aug 23 01:24:09 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:09.809465 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c99af8-eaeb-43be-87c7-73cebc059dd0 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:09.817772 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c99af8-eaeb-43be-87c7-73cebc059dd0 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:09.821711 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b650360-9540-4942-ae7d-b6f46041c93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:09.822286 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b650360-9540-4942-ae7d-b6f46041c93a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:09.822575 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b650360-9540-4942-ae7d-b6f46041c93a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:09.822861 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b650360-9540-4942-ae7d-b6f46041c93a admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:09.823562 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b650360-9540-4942-ae7d-b6f46041c93a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:09.823860 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b650360-9540-4942-ae7d-b6f46041c93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:09.850149 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b650360-9540-4942-ae7d-b6f46041c93a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:09.858239 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 323/645] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Aug 23 01:24:09 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:09.863335 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051c5ab-a9a1-47e1-bfe2-0765749e7e98 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:09.872718 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051c5ab-a9a1-47e1-bfe2-0765749e7e98 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:09.876630 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3576a5-2a19-4651-a146-e7263d6f88b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:09.877310 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3576a5-2a19-4651-a146-e7263d6f88b0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:09.877596 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3576a5-2a19-4651-a146-e7263d6f88b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:09.877875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3576a5-2a19-4651-a146-e7263d6f88b0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:09.889162 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3576a5-2a19-4651-a146-e7263d6f88b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:09.914210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3576a5-2a19-4651-a146-e7263d6f88b0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:09.931312 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-bf3576a5-2a19-4651-a146-e7263d6f88b0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:24:09.932333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 323/646] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:09.938026 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b650360-9540-4942-ae7d-b6f46041c93a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:09.946794 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b650360-9540-4942-ae7d-b6f46041c93a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:09.950780 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f4d0b-5b6b-42ca-8967-7ca4560eb560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:09.951341 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f4d0b-5b6b-42ca-8967-7ca4560eb560 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:09.951632 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f4d0b-5b6b-42ca-8967-7ca4560eb560 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:09.951914 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f4d0b-5b6b-42ca-8967-7ca4560eb560 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:09.952612 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f4d0b-5b6b-42ca-8967-7ca4560eb560 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:09.952916 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f4d0b-5b6b-42ca-8967-7ca4560eb560 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:09.978151 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f4d0b-5b6b-42ca-8967-7ca4560eb560 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:09.990823 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 324/647] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:24:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:09.995628 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3576a5-2a19-4651-a146-e7263d6f88b0 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:10.005092 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3576a5-2a19-4651-a146-e7263d6f88b0 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:10.008996 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a1647-0b7c-4c9b-ba70-01a07a3781a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:10.009685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a1647-0b7c-4c9b-ba70-01a07a3781a5 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:10.009972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a1647-0b7c-4c9b-ba70-01a07a3781a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:10.010253 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a1647-0b7c-4c9b-ba70-01a07a3781a5 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:10.022381 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a1647-0b7c-4c9b-ba70-01a07a3781a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:10.047933 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a1647-0b7c-4c9b-ba70-01a07a3781a5 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:10.065880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-861a1647-0b7c-4c9b-ba70-01a07a3781a5 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 01:24:10.066893 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 324/648] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Aug 23 01:24:09 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:10.071936 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f4d0b-5b6b-42ca-8967-7ca4560eb560 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:10.080799 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f4d0b-5b6b-42ca-8967-7ca4560eb560 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:10.084771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66413491-6cc4-4dd7-b048-f0f5605daca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:10.085338 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66413491-6cc4-4dd7-b048-f0f5605daca6 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:10.085625 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66413491-6cc4-4dd7-b048-f0f5605daca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:10.085905 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66413491-6cc4-4dd7-b048-f0f5605daca6 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:10.086672 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66413491-6cc4-4dd7-b048-f0f5605daca6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:10.086972 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66413491-6cc4-4dd7-b048-f0f5605daca6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:10.113351 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66413491-6cc4-4dd7-b048-f0f5605daca6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:10.142016 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 325/649] 10.222.0.20 () {56 vars in 1171 bytes} [Mon Aug 23 01:24:10 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:10.147045 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a1647-0b7c-4c9b-ba70-01a07a3781a5 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:10.156373 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a1647-0b7c-4c9b-ba70-01a07a3781a5 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:10.160241 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1ac36-b1a8-41f7-950d-98e10c201e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:10.160819 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1ac36-b1a8-41f7-950d-98e10c201e4c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:10.161107 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1ac36-b1a8-41f7-950d-98e10c201e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:10.161384 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1ac36-b1a8-41f7-950d-98e10c201e4c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:10.168740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1ac36-b1a8-41f7-950d-98e10c201e4c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:10.194255 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1ac36-b1a8-41f7-950d-98e10c201e4c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:10.202276 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 325/650] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:24:10 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:24:10.207180 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66413491-6cc4-4dd7-b048-f0f5605daca6 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:10.216005 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66413491-6cc4-4dd7-b048-f0f5605daca6 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:10.220791 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e39e3-deda-4974-b1ab-63b2b400aa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:10.221479 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e39e3-deda-4974-b1ab-63b2b400aa1c admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:10.221762 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e39e3-deda-4974-b1ab-63b2b400aa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:10.222037 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e39e3-deda-4974-b1ab-63b2b400aa1c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:10.233257 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e39e3-deda-4974-b1ab-63b2b400aa1c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:10.258922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e39e3-deda-4974-b1ab-63b2b400aa1c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:10.275568 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-cc6e39e3-deda-4974-b1ab-63b2b400aa1c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:24:10.276602 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 326/651] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:10.281578 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1ac36-b1a8-41f7-950d-98e10c201e4c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:10.289636 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1ac36-b1a8-41f7-950d-98e10c201e4c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:10.293554 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78ed09-961e-40da-b801-15d1a65f6999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:10.294112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78ed09-961e-40da-b801-15d1a65f6999 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:10.294397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78ed09-961e-40da-b801-15d1a65f6999 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:10.294675 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78ed09-961e-40da-b801-15d1a65f6999 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:10.295339 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78ed09-961e-40da-b801-15d1a65f6999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:10.295636 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78ed09-961e-40da-b801-15d1a65f6999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:10.320878 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78ed09-961e-40da-b801-15d1a65f6999 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:10.333768 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 326/652] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:24:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:10.338555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e39e3-deda-4974-b1ab-63b2b400aa1c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:10.347553 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e39e3-deda-4974-b1ab-63b2b400aa1c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:10.351440 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da111c0-ad48-442e-bdc1-a85fa8eb22d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:10.352114 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da111c0-ad48-442e-bdc1-a85fa8eb22d1 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:10.352403 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da111c0-ad48-442e-bdc1-a85fa8eb22d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:10.352718 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da111c0-ad48-442e-bdc1-a85fa8eb22d1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:10.361226 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da111c0-ad48-442e-bdc1-a85fa8eb22d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:10.386895 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da111c0-ad48-442e-bdc1-a85fa8eb22d1 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:10.400673 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-1da111c0-ad48-442e-bdc1-a85fa8eb22d1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:24:10.401703 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 327/653] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:24:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:10.406917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78ed09-961e-40da-b801-15d1a65f6999 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:10.416038 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78ed09-961e-40da-b801-15d1a65f6999 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:10.419967 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb7fad-a89d-4288-b17f-93abbea3e9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:10.420536 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb7fad-a89d-4288-b17f-93abbea3e9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:10.420845 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb7fad-a89d-4288-b17f-93abbea3e9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:10.421128 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb7fad-a89d-4288-b17f-93abbea3e9c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:10.421855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb7fad-a89d-4288-b17f-93abbea3e9c0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:10.422154 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb7fad-a89d-4288-b17f-93abbea3e9c0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:10.447771 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb7fad-a89d-4288-b17f-93abbea3e9c0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:10.460286 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 327/654] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:24:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:10.465704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da111c0-ad48-442e-bdc1-a85fa8eb22d1 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:10.475514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da111c0-ad48-442e-bdc1-a85fa8eb22d1 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:10.479463 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012a91a-9341-455f-8d3f-f232c51e294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:10.480020 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012a91a-9341-455f-8d3f-f232c51e294a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:10.480309 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012a91a-9341-455f-8d3f-f232c51e294a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:10.480621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012a91a-9341-455f-8d3f-f232c51e294a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:10.481399 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012a91a-9341-455f-8d3f-f232c51e294a admin admin] RBAC: Adding query filter params (role.id=4b08bc68a548443bab31d6b110aa5c96, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=8f0dd32880d14ec9990bc09685d26326) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:10.481707 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012a91a-9341-455f-8d3f-f232c51e294a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:10.507486 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012a91a-9341-455f-8d3f-f232c51e294a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:10.513569 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 328/655] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:24:10 2021] GET /identity/v3/role_assignments?user.id=8f0dd32880d14ec9990bc09685d26326&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=4b08bc68a548443bab31d6b110aa5c96 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:12.483612 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d730dd2-297a-4ae7-8e18-4d3683fc5bf1 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:12.484055 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d730dd2-297a-4ae7-8e18-4d3683fc5bf1 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:12.484162 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d730dd2-297a-4ae7-8e18-4d3683fc5bf1 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:12.485846 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 328/656] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:12.490898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e4c82-fbb6-4a87-b3c6-df81723b4823 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:12.491315 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e4c82-fbb6-4a87-b3c6-df81723b4823 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:12.491469 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e4c82-fbb6-4a87-b3c6-df81723b4823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:12.514621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-259e4c82-fbb6-4a87-b3c6-df81723b4823 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:12.515779 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-259e4c82-fbb6-4a87-b3c6-df81723b4823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:12.522432 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 329/657] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:12 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:12.543537 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d730dd2-297a-4ae7-8e18-4d3683fc5bf1 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:12.554678 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d730dd2-297a-4ae7-8e18-4d3683fc5bf1 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:12.558435 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5145e-b196-49bf-9c30-d375e4bc6dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:12.559120 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5145e-b196-49bf-9c30-d375e4bc6dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:12.559406 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5145e-b196-49bf-9c30-d375e4bc6dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:12.559685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5145e-b196-49bf-9c30-d375e4bc6dd2 admin admin] PATH_INFO: `/v3/services/image` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:12.560831 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5145e-b196-49bf-9c30-d375e4bc6dd2 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:12.586121 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5145e-b196-49bf-9c30-d375e4bc6dd2 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:12.596162 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-dfb5145e-b196-49bf-9c30-d375e4bc6dd2 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 01:24:12.597215 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 329/658] 10.222.0.20 () {56 vars in 1127 bytes} [Mon Aug 23 01:24:12 2021] GET /identity/v3/services/image => generated 86 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:24:12.602472 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e4c82-fbb6-4a87-b3c6-df81723b4823 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:12.610779 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e4c82-fbb6-4a87-b3c6-df81723b4823 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:12.614813 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad24f6-660f-44f7-9b8a-3a253c25ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:12.615384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad24f6-660f-44f7-9b8a-3a253c25ba4f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:12.615674 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad24f6-660f-44f7-9b8a-3a253c25ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:12.615957 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad24f6-660f-44f7-9b8a-3a253c25ba4f admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:12.616667 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad24f6-660f-44f7-9b8a-3a253c25ba4f admin admin] RBAC: Adding query filter params (name=image) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:12.616971 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad24f6-660f-44f7-9b8a-3a253c25ba4f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:12.643746 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad24f6-660f-44f7-9b8a-3a253c25ba4f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:12.647979 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 330/659] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:12 2021] GET /identity/v3/services?name=image => generated 122 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:12.652862 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5145e-b196-49bf-9c30-d375e4bc6dd2 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:12.661567 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5145e-b196-49bf-9c30-d375e4bc6dd2 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:12.665486 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462df5ab-1c3d-4fd6-aed9-141d7f939611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:12.665984 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462df5ab-1c3d-4fd6-aed9-141d7f939611 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:12.666266 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462df5ab-1c3d-4fd6-aed9-141d7f939611 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:12.666538 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462df5ab-1c3d-4fd6-aed9-141d7f939611 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:12.667174 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462df5ab-1c3d-4fd6-aed9-141d7f939611 admin admin] RBAC: Adding query filter params (type=image) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:12.667466 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462df5ab-1c3d-4fd6-aed9-141d7f939611 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:12.692631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462df5ab-1c3d-4fd6-aed9-141d7f939611 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:12.696686 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 330/660] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:12 2021] GET /identity/v3/services?type=image => generated 122 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:14.606420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735419b-c2c6-417e-9579-bdc350e6c05f None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:14.607501 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735419b-c2c6-417e-9579-bdc350e6c05f None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:14.607501 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735419b-c2c6-417e-9579-bdc350e6c05f None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:14.609193 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 331/661] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:14.614208 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77901b-b25a-4621-9b0c-18dde4aa08b0 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:14.614591 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77901b-b25a-4621-9b0c-18dde4aa08b0 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:14.614778 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77901b-b25a-4621-9b0c-18dde4aa08b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:14.636537 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-cd77901b-b25a-4621-9b0c-18dde4aa08b0 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:14.637705 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-cd77901b-b25a-4621-9b0c-18dde4aa08b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:14.644152 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 331/662] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:14 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:14.665798 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735419b-c2c6-417e-9579-bdc350e6c05f None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:14.677516 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735419b-c2c6-417e-9579-bdc350e6c05f None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:14.681281 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d39d1-86d8-40e6-80a8-dc1668a98575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:14.681847 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d39d1-86d8-40e6-80a8-dc1668a98575 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:14.682131 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d39d1-86d8-40e6-80a8-dc1668a98575 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:14.682406 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d39d1-86d8-40e6-80a8-dc1668a98575 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:14.683068 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d39d1-86d8-40e6-80a8-dc1668a98575 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:14.708323 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d39d1-86d8-40e6-80a8-dc1668a98575 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:14.801078 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 332/663] 10.222.0.20 () {60 vars in 1163 bytes} [Mon Aug 23 01:24:14 2021] POST /identity/v3/services => generated 242 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:24:16.755062 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217a857-0337-4c06-a84e-1706c7bde8dd None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:16.755549 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217a857-0337-4c06-a84e-1706c7bde8dd None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:16.755549 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217a857-0337-4c06-a84e-1706c7bde8dd None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:16.757226 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 332/664] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:16.762157 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e74b0-5e97-430a-a7bb-e52fcf6b0c6b None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:16.762545 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e74b0-5e97-430a-a7bb-e52fcf6b0c6b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:16.762742 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e74b0-5e97-430a-a7bb-e52fcf6b0c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:16.784398 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-912e74b0-5e97-430a-a7bb-e52fcf6b0c6b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:16.785534 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-912e74b0-5e97-430a-a7bb-e52fcf6b0c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:16.802158 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 333/665] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:16 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:24:16.823862 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217a857-0337-4c06-a84e-1706c7bde8dd None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:16.835191 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217a857-0337-4c06-a84e-1706c7bde8dd None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:16.838993 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71e4f6-1553-4110-932a-9dc7614b05e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:16.839684 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71e4f6-1553-4110-932a-9dc7614b05e4 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:16.839972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71e4f6-1553-4110-932a-9dc7614b05e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:16.840253 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71e4f6-1553-4110-932a-9dc7614b05e4 admin admin] PATH_INFO: `/v3/services/image` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:16.841422 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71e4f6-1553-4110-932a-9dc7614b05e4 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:16.866599 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71e4f6-1553-4110-932a-9dc7614b05e4 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:16.876937 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-fe71e4f6-1553-4110-932a-9dc7614b05e4 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 01:24:16.877961 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 333/666] 10.222.0.20 () {56 vars in 1127 bytes} [Mon Aug 23 01:24:16 2021] GET /identity/v3/services/image => generated 86 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:16.883317 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e74b0-5e97-430a-a7bb-e52fcf6b0c6b None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:16.892225 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e74b0-5e97-430a-a7bb-e52fcf6b0c6b None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:16.896159 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfa6d9-7391-49eb-917a-71b5bae07397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:16.896765 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfa6d9-7391-49eb-917a-71b5bae07397 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:16.897052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfa6d9-7391-49eb-917a-71b5bae07397 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:16.897331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfa6d9-7391-49eb-917a-71b5bae07397 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:16.897988 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfa6d9-7391-49eb-917a-71b5bae07397 admin admin] RBAC: Adding query filter params (name=image) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:16.898283 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfa6d9-7391-49eb-917a-71b5bae07397 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:16.923170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfa6d9-7391-49eb-917a-71b5bae07397 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:16.927435 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 334/667] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:16 2021] GET /identity/v3/services?name=image => generated 122 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:16.932396 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71e4f6-1553-4110-932a-9dc7614b05e4 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:16.941701 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71e4f6-1553-4110-932a-9dc7614b05e4 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:16.945656 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91a608-b08a-4898-97c9-e2f3d2b26100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:16.946213 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91a608-b08a-4898-97c9-e2f3d2b26100 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:16.946498 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91a608-b08a-4898-97c9-e2f3d2b26100 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:16.946777 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91a608-b08a-4898-97c9-e2f3d2b26100 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:16.947425 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91a608-b08a-4898-97c9-e2f3d2b26100 admin admin] RBAC: Adding query filter params (type=image) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:16.947720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91a608-b08a-4898-97c9-e2f3d2b26100 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:16.973234 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91a608-b08a-4898-97c9-e2f3d2b26100 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:16.977660 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 334/668] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:16 2021] GET /identity/v3/services?type=image => generated 350 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:16.982830 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfa6d9-7391-49eb-917a-71b5bae07397 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:16.991505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfa6d9-7391-49eb-917a-71b5bae07397 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:16.995393 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97428a91-848d-4a38-894e-db959f6712fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:16.995932 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97428a91-848d-4a38-894e-db959f6712fa admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:16.996215 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97428a91-848d-4a38-894e-db959f6712fa admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:16.996491 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97428a91-848d-4a38-894e-db959f6712fa admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:16.997732 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97428a91-848d-4a38-894e-db959f6712fa admin admin] RBAC: Adding query filter params (interface=public, service_id=8af0477a42454d35897ba7796842309c, region_id=RegionOne) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:16.998029 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97428a91-848d-4a38-894e-db959f6712fa admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:17.023057 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97428a91-848d-4a38-894e-db959f6712fa admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:17.027934 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 335/669] 10.222.0.20 () {56 vars in 1273 bytes} [Mon Aug 23 01:24:16 2021] GET /identity/v3/endpoints?service_id=8af0477a42454d35897ba7796842309c&interface=public®ion_id=RegionOne => generated 194 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:17.033283 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91a608-b08a-4898-97c9-e2f3d2b26100 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:17.042026 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91a608-b08a-4898-97c9-e2f3d2b26100 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:17.046068 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b7d8c-a3b6-40b7-b318-199162140b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:17.046624 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b7d8c-a3b6-40b7-b318-199162140b03 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:17.046911 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b7d8c-a3b6-40b7-b318-199162140b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:17.047188 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b7d8c-a3b6-40b7-b318-199162140b03 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:17.047808 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b7d8c-a3b6-40b7-b318-199162140b03 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:17.073108 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b7d8c-a3b6-40b7-b318-199162140b03 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:17.079015 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 335/670] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 23 01:24:17 2021] GET /identity/v3/services => generated 1022 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:24:18.995877 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41f095-566c-48e5-a620-cff6b2e173fd None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:18.996483 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41f095-566c-48e5-a620-cff6b2e173fd None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:18.996483 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41f095-566c-48e5-a620-cff6b2e173fd None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:18.998747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 336/671] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 01:24:19.003761 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1a144-c92c-49c2-8360-95eb727f95e9 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:19.004185 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1a144-c92c-49c2-8360-95eb727f95e9 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:19.004334 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1a144-c92c-49c2-8360-95eb727f95e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:19.027424 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-bce1a144-c92c-49c2-8360-95eb727f95e9 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:19.028539 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-bce1a144-c92c-49c2-8360-95eb727f95e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:19.035137 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 336/672] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:19 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:19.057094 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41f095-566c-48e5-a620-cff6b2e173fd None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:19.069057 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41f095-566c-48e5-a620-cff6b2e173fd None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:19.072902 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71638e98-09d5-4fe6-ba6a-a90b3638f4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:19.073589 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71638e98-09d5-4fe6-ba6a-a90b3638f4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:19.073876 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71638e98-09d5-4fe6-ba6a-a90b3638f4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:19.074153 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71638e98-09d5-4fe6-ba6a-a90b3638f4e6 admin admin] PATH_INFO: `/v3/services/image` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:19.074758 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71638e98-09d5-4fe6-ba6a-a90b3638f4e6 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:19.100679 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71638e98-09d5-4fe6-ba6a-a90b3638f4e6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:19.111330 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-71638e98-09d5-4fe6-ba6a-a90b3638f4e6 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 01:24:19.112346 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 337/673] 10.222.0.20 () {56 vars in 1127 bytes} [Mon Aug 23 01:24:19 2021] GET /identity/v3/services/image => generated 86 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:24:19.117696 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1a144-c92c-49c2-8360-95eb727f95e9 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:19.126075 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1a144-c92c-49c2-8360-95eb727f95e9 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:19.130063 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af867721-a7df-4e95-a07a-7625d3418db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:19.130641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af867721-a7df-4e95-a07a-7625d3418db3 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:19.130930 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af867721-a7df-4e95-a07a-7625d3418db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:19.131210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af867721-a7df-4e95-a07a-7625d3418db3 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:19.131865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af867721-a7df-4e95-a07a-7625d3418db3 admin admin] RBAC: Adding query filter params (name=image) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:19.132163 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af867721-a7df-4e95-a07a-7625d3418db3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:19.157295 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af867721-a7df-4e95-a07a-7625d3418db3 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:19.161598 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 337/674] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:19 2021] GET /identity/v3/services?name=image => generated 122 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:19.166662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71638e98-09d5-4fe6-ba6a-a90b3638f4e6 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:19.176050 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71638e98-09d5-4fe6-ba6a-a90b3638f4e6 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:19.179942 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650563e-7a9b-4020-8570-f802986c3fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:19.180492 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650563e-7a9b-4020-8570-f802986c3fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:19.180802 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650563e-7a9b-4020-8570-f802986c3fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:19.181078 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650563e-7a9b-4020-8570-f802986c3fe3 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:19.181727 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650563e-7a9b-4020-8570-f802986c3fe3 admin admin] RBAC: Adding query filter params (type=image) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:19.182018 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650563e-7a9b-4020-8570-f802986c3fe3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:19.207108 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650563e-7a9b-4020-8570-f802986c3fe3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:19.211568 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 338/675] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:19 2021] GET /identity/v3/services?type=image => generated 350 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:24:19.217154 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af867721-a7df-4e95-a07a-7625d3418db3 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:19.226152 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af867721-a7df-4e95-a07a-7625d3418db3 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:19.230080 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b756bbe-2ed2-45a6-8649-37b0a8f0e7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:19.230632 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b756bbe-2ed2-45a6-8649-37b0a8f0e7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:19.230917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b756bbe-2ed2-45a6-8649-37b0a8f0e7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:19.231196 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b756bbe-2ed2-45a6-8649-37b0a8f0e7a0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:19.232461 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b756bbe-2ed2-45a6-8649-37b0a8f0e7a0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:19.257032 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b756bbe-2ed2-45a6-8649-37b0a8f0e7a0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:19.337288 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 338/676] 10.222.0.20 () {60 vars in 1166 bytes} [Mon Aug 23 01:24:19 2021] POST /identity/v3/endpoints => generated 327 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:24:21.277300 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762303f2-6c05-4f70-a235-635ed03f7c95 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:21.277865 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762303f2-6c05-4f70-a235-635ed03f7c95 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:21.277865 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762303f2-6c05-4f70-a235-635ed03f7c95 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:21.280107 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 339/677] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:21.285019 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3af5e6-3e48-4aeb-9053-1c1f037a0aed None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:21.285402 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3af5e6-3e48-4aeb-9053-1c1f037a0aed None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:21.285584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3af5e6-3e48-4aeb-9053-1c1f037a0aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:21.307103 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-2e3af5e6-3e48-4aeb-9053-1c1f037a0aed None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:21.308216 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-2e3af5e6-3e48-4aeb-9053-1c1f037a0aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:21.323550 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 339/678] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:21 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:21.345443 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762303f2-6c05-4f70-a235-635ed03f7c95 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:21.356781 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762303f2-6c05-4f70-a235-635ed03f7c95 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:21.360652 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e74738-a8b8-41d7-af9c-090bc180f765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:21.361207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e74738-a8b8-41d7-af9c-090bc180f765 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:21.361492 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e74738-a8b8-41d7-af9c-090bc180f765 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:21.361772 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e74738-a8b8-41d7-af9c-090bc180f765 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:21.369183 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e74738-a8b8-41d7-af9c-090bc180f765 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:21.395175 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e74738-a8b8-41d7-af9c-090bc180f765 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:21.404335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 340/679] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:24:21 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:24:21.409770 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3af5e6-3e48-4aeb-9053-1c1f037a0aed None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:21.418110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3af5e6-3e48-4aeb-9053-1c1f037a0aed None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:21.422137 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c2bc3-1c03-44ec-9168-fe5bd87c4368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:21.423139 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c2bc3-1c03-44ec-9168-fe5bd87c4368 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:21.423429 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c2bc3-1c03-44ec-9168-fe5bd87c4368 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:21.423707 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c2bc3-1c03-44ec-9168-fe5bd87c4368 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:21.424783 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c2bc3-1c03-44ec-9168-fe5bd87c4368 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:21.449986 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c2bc3-1c03-44ec-9168-fe5bd87c4368 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:21.451442 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 340/680] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:23.471503 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0ce9b-d20c-470c-ab03-f4f37595277c None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:23.471954 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0ce9b-d20c-470c-ab03-f4f37595277c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:23.472064 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0ce9b-d20c-470c-ab03-f4f37595277c None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:23.473740 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 341/681] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:23.478643 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810ba9d-d4a1-41cb-9dac-7de15a00883e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:23.479004 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810ba9d-d4a1-41cb-9dac-7de15a00883e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:23.479210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810ba9d-d4a1-41cb-9dac-7de15a00883e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:23.500698 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-6810ba9d-d4a1-41cb-9dac-7de15a00883e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:23.501800 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-6810ba9d-d4a1-41cb-9dac-7de15a00883e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:23.508239 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 341/682] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:23 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:23.532003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0ce9b-d20c-470c-ab03-f4f37595277c None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:23.543284 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0ce9b-d20c-470c-ab03-f4f37595277c None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:23.547129 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a042f-32a1-4a30-a8a0-ab5203f7c995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:23.547819 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a042f-32a1-4a30-a8a0-ab5203f7c995 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:23.548106 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a042f-32a1-4a30-a8a0-ab5203f7c995 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:23.548381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a042f-32a1-4a30-a8a0-ab5203f7c995 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:23.559640 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a042f-32a1-4a30-a8a0-ab5203f7c995 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:23.585359 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a042f-32a1-4a30-a8a0-ab5203f7c995 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:23.602369 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-367a042f-32a1-4a30-a8a0-ab5203f7c995 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:24:23.603410 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 342/683] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:23.609011 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810ba9d-d4a1-41cb-9dac-7de15a00883e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:23.617317 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810ba9d-d4a1-41cb-9dac-7de15a00883e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:23.621188 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bfa96-acfc-4350-8573-de30e8ccc687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:23.621758 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bfa96-acfc-4350-8573-de30e8ccc687 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:23.622530 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bfa96-acfc-4350-8573-de30e8ccc687 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:23.622806 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bfa96-acfc-4350-8573-de30e8ccc687 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:23.623475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bfa96-acfc-4350-8573-de30e8ccc687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:23.623770 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bfa96-acfc-4350-8573-de30e8ccc687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:23.649378 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bfa96-acfc-4350-8573-de30e8ccc687 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:23.661857 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 342/684] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:24:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:23.667045 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a042f-32a1-4a30-a8a0-ab5203f7c995 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:23.675921 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a042f-32a1-4a30-a8a0-ab5203f7c995 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:23.679862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5676e-9a12-4ac0-8153-d28dc7efd7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:23.680423 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5676e-9a12-4ac0-8153-d28dc7efd7fd admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:23.680751 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5676e-9a12-4ac0-8153-d28dc7efd7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:23.681033 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5676e-9a12-4ac0-8153-d28dc7efd7fd admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:23.681672 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5676e-9a12-4ac0-8153-d28dc7efd7fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:23.707889 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5676e-9a12-4ac0-8153-d28dc7efd7fd admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:23.811763 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 343/685] 10.222.0.20 () {60 vars in 1154 bytes} [Mon Aug 23 01:24:23 2021] POST /identity/v3/users => generated 248 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:24:25.765841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9de63-c0ba-429b-b15a-e4ccf5216e0b None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:25.766360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9de63-c0ba-429b-b15a-e4ccf5216e0b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:25.766360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9de63-c0ba-429b-b15a-e4ccf5216e0b None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:25.768018 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 343/686] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:25.773004 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd5dc0-e205-4d60-bd6e-00edd7036904 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:25.773384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd5dc0-e205-4d60-bd6e-00edd7036904 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:25.773576 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd5dc0-e205-4d60-bd6e-00edd7036904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:25.795428 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-22dd5dc0-e205-4d60-bd6e-00edd7036904 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:25.796552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-22dd5dc0-e205-4d60-bd6e-00edd7036904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:25.803141 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 344/687] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:25 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:25.824684 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9de63-c0ba-429b-b15a-e4ccf5216e0b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:25.836905 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9de63-c0ba-429b-b15a-e4ccf5216e0b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:25.840807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0acda-b868-45df-8220-7931663bea9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:25.841508 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0acda-b868-45df-8220-7931663bea9b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:25.841795 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0acda-b868-45df-8220-7931663bea9b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:25.842075 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0acda-b868-45df-8220-7931663bea9b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:25.853117 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0acda-b868-45df-8220-7931663bea9b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:24:25.859464 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-e3a0acda-b868-45df-8220-7931663bea9b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:24:25.860510 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 344/688] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:24:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:25.865723 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd5dc0-e205-4d60-bd6e-00edd7036904 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:25.874464 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd5dc0-e205-4d60-bd6e-00edd7036904 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:25.878456 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e29e7f-4521-4008-82ea-2a4490dc7a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:25.879026 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e29e7f-4521-4008-82ea-2a4490dc7a1f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:25.879315 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e29e7f-4521-4008-82ea-2a4490dc7a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:25.879597 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e29e7f-4521-4008-82ea-2a4490dc7a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:25.880355 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e29e7f-4521-4008-82ea-2a4490dc7a1f admin admin] RBAC: Adding query filter params (name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:25.880621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e29e7f-4521-4008-82ea-2a4490dc7a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:25.906174 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e29e7f-4521-4008-82ea-2a4490dc7a1f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:25.914263 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 345/689] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:24:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:25.919882 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0acda-b868-45df-8220-7931663bea9b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:25.929354 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0acda-b868-45df-8220-7931663bea9b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:25.933548 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d6bce-0af7-4f79-b2ed-37fd076e3437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:25.934262 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d6bce-0af7-4f79-b2ed-37fd076e3437 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:25.934558 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d6bce-0af7-4f79-b2ed-37fd076e3437 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:25.934843 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d6bce-0af7-4f79-b2ed-37fd076e3437 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:25.945798 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d6bce-0af7-4f79-b2ed-37fd076e3437 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:25.971832 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d6bce-0af7-4f79-b2ed-37fd076e3437 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:25.989647 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-403d6bce-0af7-4f79-b2ed-37fd076e3437 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:24:25.990685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 345/690] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:25.995981 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e29e7f-4521-4008-82ea-2a4490dc7a1f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:26.005033 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e29e7f-4521-4008-82ea-2a4490dc7a1f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:26.008990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbd119-d732-49f7-910e-fd6c7927d14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:26.009559 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbd119-d732-49f7-910e-fd6c7927d14b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:26.009846 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbd119-d732-49f7-910e-fd6c7927d14b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:26.010127 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbd119-d732-49f7-910e-fd6c7927d14b admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:26.010800 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cbd119-d732-49f7-910e-fd6c7927d14b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:26.011101 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cbd119-d732-49f7-910e-fd6c7927d14b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:26.036770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cbd119-d732-49f7-910e-fd6c7927d14b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:26.049611 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 346/691] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:24:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:26.054683 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d6bce-0af7-4f79-b2ed-37fd076e3437 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:26.063645 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d6bce-0af7-4f79-b2ed-37fd076e3437 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:26.067641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be16d17-965a-4b05-ac86-889b29a1a702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:26.068331 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be16d17-965a-4b05-ac86-889b29a1a702 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:26.068658 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be16d17-965a-4b05-ac86-889b29a1a702 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:26.068943 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be16d17-965a-4b05-ac86-889b29a1a702 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:26.081475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be16d17-965a-4b05-ac86-889b29a1a702 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:26.108118 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be16d17-965a-4b05-ac86-889b29a1a702 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:26.125421 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-1be16d17-965a-4b05-ac86-889b29a1a702 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 01:24:26.126447 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 346/692] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:24:26 2021] GET /identity/v3/users/cinder => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:26.131890 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbd119-d732-49f7-910e-fd6c7927d14b admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:26.141002 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbd119-d732-49f7-910e-fd6c7927d14b admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:26.145015 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8fe04-86b5-4e88-8d26-937826f4d8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:26.145596 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8fe04-86b5-4e88-8d26-937826f4d8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:26.145885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8fe04-86b5-4e88-8d26-937826f4d8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:26.146168 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8fe04-86b5-4e88-8d26-937826f4d8b8 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:26.146952 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8fe04-86b5-4e88-8d26-937826f4d8b8 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:26.147257 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8fe04-86b5-4e88-8d26-937826f4d8b8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:26.173870 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8fe04-86b5-4e88-8d26-937826f4d8b8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:26.203056 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 347/693] 10.222.0.20 () {56 vars in 1159 bytes} [Mon Aug 23 01:24:26 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:26.208154 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be16d17-965a-4b05-ac86-889b29a1a702 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:26.217653 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be16d17-965a-4b05-ac86-889b29a1a702 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:26.221874 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa16c1-9676-4807-9d81-21a4ace0f86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:26.222425 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa16c1-9676-4807-9d81-21a4ace0f86d admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:26.222713 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa16c1-9676-4807-9d81-21a4ace0f86d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:26.222995 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa16c1-9676-4807-9d81-21a4ace0f86d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:26.230477 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa16c1-9676-4807-9d81-21a4ace0f86d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:26.256040 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa16c1-9676-4807-9d81-21a4ace0f86d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:26.264785 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 347/694] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:24:26 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:24:26.269778 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8fe04-86b5-4e88-8d26-937826f4d8b8 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:26.279283 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8fe04-86b5-4e88-8d26-937826f4d8b8 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:26.283226 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f7dde-9aff-454f-a245-8826315e3b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:26.283923 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f7dde-9aff-454f-a245-8826315e3b75 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:26.284209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f7dde-9aff-454f-a245-8826315e3b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:26.284486 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f7dde-9aff-454f-a245-8826315e3b75 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:26.295730 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f7dde-9aff-454f-a245-8826315e3b75 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:26.320861 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f7dde-9aff-454f-a245-8826315e3b75 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:26.337516 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-010f7dde-9aff-454f-a245-8826315e3b75 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:24:26.338542 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 348/695] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:26.344275 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa16c1-9676-4807-9d81-21a4ace0f86d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:26.352786 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa16c1-9676-4807-9d81-21a4ace0f86d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:26.356823 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fbbe7-f1c2-4711-88bd-c2a7b1be67b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:26.357390 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fbbe7-f1c2-4711-88bd-c2a7b1be67b8 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:26.357679 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fbbe7-f1c2-4711-88bd-c2a7b1be67b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:26.357964 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fbbe7-f1c2-4711-88bd-c2a7b1be67b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:26.358630 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fbbe7-f1c2-4711-88bd-c2a7b1be67b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:26.358928 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fbbe7-f1c2-4711-88bd-c2a7b1be67b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:26.384010 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fbbe7-f1c2-4711-88bd-c2a7b1be67b8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:26.397216 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 348/696] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:24:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:26.402190 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f7dde-9aff-454f-a245-8826315e3b75 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:26.411671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f7dde-9aff-454f-a245-8826315e3b75 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:26.415586 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a372733-3350-4a98-90a4-1f44478801f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:26.416280 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a372733-3350-4a98-90a4-1f44478801f5 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:26.416944 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a372733-3350-4a98-90a4-1f44478801f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:26.416944 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a372733-3350-4a98-90a4-1f44478801f5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:26.425453 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a372733-3350-4a98-90a4-1f44478801f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:26.451121 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a372733-3350-4a98-90a4-1f44478801f5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:26.464062 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-9a372733-3350-4a98-90a4-1f44478801f5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:24:26.465114 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 349/697] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:24:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:26.471303 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fbbe7-f1c2-4711-88bd-c2a7b1be67b8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:26.480325 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fbbe7-f1c2-4711-88bd-c2a7b1be67b8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:26.484314 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19d5fa-068e-420f-aae2-88eb0416bc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:26.484917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19d5fa-068e-420f-aae2-88eb0416bc11 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:26.485217 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19d5fa-068e-420f-aae2-88eb0416bc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:26.485484 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19d5fa-068e-420f-aae2-88eb0416bc11 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:26.486210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19d5fa-068e-420f-aae2-88eb0416bc11 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:26.486508 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19d5fa-068e-420f-aae2-88eb0416bc11 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:26.511779 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19d5fa-068e-420f-aae2-88eb0416bc11 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:26.524767 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 349/698] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:24:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:24:26.530636 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a372733-3350-4a98-90a4-1f44478801f5 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:26.539490 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a372733-3350-4a98-90a4-1f44478801f5 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:26.543421 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e59220-c3a4-435e-a076-1de340f0e8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:26.543973 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e59220-c3a4-435e-a076-1de340f0e8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:26.544259 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e59220-c3a4-435e-a076-1de340f0e8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:26.544537 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e59220-c3a4-435e-a076-1de340f0e8c3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:26.545331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e59220-c3a4-435e-a076-1de340f0e8c3 admin admin] RBAC: Adding query filter params (role.id=aa34949eb3ac4431991f6c257fca79a9, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=43ec554d6a304e029ee4f244f4a18e24) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:26.545631 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e59220-c3a4-435e-a076-1de340f0e8c3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:26.570753 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e59220-c3a4-435e-a076-1de340f0e8c3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:26.576323 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 350/699] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:24:26 2021] GET /identity/v3/role_assignments?user.id=43ec554d6a304e029ee4f244f4a18e24&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=aa34949eb3ac4431991f6c257fca79a9 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:28.495369 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f028c45-bfab-4635-a5db-1987cf670970 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:28.495817 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f028c45-bfab-4635-a5db-1987cf670970 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:28.495944 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f028c45-bfab-4635-a5db-1987cf670970 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:28.497638 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 350/700] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:28.502754 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d775f9f-3d22-4061-822c-0f91bf9c363b None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:28.503171 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d775f9f-3d22-4061-822c-0f91bf9c363b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:28.503330 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d775f9f-3d22-4061-822c-0f91bf9c363b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:28.525831 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-3d775f9f-3d22-4061-822c-0f91bf9c363b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:28.526964 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-3d775f9f-3d22-4061-822c-0f91bf9c363b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:28.534239 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 351/701] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:28 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:28.555353 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f028c45-bfab-4635-a5db-1987cf670970 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:28.566752 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f028c45-bfab-4635-a5db-1987cf670970 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:28.570547 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd32106-b457-41ce-a729-5db80949fe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:28.571245 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd32106-b457-41ce-a729-5db80949fe7b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:28.571530 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd32106-b457-41ce-a729-5db80949fe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:28.571814 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd32106-b457-41ce-a729-5db80949fe7b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:28.583235 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd32106-b457-41ce-a729-5db80949fe7b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:24:28.589495 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-edd32106-b457-41ce-a729-5db80949fe7b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:24:28.591111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 351/702] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:24:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:28.596588 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d775f9f-3d22-4061-822c-0f91bf9c363b None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:28.604869 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d775f9f-3d22-4061-822c-0f91bf9c363b None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:28.608860 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf4407-cc34-4db3-ab91-c7b3975f4ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:28.609436 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf4407-cc34-4db3-ab91-c7b3975f4ebf admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:28.609727 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf4407-cc34-4db3-ab91-c7b3975f4ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:28.610010 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf4407-cc34-4db3-ab91-c7b3975f4ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:28.610710 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf4407-cc34-4db3-ab91-c7b3975f4ebf admin admin] RBAC: Adding query filter params (name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:28.611009 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf4407-cc34-4db3-ab91-c7b3975f4ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:28.636039 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf4407-cc34-4db3-ab91-c7b3975f4ebf admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:28.644707 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 352/703] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:24:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:28.649566 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd32106-b457-41ce-a729-5db80949fe7b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:28.659223 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd32106-b457-41ce-a729-5db80949fe7b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:28.663149 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fb878-101a-49c8-a7be-57f49866eb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:28.663768 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fb878-101a-49c8-a7be-57f49866eb9f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:28.664052 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fb878-101a-49c8-a7be-57f49866eb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:28.664329 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fb878-101a-49c8-a7be-57f49866eb9f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:28.675604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fb878-101a-49c8-a7be-57f49866eb9f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:28.701382 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fb878-101a-49c8-a7be-57f49866eb9f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:28.718549 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-2b0fb878-101a-49c8-a7be-57f49866eb9f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:24:28.719552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 352/704] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:24:28.724931 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf4407-cc34-4db3-ab91-c7b3975f4ebf admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:28.734423 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf4407-cc34-4db3-ab91-c7b3975f4ebf admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:28.738553 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f836c-1a5a-4389-9c22-4ba38b35e944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:28.739124 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f836c-1a5a-4389-9c22-4ba38b35e944 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:28.739412 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f836c-1a5a-4389-9c22-4ba38b35e944 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:28.739692 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f836c-1a5a-4389-9c22-4ba38b35e944 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:28.740365 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f836c-1a5a-4389-9c22-4ba38b35e944 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:28.740704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f836c-1a5a-4389-9c22-4ba38b35e944 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:28.766201 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f836c-1a5a-4389-9c22-4ba38b35e944 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:28.778576 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 353/705] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:24:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:28.783442 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fb878-101a-49c8-a7be-57f49866eb9f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:28.792199 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fb878-101a-49c8-a7be-57f49866eb9f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:28.796625 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50f6e6-3ceb-4d79-85e0-ee65e899c8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:28.797303 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50f6e6-3ceb-4d79-85e0-ee65e899c8be admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:28.797584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50f6e6-3ceb-4d79-85e0-ee65e899c8be admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:28.798129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50f6e6-3ceb-4d79-85e0-ee65e899c8be admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:28.810787 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50f6e6-3ceb-4d79-85e0-ee65e899c8be admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:28.836156 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50f6e6-3ceb-4d79-85e0-ee65e899c8be admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:28.853789 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-fd50f6e6-3ceb-4d79-85e0-ee65e899c8be admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 01:24:28.854792 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 353/706] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:24:28 2021] GET /identity/v3/users/cinder => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:28.860579 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f836c-1a5a-4389-9c22-4ba38b35e944 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:28.869584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f836c-1a5a-4389-9c22-4ba38b35e944 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:28.873712 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47d291-42ce-4d1f-aac2-a0a4e2090685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:28.874285 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47d291-42ce-4d1f-aac2-a0a4e2090685 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:28.874573 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47d291-42ce-4d1f-aac2-a0a4e2090685 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:28.874855 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47d291-42ce-4d1f-aac2-a0a4e2090685 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:28.875624 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47d291-42ce-4d1f-aac2-a0a4e2090685 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:28.875923 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47d291-42ce-4d1f-aac2-a0a4e2090685 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:28.901137 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47d291-42ce-4d1f-aac2-a0a4e2090685 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:28.929865 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 354/707] 10.222.0.20 () {56 vars in 1159 bytes} [Mon Aug 23 01:24:28 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:28.934924 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50f6e6-3ceb-4d79-85e0-ee65e899c8be admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:28.944026 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50f6e6-3ceb-4d79-85e0-ee65e899c8be admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:28.947971 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f81a3e-05ed-49ed-a181-43d3fe62ac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:28.948703 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f81a3e-05ed-49ed-a181-43d3fe62ac01 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:28.948990 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f81a3e-05ed-49ed-a181-43d3fe62ac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:28.949267 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f81a3e-05ed-49ed-a181-43d3fe62ac01 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:28.962218 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f81a3e-05ed-49ed-a181-43d3fe62ac01 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:28.988274 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f81a3e-05ed-49ed-a181-43d3fe62ac01 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:29.004291 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-88f81a3e-05ed-49ed-a181-43d3fe62ac01 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:24:29.005342 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 354/708] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:29.010367 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47d291-42ce-4d1f-aac2-a0a4e2090685 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:29.019410 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47d291-42ce-4d1f-aac2-a0a4e2090685 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:29.023359 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6042fcf-2e15-4b13-8e85-94fe1490671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:29.023928 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6042fcf-2e15-4b13-8e85-94fe1490671a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:29.024216 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6042fcf-2e15-4b13-8e85-94fe1490671a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:29.024498 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6042fcf-2e15-4b13-8e85-94fe1490671a admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:29.025203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6042fcf-2e15-4b13-8e85-94fe1490671a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:29.025501 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6042fcf-2e15-4b13-8e85-94fe1490671a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:29.051540 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6042fcf-2e15-4b13-8e85-94fe1490671a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:29.063070 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 355/709] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:24:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:29.067877 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f81a3e-05ed-49ed-a181-43d3fe62ac01 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:29.076735 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f81a3e-05ed-49ed-a181-43d3fe62ac01 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:29.080617 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dce14-51a5-421d-966c-e937524dd3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:29.081299 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dce14-51a5-421d-966c-e937524dd3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:29.081584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dce14-51a5-421d-966c-e937524dd3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:29.081864 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dce14-51a5-421d-966c-e937524dd3c8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:29.090879 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dce14-51a5-421d-966c-e937524dd3c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:29.116947 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dce14-51a5-421d-966c-e937524dd3c8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:29.130028 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-2c0dce14-51a5-421d-966c-e937524dd3c8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:24:29.131187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 355/710] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:24:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:24:29.136146 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6042fcf-2e15-4b13-8e85-94fe1490671a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:29.145026 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6042fcf-2e15-4b13-8e85-94fe1490671a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:29.148929 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00d2c8-b2d1-4412-bbb5-ad54be00d865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:29.149489 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00d2c8-b2d1-4412-bbb5-ad54be00d865 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:29.149773 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00d2c8-b2d1-4412-bbb5-ad54be00d865 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:29.150052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00d2c8-b2d1-4412-bbb5-ad54be00d865 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:29.150774 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00d2c8-b2d1-4412-bbb5-ad54be00d865 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:29.151071 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00d2c8-b2d1-4412-bbb5-ad54be00d865 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:29.177101 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00d2c8-b2d1-4412-bbb5-ad54be00d865 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:29.189688 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 356/711] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:24:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:24:29.194487 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dce14-51a5-421d-966c-e937524dd3c8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:29.203268 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dce14-51a5-421d-966c-e937524dd3c8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:29.207133 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed000a-7f9b-48b4-94c5-d2fd5bef4cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:29.207912 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed000a-7f9b-48b4-94c5-d2fd5bef4cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:29.208197 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed000a-7f9b-48b4-94c5-d2fd5bef4cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:29.208476 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed000a-7f9b-48b4-94c5-d2fd5bef4cc7 admin admin] PATH_INFO: `/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/43ec554d6a304e029ee4f244f4a18e24/roles/aa34949eb3ac4431991f6c257fca79a9` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:29.228223 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed000a-7f9b-48b4-94c5-d2fd5bef4cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2728fddda1c4691b33daad4fa4ef3d2, user_id=43ec554d6a304e029ee4f244f4a18e24, role_id=aa34949eb3ac4431991f6c257fca79a9)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:29.254748 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed000a-7f9b-48b4-94c5-d2fd5bef4cc7 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:29.336959 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 356/712] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:24:29 2021] PUT /identity/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/43ec554d6a304e029ee4f244f4a18e24/roles/aa34949eb3ac4431991f6c257fca79a9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:24:31.250500 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4567d-e069-47ed-97f2-8a1c54564efd None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:31.251037 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4567d-e069-47ed-97f2-8a1c54564efd None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:31.251037 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4567d-e069-47ed-97f2-8a1c54564efd None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:31.252750 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 357/713] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:31.257875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b1fbb-f609-432d-b6ce-207d5468ae6f None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:31.258248 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b1fbb-f609-432d-b6ce-207d5468ae6f None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:31.258447 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b1fbb-f609-432d-b6ce-207d5468ae6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:31.280922 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-a28b1fbb-f609-432d-b6ce-207d5468ae6f None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:31.282048 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-a28b1fbb-f609-432d-b6ce-207d5468ae6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:31.343710 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 357/714] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:31 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:31.365681 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4567d-e069-47ed-97f2-8a1c54564efd None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:31.377553 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4567d-e069-47ed-97f2-8a1c54564efd None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:31.381364 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031efd01-b8b4-4651-a57b-0f50209c4c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:31.382069 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031efd01-b8b4-4651-a57b-0f50209c4c58 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:31.382351 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031efd01-b8b4-4651-a57b-0f50209c4c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:31.382624 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031efd01-b8b4-4651-a57b-0f50209c4c58 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:31.393980 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031efd01-b8b4-4651-a57b-0f50209c4c58 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:24:31.400181 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-031efd01-b8b4-4651-a57b-0f50209c4c58 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:24:31.401261 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 358/715] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:24:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:31.406662 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b1fbb-f609-432d-b6ce-207d5468ae6f None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:31.415089 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b1fbb-f609-432d-b6ce-207d5468ae6f None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:31.419085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918060e3-23c6-4206-a740-b34362d259ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:31.419673 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918060e3-23c6-4206-a740-b34362d259ff admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:31.419964 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918060e3-23c6-4206-a740-b34362d259ff admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:31.420247 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918060e3-23c6-4206-a740-b34362d259ff admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:31.420998 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918060e3-23c6-4206-a740-b34362d259ff admin admin] RBAC: Adding query filter params (name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:31.421299 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918060e3-23c6-4206-a740-b34362d259ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:31.446625 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918060e3-23c6-4206-a740-b34362d259ff admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:31.455283 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 358/716] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:24:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:31.460624 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031efd01-b8b4-4651-a57b-0f50209c4c58 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:31.470419 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031efd01-b8b4-4651-a57b-0f50209c4c58 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:31.474394 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab92267-afa0-44ed-974f-f844e25db5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:31.475088 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab92267-afa0-44ed-974f-f844e25db5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:31.475376 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab92267-afa0-44ed-974f-f844e25db5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:31.475658 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab92267-afa0-44ed-974f-f844e25db5a3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:31.487070 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab92267-afa0-44ed-974f-f844e25db5a3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:31.512981 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab92267-afa0-44ed-974f-f844e25db5a3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:31.529792 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-9ab92267-afa0-44ed-974f-f844e25db5a3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:24:31.530820 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 359/717] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:31.535972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918060e3-23c6-4206-a740-b34362d259ff admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:31.545389 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918060e3-23c6-4206-a740-b34362d259ff admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:31.549376 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71c8ef-dbf4-4d49-973c-3bdf5448c3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:31.549946 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71c8ef-dbf4-4d49-973c-3bdf5448c3db admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:31.550235 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71c8ef-dbf4-4d49-973c-3bdf5448c3db admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:31.550523 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71c8ef-dbf4-4d49-973c-3bdf5448c3db admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:31.551200 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71c8ef-dbf4-4d49-973c-3bdf5448c3db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:31.551502 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71c8ef-dbf4-4d49-973c-3bdf5448c3db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:31.577863 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71c8ef-dbf4-4d49-973c-3bdf5448c3db admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:31.590406 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 359/718] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:24:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:31.595705 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab92267-afa0-44ed-974f-f844e25db5a3 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:31.605289 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab92267-afa0-44ed-974f-f844e25db5a3 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:31.610093 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2b378-1193-427b-80dc-a5d5d6a38221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:31.610814 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2b378-1193-427b-80dc-a5d5d6a38221 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:31.611103 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2b378-1193-427b-80dc-a5d5d6a38221 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:31.611386 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2b378-1193-427b-80dc-a5d5d6a38221 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:31.624527 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2b378-1193-427b-80dc-a5d5d6a38221 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:31.650026 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2b378-1193-427b-80dc-a5d5d6a38221 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:31.667282 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-adb2b378-1193-427b-80dc-a5d5d6a38221 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 01:24:31.668349 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 360/719] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:24:31 2021] GET /identity/v3/users/cinder => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:31.674559 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71c8ef-dbf4-4d49-973c-3bdf5448c3db admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:31.683734 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71c8ef-dbf4-4d49-973c-3bdf5448c3db admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:31.688342 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa90b11-219d-4ac5-af0e-76fa66efe712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:31.688958 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa90b11-219d-4ac5-af0e-76fa66efe712 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:31.689248 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa90b11-219d-4ac5-af0e-76fa66efe712 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:31.689548 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa90b11-219d-4ac5-af0e-76fa66efe712 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:31.690315 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa90b11-219d-4ac5-af0e-76fa66efe712 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:31.690617 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa90b11-219d-4ac5-af0e-76fa66efe712 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:31.715868 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa90b11-219d-4ac5-af0e-76fa66efe712 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:31.744294 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 360/720] 10.222.0.20 () {56 vars in 1159 bytes} [Mon Aug 23 01:24:31 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:31.750338 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2b378-1193-427b-80dc-a5d5d6a38221 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:31.759319 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2b378-1193-427b-80dc-a5d5d6a38221 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:31.763321 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7e330-33d4-4e08-8509-d00b4081d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:31.763824 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7e330-33d4-4e08-8509-d00b4081d49f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:31.764107 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7e330-33d4-4e08-8509-d00b4081d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:31.764384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7e330-33d4-4e08-8509-d00b4081d49f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:31.772126 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7e330-33d4-4e08-8509-d00b4081d49f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:31.797576 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7e330-33d4-4e08-8509-d00b4081d49f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:31.805745 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 361/721] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:24:31 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:24:31.811474 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa90b11-219d-4ac5-af0e-76fa66efe712 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:31.820412 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa90b11-219d-4ac5-af0e-76fa66efe712 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:31.824397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2e8fd-79ec-4d58-b3b6-5be8a0879359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:31.825131 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2e8fd-79ec-4d58-b3b6-5be8a0879359 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:31.825421 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2e8fd-79ec-4d58-b3b6-5be8a0879359 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:31.825700 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2e8fd-79ec-4d58-b3b6-5be8a0879359 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:31.836886 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2e8fd-79ec-4d58-b3b6-5be8a0879359 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:31.863186 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2e8fd-79ec-4d58-b3b6-5be8a0879359 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:31.879479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-6bc2e8fd-79ec-4d58-b3b6-5be8a0879359 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:24:31.880516 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 361/722] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:24:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:31.885617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7e330-33d4-4e08-8509-d00b4081d49f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:31.893841 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7e330-33d4-4e08-8509-d00b4081d49f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:31.901834 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344f5cc-a39c-461e-b84e-e3799303d38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:31.901834 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344f5cc-a39c-461e-b84e-e3799303d38d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:31.901834 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344f5cc-a39c-461e-b84e-e3799303d38d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:31.901834 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344f5cc-a39c-461e-b84e-e3799303d38d admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:31.902136 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344f5cc-a39c-461e-b84e-e3799303d38d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:31.902136 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344f5cc-a39c-461e-b84e-e3799303d38d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:31.930055 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344f5cc-a39c-461e-b84e-e3799303d38d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:31.943518 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 362/723] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:24:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:31.949107 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2e8fd-79ec-4d58-b3b6-5be8a0879359 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:31.958319 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2e8fd-79ec-4d58-b3b6-5be8a0879359 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:31.962357 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153f04b-62f1-461c-8330-39e140b4fb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:31.963059 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153f04b-62f1-461c-8330-39e140b4fb10 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:31.963349 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153f04b-62f1-461c-8330-39e140b4fb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:31.963632 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153f04b-62f1-461c-8330-39e140b4fb10 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:31.973091 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153f04b-62f1-461c-8330-39e140b4fb10 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:31.998853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153f04b-62f1-461c-8330-39e140b4fb10 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:32.011948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-8153f04b-62f1-461c-8330-39e140b4fb10 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:24:32.013002 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 362/724] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:24:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:24:32.018448 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344f5cc-a39c-461e-b84e-e3799303d38d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:32.027453 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344f5cc-a39c-461e-b84e-e3799303d38d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:32.031916 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f731d72-f01d-4323-b9be-544fb90761ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:32.032485 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f731d72-f01d-4323-b9be-544fb90761ca admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:32.032804 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f731d72-f01d-4323-b9be-544fb90761ca admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:32.033085 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f731d72-f01d-4323-b9be-544fb90761ca admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:32.033815 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f731d72-f01d-4323-b9be-544fb90761ca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:32.034118 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f731d72-f01d-4323-b9be-544fb90761ca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:32.059919 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f731d72-f01d-4323-b9be-544fb90761ca admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:32.073719 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 363/725] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:24:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:32.079219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153f04b-62f1-461c-8330-39e140b4fb10 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:32.088213 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153f04b-62f1-461c-8330-39e140b4fb10 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:32.092680 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47a8db-1f3a-466f-a857-25d0722e0023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:32.093238 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47a8db-1f3a-466f-a857-25d0722e0023 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:32.093526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47a8db-1f3a-466f-a857-25d0722e0023 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:32.093805 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47a8db-1f3a-466f-a857-25d0722e0023 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:32.094568 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47a8db-1f3a-466f-a857-25d0722e0023 admin admin] RBAC: Adding query filter params (role.id=aa34949eb3ac4431991f6c257fca79a9, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=43ec554d6a304e029ee4f244f4a18e24) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:32.095134 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47a8db-1f3a-466f-a857-25d0722e0023 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:32.121018 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47a8db-1f3a-466f-a857-25d0722e0023 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:32.127010 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 363/726] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:24:32 2021] GET /identity/v3/role_assignments?user.id=43ec554d6a304e029ee4f244f4a18e24&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=aa34949eb3ac4431991f6c257fca79a9 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:34.084905 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28631e2e-4720-4d26-9219-de7385cd4f59 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:34.085428 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28631e2e-4720-4d26-9219-de7385cd4f59 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:34.085540 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28631e2e-4720-4d26-9219-de7385cd4f59 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:34.087126 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 364/727] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:34.092781 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ea00c-2815-4c86-9cef-b5a208b6bb12 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:34.093160 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ea00c-2815-4c86-9cef-b5a208b6bb12 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:34.093351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ea00c-2815-4c86-9cef-b5a208b6bb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:34.115666 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-205ea00c-2815-4c86-9cef-b5a208b6bb12 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:34.116826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-205ea00c-2815-4c86-9cef-b5a208b6bb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:34.123951 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 364/728] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:34 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:34.145344 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28631e2e-4720-4d26-9219-de7385cd4f59 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:34.156967 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28631e2e-4720-4d26-9219-de7385cd4f59 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:34.160846 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0dfc4b-c0da-4541-ab39-4d764fbeec18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:34.161558 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0dfc4b-c0da-4541-ab39-4d764fbeec18 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:34.161843 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0dfc4b-c0da-4541-ab39-4d764fbeec18 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:34.162122 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0dfc4b-c0da-4541-ab39-4d764fbeec18 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:34.162733 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0dfc4b-c0da-4541-ab39-4d764fbeec18 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:34.188084 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0dfc4b-c0da-4541-ab39-4d764fbeec18 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:34.198499 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-2b0dfc4b-c0da-4541-ab39-4d764fbeec18 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 01:24:34.199514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 365/729] 10.222.0.20 () {56 vars in 1151 bytes} [Mon Aug 23 01:24:34 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:24:34.205299 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ea00c-2815-4c86-9cef-b5a208b6bb12 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:34.213590 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ea00c-2815-4c86-9cef-b5a208b6bb12 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:34.217592 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae523f3-1356-4ba0-9991-4ff469233a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:34.218165 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae523f3-1356-4ba0-9991-4ff469233a33 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:34.218457 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae523f3-1356-4ba0-9991-4ff469233a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:34.218741 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae523f3-1356-4ba0-9991-4ff469233a33 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:34.219402 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae523f3-1356-4ba0-9991-4ff469233a33 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:34.219956 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae523f3-1356-4ba0-9991-4ff469233a33 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:34.244760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae523f3-1356-4ba0-9991-4ff469233a33 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:34.249555 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 365/730] 10.222.0.20 () {56 vars in 1146 bytes} [Mon Aug 23 01:24:34 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:34.254617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0dfc4b-c0da-4541-ab39-4d764fbeec18 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:34.264019 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0dfc4b-c0da-4541-ab39-4d764fbeec18 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:34.267994 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dd07b-78f5-41bb-986c-c5bbe56585d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:34.268582 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dd07b-78f5-41bb-986c-c5bbe56585d2 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:34.268871 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dd07b-78f5-41bb-986c-c5bbe56585d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:34.269149 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dd07b-78f5-41bb-986c-c5bbe56585d2 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:34.269804 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dd07b-78f5-41bb-986c-c5bbe56585d2 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:34.270099 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dd07b-78f5-41bb-986c-c5bbe56585d2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:34.294878 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dd07b-78f5-41bb-986c-c5bbe56585d2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:34.299038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 366/731] 10.222.0.20 () {56 vars in 1146 bytes} [Mon Aug 23 01:24:34 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:36.226321 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067052f1-de4e-416b-8a40-dd673f41c1cf None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:36.226865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067052f1-de4e-416b-8a40-dd673f41c1cf None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:36.226865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067052f1-de4e-416b-8a40-dd673f41c1cf None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:36.228545 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 366/732] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:36.233997 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9345055-f883-431e-99d2-b7119b765022 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:36.234378 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9345055-f883-431e-99d2-b7119b765022 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:36.234560 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9345055-f883-431e-99d2-b7119b765022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:36.256899 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-a9345055-f883-431e-99d2-b7119b765022 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:36.258014 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a9345055-f883-431e-99d2-b7119b765022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:36.264632 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 367/733] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:36 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:36.286155 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067052f1-de4e-416b-8a40-dd673f41c1cf None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:36.297987 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067052f1-de4e-416b-8a40-dd673f41c1cf None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:36.301910 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3b749-0f8a-4e85-955a-15873e315da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:36.302481 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3b749-0f8a-4e85-955a-15873e315da8 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:36.302772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3b749-0f8a-4e85-955a-15873e315da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:36.303056 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3b749-0f8a-4e85-955a-15873e315da8 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:36.303727 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3b749-0f8a-4e85-955a-15873e315da8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:36.329228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3b749-0f8a-4e85-955a-15873e315da8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:36.420792 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 367/734] 10.222.0.20 () {60 vars in 1163 bytes} [Mon Aug 23 01:24:36 2021] POST /identity/v3/services => generated 251 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:24:38.349005 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ef22f-a1ce-401e-8a19-36129fd05ece None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:38.349528 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ef22f-a1ce-401e-8a19-36129fd05ece None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:38.349647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ef22f-a1ce-401e-8a19-36129fd05ece None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:38.351228 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 368/735] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:38.356653 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4703f-b80c-4585-8812-7ed9f403a71e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:38.357029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4703f-b80c-4585-8812-7ed9f403a71e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:38.357214 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4703f-b80c-4585-8812-7ed9f403a71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:38.380701 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-c2d4703f-b80c-4585-8812-7ed9f403a71e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:38.381804 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c2d4703f-b80c-4585-8812-7ed9f403a71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:38.397556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 368/736] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:38 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:38.419110 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ef22f-a1ce-401e-8a19-36129fd05ece None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:38.430420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ef22f-a1ce-401e-8a19-36129fd05ece None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:38.434965 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a1974-e634-4696-abb0-6482ef8012fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:38.435680 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a1974-e634-4696-abb0-6482ef8012fe admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:38.435965 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a1974-e634-4696-abb0-6482ef8012fe admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:38.436241 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a1974-e634-4696-abb0-6482ef8012fe admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:38.436891 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a1974-e634-4696-abb0-6482ef8012fe admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:38.461853 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a1974-e634-4696-abb0-6482ef8012fe admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:38.472475 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-7e0a1974-e634-4696-abb0-6482ef8012fe admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 01:24:38.473527 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 369/737] 10.222.0.20 () {56 vars in 1151 bytes} [Mon Aug 23 01:24:38 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:24:38.478878 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4703f-b80c-4585-8812-7ed9f403a71e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:38.487640 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4703f-b80c-4585-8812-7ed9f403a71e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:38.491500 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258db2a-efbb-4988-b1dd-6c91a9050952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:38.492075 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258db2a-efbb-4988-b1dd-6c91a9050952 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:38.492359 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258db2a-efbb-4988-b1dd-6c91a9050952 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:38.492662 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258db2a-efbb-4988-b1dd-6c91a9050952 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:38.493319 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258db2a-efbb-4988-b1dd-6c91a9050952 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:38.493609 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258db2a-efbb-4988-b1dd-6c91a9050952 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:38.519236 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258db2a-efbb-4988-b1dd-6c91a9050952 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:38.523561 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 369/738] 10.222.0.20 () {56 vars in 1146 bytes} [Mon Aug 23 01:24:38 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:38.528698 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a1974-e634-4696-abb0-6482ef8012fe admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:38.537523 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a1974-e634-4696-abb0-6482ef8012fe admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:38.541462 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5d5ee-24b7-481a-96c4-4475b20b6603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:38.542015 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5d5ee-24b7-481a-96c4-4475b20b6603 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:38.542301 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5d5ee-24b7-481a-96c4-4475b20b6603 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:38.542581 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5d5ee-24b7-481a-96c4-4475b20b6603 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:38.543753 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5d5ee-24b7-481a-96c4-4475b20b6603 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:38.544054 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5d5ee-24b7-481a-96c4-4475b20b6603 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:38.569439 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5d5ee-24b7-481a-96c4-4475b20b6603 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:38.573938 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 370/739] 10.222.0.20 () {56 vars in 1146 bytes} [Mon Aug 23 01:24:38 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:38.578934 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258db2a-efbb-4988-b1dd-6c91a9050952 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:38.587578 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258db2a-efbb-4988-b1dd-6c91a9050952 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:38.591978 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc2798-e5e5-46ef-a92a-bb3bd4bd49e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:38.592525 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc2798-e5e5-46ef-a92a-bb3bd4bd49e4 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:38.592841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc2798-e5e5-46ef-a92a-bb3bd4bd49e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:38.593114 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc2798-e5e5-46ef-a92a-bb3bd4bd49e4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:38.593830 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc2798-e5e5-46ef-a92a-bb3bd4bd49e4 admin admin] RBAC: Adding query filter params (interface=public, service_id=221b46e087ad42c19716b2e063fe0dc6, region_id=RegionOne) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:38.594129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc2798-e5e5-46ef-a92a-bb3bd4bd49e4 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:38.619300 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc2798-e5e5-46ef-a92a-bb3bd4bd49e4 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:38.624628 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 370/740] 10.222.0.20 () {56 vars in 1273 bytes} [Mon Aug 23 01:24:38 2021] GET /identity/v3/endpoints?service_id=221b46e087ad42c19716b2e063fe0dc6&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:38.629320 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5d5ee-24b7-481a-96c4-4475b20b6603 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:38.638127 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5d5ee-24b7-481a-96c4-4475b20b6603 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:38.642081 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f0c5d-320a-4eec-80d7-2a66a8b0e249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:38.642629 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f0c5d-320a-4eec-80d7-2a66a8b0e249 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:38.642913 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f0c5d-320a-4eec-80d7-2a66a8b0e249 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:38.643193 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f0c5d-320a-4eec-80d7-2a66a8b0e249 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:38.643817 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f0c5d-320a-4eec-80d7-2a66a8b0e249 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:38.669111 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f0c5d-320a-4eec-80d7-2a66a8b0e249 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:38.675038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 371/741] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 23 01:24:38 2021] GET /identity/v3/services => generated 1261 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:24:40.597934 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7a964-ae2c-450e-b88a-369efba16458 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:40.598462 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7a964-ae2c-450e-b88a-369efba16458 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:40.598564 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7a964-ae2c-450e-b88a-369efba16458 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:40.600147 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 371/742] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:40.605213 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3a599-c830-4295-a34d-baccc63d4ad2 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:40.605571 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3a599-c830-4295-a34d-baccc63d4ad2 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:40.605818 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3a599-c830-4295-a34d-baccc63d4ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:40.627572 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-ccb3a599-c830-4295-a34d-baccc63d4ad2 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:40.628716 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-ccb3a599-c830-4295-a34d-baccc63d4ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:40.635297 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 372/743] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:40 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:40.657619 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7a964-ae2c-450e-b88a-369efba16458 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:40.668934 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7a964-ae2c-450e-b88a-369efba16458 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:40.672657 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880a27f-18a2-40eb-8aae-049cfdfbd4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:40.673364 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880a27f-18a2-40eb-8aae-049cfdfbd4ea admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:40.673646 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880a27f-18a2-40eb-8aae-049cfdfbd4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:40.673921 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880a27f-18a2-40eb-8aae-049cfdfbd4ea admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:40.674525 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880a27f-18a2-40eb-8aae-049cfdfbd4ea admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:40.699152 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880a27f-18a2-40eb-8aae-049cfdfbd4ea admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:40.710046 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-8880a27f-18a2-40eb-8aae-049cfdfbd4ea admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 01:24:40.711053 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 372/744] 10.222.0.20 () {56 vars in 1151 bytes} [Mon Aug 23 01:24:40 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:40.717044 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3a599-c830-4295-a34d-baccc63d4ad2 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:40.725552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3a599-c830-4295-a34d-baccc63d4ad2 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:40.729486 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1f1f0-4882-4509-9167-308ec1a089c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:40.730056 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1f1f0-4882-4509-9167-308ec1a089c7 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:40.730343 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1f1f0-4882-4509-9167-308ec1a089c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:40.730623 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1f1f0-4882-4509-9167-308ec1a089c7 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:40.731285 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1f1f0-4882-4509-9167-308ec1a089c7 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:40.731577 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1f1f0-4882-4509-9167-308ec1a089c7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:40.756382 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1f1f0-4882-4509-9167-308ec1a089c7 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:40.760763 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 373/745] 10.222.0.20 () {56 vars in 1146 bytes} [Mon Aug 23 01:24:40 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:40.766294 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880a27f-18a2-40eb-8aae-049cfdfbd4ea admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:40.775002 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880a27f-18a2-40eb-8aae-049cfdfbd4ea admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:40.779660 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d108a-3ed4-4ff6-b507-ea1eb68bba76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:40.780211 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d108a-3ed4-4ff6-b507-ea1eb68bba76 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:40.780492 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d108a-3ed4-4ff6-b507-ea1eb68bba76 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:40.780797 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d108a-3ed4-4ff6-b507-ea1eb68bba76 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:40.781438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d108a-3ed4-4ff6-b507-ea1eb68bba76 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:40.781730 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d108a-3ed4-4ff6-b507-ea1eb68bba76 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:40.806338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d108a-3ed4-4ff6-b507-ea1eb68bba76 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:40.810802 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 373/746] 10.222.0.20 () {56 vars in 1146 bytes} [Mon Aug 23 01:24:40 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:40.815839 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1f1f0-4882-4509-9167-308ec1a089c7 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:40.825420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1f1f0-4882-4509-9167-308ec1a089c7 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:40.829301 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e73472-c1da-4d11-a58c-ee5d904a072d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:40.829845 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e73472-c1da-4d11-a58c-ee5d904a072d admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:40.830125 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e73472-c1da-4d11-a58c-ee5d904a072d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:40.830398 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e73472-c1da-4d11-a58c-ee5d904a072d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:40.831373 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e73472-c1da-4d11-a58c-ee5d904a072d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:40.857241 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e73472-c1da-4d11-a58c-ee5d904a072d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:40.940739 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 374/747] 10.222.0.20 () {60 vars in 1166 bytes} [Mon Aug 23 01:24:40 2021] POST /identity/v3/endpoints => generated 346 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:24:42.883305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75054b-f675-4bd1-97c8-c203253fccc1 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:42.883811 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75054b-f675-4bd1-97c8-c203253fccc1 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:42.883902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75054b-f675-4bd1-97c8-c203253fccc1 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:42.885566 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 374/748] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:42.890625 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569bed7-ce91-4887-9f72-b08ee110167b None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:42.891023 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569bed7-ce91-4887-9f72-b08ee110167b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:42.891191 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569bed7-ce91-4887-9f72-b08ee110167b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:42.913081 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-e569bed7-ce91-4887-9f72-b08ee110167b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:42.914211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-e569bed7-ce91-4887-9f72-b08ee110167b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:42.931740 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 375/749] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:42 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:42.954831 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75054b-f675-4bd1-97c8-c203253fccc1 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:42.966470 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75054b-f675-4bd1-97c8-c203253fccc1 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:42.970609 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d8f34-c4f3-44ed-9d5e-56c9f127553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:42.971319 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d8f34-c4f3-44ed-9d5e-56c9f127553b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:42.971610 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d8f34-c4f3-44ed-9d5e-56c9f127553b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:42.971893 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d8f34-c4f3-44ed-9d5e-56c9f127553b admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:42.972508 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d8f34-c4f3-44ed-9d5e-56c9f127553b admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:42.998456 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d8f34-c4f3-44ed-9d5e-56c9f127553b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:43.008659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-3a5d8f34-c4f3-44ed-9d5e-56c9f127553b admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Aug 23 01:24:43.009683 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 375/750] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:24:42 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:43.015190 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569bed7-ce91-4887-9f72-b08ee110167b None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:43.023780 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569bed7-ce91-4887-9f72-b08ee110167b None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:43.027802 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95fdd7-200c-40f1-8030-170eae09100d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:43.028379 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95fdd7-200c-40f1-8030-170eae09100d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:43.028703 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95fdd7-200c-40f1-8030-170eae09100d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:43.028987 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95fdd7-200c-40f1-8030-170eae09100d admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:43.029656 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95fdd7-200c-40f1-8030-170eae09100d admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:43.029958 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95fdd7-200c-40f1-8030-170eae09100d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:43.055369 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95fdd7-200c-40f1-8030-170eae09100d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:43.060359 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 376/751] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:24:43 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:43.065369 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d8f34-c4f3-44ed-9d5e-56c9f127553b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:43.075140 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d8f34-c4f3-44ed-9d5e-56c9f127553b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:43.079095 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac376fc2-f932-498c-9dcc-750b25b18a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:43.079656 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac376fc2-f932-498c-9dcc-750b25b18a82 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:43.079942 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac376fc2-f932-498c-9dcc-750b25b18a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:43.080219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac376fc2-f932-498c-9dcc-750b25b18a82 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:43.080908 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac376fc2-f932-498c-9dcc-750b25b18a82 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:43.081206 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac376fc2-f932-498c-9dcc-750b25b18a82 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:43.107030 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac376fc2-f932-498c-9dcc-750b25b18a82 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:43.111132 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 376/752] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:24:43 2021] GET /identity/v3/services?type=volumev2 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:45.031746 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09285ffa-b27c-4166-9dbf-2255b104da11 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:45.032264 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09285ffa-b27c-4166-9dbf-2255b104da11 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:45.032369 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09285ffa-b27c-4166-9dbf-2255b104da11 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:45.034018 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 377/753] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:45.039074 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c35c0-657c-43e1-b82d-5618f34db5cc None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:45.039505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c35c0-657c-43e1-b82d-5618f34db5cc None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:45.039639 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c35c0-657c-43e1-b82d-5618f34db5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:45.061305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-1c6c35c0-657c-43e1-b82d-5618f34db5cc None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:45.062415 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1c6c35c0-657c-43e1-b82d-5618f34db5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:45.069034 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 377/754] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:45 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:45.091646 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09285ffa-b27c-4166-9dbf-2255b104da11 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:45.103174 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09285ffa-b27c-4166-9dbf-2255b104da11 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:45.106967 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66f427-3871-40bd-88d7-9c0ce50c6830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:45.107530 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66f427-3871-40bd-88d7-9c0ce50c6830 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:45.107812 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66f427-3871-40bd-88d7-9c0ce50c6830 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:45.108087 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66f427-3871-40bd-88d7-9c0ce50c6830 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:45.108784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66f427-3871-40bd-88d7-9c0ce50c6830 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:45.133517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66f427-3871-40bd-88d7-9c0ce50c6830 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:45.217687 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 378/755] 10.222.0.20 () {60 vars in 1163 bytes} [Mon Aug 23 01:24:45 2021] POST /identity/v3/services => generated 251 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:24:47.234211 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450841f-d8d5-48bc-b0a3-79257a750988 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:47.234731 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450841f-d8d5-48bc-b0a3-79257a750988 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:47.234812 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450841f-d8d5-48bc-b0a3-79257a750988 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:47.236435 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 378/756] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:47.241466 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eba541-b5de-47c0-857b-f37555b63715 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:47.241882 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eba541-b5de-47c0-857b-f37555b63715 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:47.242033 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eba541-b5de-47c0-857b-f37555b63715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:47.264305 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-65eba541-b5de-47c0-857b-f37555b63715 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:47.265446 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-65eba541-b5de-47c0-857b-f37555b63715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:47.281683 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 379/757] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:47 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:47.303023 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450841f-d8d5-48bc-b0a3-79257a750988 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:47.314379 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450841f-d8d5-48bc-b0a3-79257a750988 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:47.318175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1667cf-36c4-4dcf-8c1a-8285f14b038f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:47.318875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1667cf-36c4-4dcf-8c1a-8285f14b038f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:47.319161 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1667cf-36c4-4dcf-8c1a-8285f14b038f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:47.319439 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1667cf-36c4-4dcf-8c1a-8285f14b038f admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:47.320077 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1667cf-36c4-4dcf-8c1a-8285f14b038f admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:47.346282 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1667cf-36c4-4dcf-8c1a-8285f14b038f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:47.356431 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-3a1667cf-36c4-4dcf-8c1a-8285f14b038f admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Aug 23 01:24:47.357473 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 379/758] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:24:47 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:47.362840 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eba541-b5de-47c0-857b-f37555b63715 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:47.371078 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eba541-b5de-47c0-857b-f37555b63715 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:47.375085 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62976a7c-7c3a-457b-92c0-ef4e5744e2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:47.375659 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62976a7c-7c3a-457b-92c0-ef4e5744e2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:47.375946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62976a7c-7c3a-457b-92c0-ef4e5744e2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:47.376226 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62976a7c-7c3a-457b-92c0-ef4e5744e2e5 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:47.376915 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62976a7c-7c3a-457b-92c0-ef4e5744e2e5 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:47.377209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62976a7c-7c3a-457b-92c0-ef4e5744e2e5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:47.403253 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62976a7c-7c3a-457b-92c0-ef4e5744e2e5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:47.408137 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 380/759] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:24:47 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:47.413660 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1667cf-36c4-4dcf-8c1a-8285f14b038f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:47.422825 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1667cf-36c4-4dcf-8c1a-8285f14b038f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:47.426788 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b53ea-48eb-4ea3-9067-ed4fff5da923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:47.427362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b53ea-48eb-4ea3-9067-ed4fff5da923 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:47.427649 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b53ea-48eb-4ea3-9067-ed4fff5da923 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:47.427928 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b53ea-48eb-4ea3-9067-ed4fff5da923 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:47.428641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b53ea-48eb-4ea3-9067-ed4fff5da923 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:47.428941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b53ea-48eb-4ea3-9067-ed4fff5da923 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:47.454249 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b53ea-48eb-4ea3-9067-ed4fff5da923 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:47.458753 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 380/760] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:24:47 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:24:47.464093 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62976a7c-7c3a-457b-92c0-ef4e5744e2e5 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:47.473970 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62976a7c-7c3a-457b-92c0-ef4e5744e2e5 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:47.477880 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9df492-7b73-42ca-9a87-7c0b9383b0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:47.478439 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9df492-7b73-42ca-9a87-7c0b9383b0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:47.478723 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9df492-7b73-42ca-9a87-7c0b9383b0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:47.478998 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9df492-7b73-42ca-9a87-7c0b9383b0a0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:47.479723 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9df492-7b73-42ca-9a87-7c0b9383b0a0 admin admin] RBAC: Adding query filter params (interface=public, service_id=27d88d4e23d54bcea4ab0826f8dd21fc, region_id=RegionOne) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:47.480019 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9df492-7b73-42ca-9a87-7c0b9383b0a0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:47.504843 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9df492-7b73-42ca-9a87-7c0b9383b0a0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:47.509719 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 381/761] 10.222.0.20 () {56 vars in 1273 bytes} [Mon Aug 23 01:24:47 2021] GET /identity/v3/endpoints?service_id=27d88d4e23d54bcea4ab0826f8dd21fc&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:24:47.515115 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b53ea-48eb-4ea3-9067-ed4fff5da923 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:47.524126 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b53ea-48eb-4ea3-9067-ed4fff5da923 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:47.528785 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3488c5d-c1d5-4d60-8a66-615cd4c11468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:47.529355 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3488c5d-c1d5-4d60-8a66-615cd4c11468 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:47.529643 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3488c5d-c1d5-4d60-8a66-615cd4c11468 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:47.529925 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3488c5d-c1d5-4d60-8a66-615cd4c11468 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:47.530556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3488c5d-c1d5-4d60-8a66-615cd4c11468 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:47.555525 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3488c5d-c1d5-4d60-8a66-615cd4c11468 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:47.561241 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 381/762] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 23 01:24:47 2021] GET /identity/v3/services => generated 1500 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:24:49.494165 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9372f-9549-4fe7-b05b-953d0a5161f2 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:49.494682 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9372f-9549-4fe7-b05b-953d0a5161f2 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:49.494789 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9372f-9549-4fe7-b05b-953d0a5161f2 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:49.496426 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 382/763] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:49.501469 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0643c-81fe-4c98-a4cc-d8fa58212f24 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:49.501895 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0643c-81fe-4c98-a4cc-d8fa58212f24 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:49.502032 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0643c-81fe-4c98-a4cc-d8fa58212f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:49.524204 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-d9e0643c-81fe-4c98-a4cc-d8fa58212f24 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:49.525351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-d9e0643c-81fe-4c98-a4cc-d8fa58212f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:49.532549 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 382/764] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:49 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:49.553914 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9372f-9549-4fe7-b05b-953d0a5161f2 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:49.565343 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9372f-9549-4fe7-b05b-953d0a5161f2 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:49.569222 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50349445-4146-450b-be66-d5b254a42831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:49.569927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50349445-4146-450b-be66-d5b254a42831 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:49.570217 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50349445-4146-450b-be66-d5b254a42831 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:49.570501 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50349445-4146-450b-be66-d5b254a42831 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:49.571118 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50349445-4146-450b-be66-d5b254a42831 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:49.597378 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50349445-4146-450b-be66-d5b254a42831 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:49.607513 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-50349445-4146-450b-be66-d5b254a42831 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Aug 23 01:24:49.608538 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 383/765] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:24:49 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:49.613802 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0643c-81fe-4c98-a4cc-d8fa58212f24 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:49.622036 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0643c-81fe-4c98-a4cc-d8fa58212f24 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:49.626001 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fd73b-583f-43ea-87cc-20e75044b49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:49.626571 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fd73b-583f-43ea-87cc-20e75044b49b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:49.626860 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fd73b-583f-43ea-87cc-20e75044b49b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:49.627140 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fd73b-583f-43ea-87cc-20e75044b49b admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:49.627810 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fd73b-583f-43ea-87cc-20e75044b49b admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:49.628095 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fd73b-583f-43ea-87cc-20e75044b49b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:49.653361 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fd73b-583f-43ea-87cc-20e75044b49b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:49.657807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 383/766] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:24:49 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:49.662983 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50349445-4146-450b-be66-d5b254a42831 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:49.672481 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50349445-4146-450b-be66-d5b254a42831 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:49.676397 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ad745-c718-4635-b124-742e84d04645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:49.676984 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ad745-c718-4635-b124-742e84d04645 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:49.677270 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ad745-c718-4635-b124-742e84d04645 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:49.677550 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ad745-c718-4635-b124-742e84d04645 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:49.678552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ad745-c718-4635-b124-742e84d04645 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:49.678855 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ad745-c718-4635-b124-742e84d04645 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:49.704291 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ad745-c718-4635-b124-742e84d04645 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:49.709068 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 384/767] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:24:49 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:24:49.714703 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fd73b-583f-43ea-87cc-20e75044b49b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:49.723872 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fd73b-583f-43ea-87cc-20e75044b49b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:49.727897 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328edab-5276-4088-a8fc-699a460d886b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:49.728459 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328edab-5276-4088-a8fc-699a460d886b admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:49.728781 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328edab-5276-4088-a8fc-699a460d886b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:49.729067 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328edab-5276-4088-a8fc-699a460d886b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:49.729741 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328edab-5276-4088-a8fc-699a460d886b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:49.755708 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328edab-5276-4088-a8fc-699a460d886b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:49.831281 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 384/768] 10.222.0.20 () {60 vars in 1166 bytes} [Mon Aug 23 01:24:49 2021] POST /identity/v3/endpoints => generated 346 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:24:51.768551 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191a1c4-a435-4829-81a8-183ae9e5ff3c None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:51.769075 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191a1c4-a435-4829-81a8-183ae9e5ff3c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:51.769075 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191a1c4-a435-4829-81a8-183ae9e5ff3c None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:51.770743 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 385/769] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:51.775694 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a39715-cd4c-4dd7-b337-4d5376438eab None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:51.776079 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a39715-cd4c-4dd7-b337-4d5376438eab None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:51.776262 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a39715-cd4c-4dd7-b337-4d5376438eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:51.798623 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-b6a39715-cd4c-4dd7-b337-4d5376438eab None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:51.799737 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-b6a39715-cd4c-4dd7-b337-4d5376438eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:51.815587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 385/770] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:51 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:51.836854 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191a1c4-a435-4829-81a8-183ae9e5ff3c None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:51.848547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191a1c4-a435-4829-81a8-183ae9e5ff3c None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:51.852456 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada87c1b-3b2a-49dd-84d1-ee8adb7c8a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:51.853209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada87c1b-3b2a-49dd-84d1-ee8adb7c8a9e admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:51.853497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada87c1b-3b2a-49dd-84d1-ee8adb7c8a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:51.853780 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada87c1b-3b2a-49dd-84d1-ee8adb7c8a9e admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:51.854391 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada87c1b-3b2a-49dd-84d1-ee8adb7c8a9e admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:51.880490 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada87c1b-3b2a-49dd-84d1-ee8adb7c8a9e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:51.890570 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-ada87c1b-3b2a-49dd-84d1-ee8adb7c8a9e admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 01:24:51.891598 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 386/771] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:24:51 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:51.896966 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a39715-cd4c-4dd7-b337-4d5376438eab None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:51.905311 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a39715-cd4c-4dd7-b337-4d5376438eab None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:51.909300 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f09236-c30e-4323-afb4-0a1889e26bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:51.909874 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f09236-c30e-4323-afb4-0a1889e26bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:51.910160 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f09236-c30e-4323-afb4-0a1889e26bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:51.910439 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f09236-c30e-4323-afb4-0a1889e26bb7 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:51.911099 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f09236-c30e-4323-afb4-0a1889e26bb7 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:51.911395 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f09236-c30e-4323-afb4-0a1889e26bb7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:51.937477 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f09236-c30e-4323-afb4-0a1889e26bb7 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:51.941924 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 386/772] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:24:51 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:51.947021 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada87c1b-3b2a-49dd-84d1-ee8adb7c8a9e admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:51.956842 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada87c1b-3b2a-49dd-84d1-ee8adb7c8a9e admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:51.960855 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7eb0d4-3358-4dda-b400-6931523a5e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:51.961409 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7eb0d4-3358-4dda-b400-6931523a5e49 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:51.961700 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7eb0d4-3358-4dda-b400-6931523a5e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:51.961987 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7eb0d4-3358-4dda-b400-6931523a5e49 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:51.962642 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7eb0d4-3358-4dda-b400-6931523a5e49 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:51.962942 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7eb0d4-3358-4dda-b400-6931523a5e49 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:51.988505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7eb0d4-3358-4dda-b400-6931523a5e49 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:51.992801 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 387/773] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:24:51 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:53.917788 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed3507-0611-400f-9b21-177f05971d70 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:53.918283 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed3507-0611-400f-9b21-177f05971d70 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:53.918441 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed3507-0611-400f-9b21-177f05971d70 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:53.920003 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 387/774] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:53.924925 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8d8ab-b2a6-4add-b172-8be2bb8ff27d None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:53.925305 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8d8ab-b2a6-4add-b172-8be2bb8ff27d None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:53.925478 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8d8ab-b2a6-4add-b172-8be2bb8ff27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:53.947504 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-30d8d8ab-b2a6-4add-b172-8be2bb8ff27d None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:53.949506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-30d8d8ab-b2a6-4add-b172-8be2bb8ff27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:53.956094 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 388/775] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:53 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:53.977737 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed3507-0611-400f-9b21-177f05971d70 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:53.989383 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed3507-0611-400f-9b21-177f05971d70 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:53.993542 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40df96a-f0e9-431f-876a-7c2252d20308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:53.994112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40df96a-f0e9-431f-876a-7c2252d20308 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:53.994397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40df96a-f0e9-431f-876a-7c2252d20308 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:53.994673 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40df96a-f0e9-431f-876a-7c2252d20308 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:53.995329 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40df96a-f0e9-431f-876a-7c2252d20308 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:54.020543 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40df96a-f0e9-431f-876a-7c2252d20308 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:54.127861 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 388/776] 10.222.0.20 () {60 vars in 1163 bytes} [Mon Aug 23 01:24:53 2021] POST /identity/v3/services => generated 251 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:24:56.061656 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffca043-e33e-40a4-88d1-29f43431b7a8 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:56.062169 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffca043-e33e-40a4-88d1-29f43431b7a8 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:56.062258 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffca043-e33e-40a4-88d1-29f43431b7a8 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:56.063880 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 389/777] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:56.069032 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f2dcc-2333-4d40-bf68-866a010b3e00 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:56.069420 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f2dcc-2333-4d40-bf68-866a010b3e00 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:56.069613 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f2dcc-2333-4d40-bf68-866a010b3e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:56.091972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-d42f2dcc-2333-4d40-bf68-866a010b3e00 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:56.093123 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-d42f2dcc-2333-4d40-bf68-866a010b3e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:56.109397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 389/778] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:56 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:56.131466 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffca043-e33e-40a4-88d1-29f43431b7a8 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:56.143625 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffca043-e33e-40a4-88d1-29f43431b7a8 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:56.147556 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06928811-f17f-4da9-b9d1-872844d66799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:56.148256 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06928811-f17f-4da9-b9d1-872844d66799 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:56.148547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06928811-f17f-4da9-b9d1-872844d66799 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:56.148880 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06928811-f17f-4da9-b9d1-872844d66799 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:56.149499 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06928811-f17f-4da9-b9d1-872844d66799 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:56.174491 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06928811-f17f-4da9-b9d1-872844d66799 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:56.185144 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-06928811-f17f-4da9-b9d1-872844d66799 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 01:24:56.186178 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 390/779] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:24:56 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:56.191656 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f2dcc-2333-4d40-bf68-866a010b3e00 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:56.200592 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f2dcc-2333-4d40-bf68-866a010b3e00 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:56.204540 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c9a7c-b05e-4a86-b91f-d8c7d3025885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:56.205142 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c9a7c-b05e-4a86-b91f-d8c7d3025885 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:56.205430 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c9a7c-b05e-4a86-b91f-d8c7d3025885 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:56.205706 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c9a7c-b05e-4a86-b91f-d8c7d3025885 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:56.206363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c9a7c-b05e-4a86-b91f-d8c7d3025885 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:56.206660 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c9a7c-b05e-4a86-b91f-d8c7d3025885 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:56.232232 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c9a7c-b05e-4a86-b91f-d8c7d3025885 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:56.236845 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 390/780] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:24:56 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:56.242009 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06928811-f17f-4da9-b9d1-872844d66799 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:56.251457 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06928811-f17f-4da9-b9d1-872844d66799 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:56.255454 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce7166-91d3-4704-8024-249b2009fd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:56.256015 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce7166-91d3-4704-8024-249b2009fd6a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:56.256305 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce7166-91d3-4704-8024-249b2009fd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:56.256610 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce7166-91d3-4704-8024-249b2009fd6a admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:56.257271 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce7166-91d3-4704-8024-249b2009fd6a admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:56.257568 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce7166-91d3-4704-8024-249b2009fd6a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:56.282693 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce7166-91d3-4704-8024-249b2009fd6a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:56.287180 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 391/781] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:24:56 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:56.292334 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c9a7c-b05e-4a86-b91f-d8c7d3025885 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:56.301702 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c9a7c-b05e-4a86-b91f-d8c7d3025885 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:56.305680 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37d3b9-79c5-46d5-9309-213dcf5bd4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:56.306233 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37d3b9-79c5-46d5-9309-213dcf5bd4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:56.306521 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37d3b9-79c5-46d5-9309-213dcf5bd4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:56.306803 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37d3b9-79c5-46d5-9309-213dcf5bd4b0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:56.307526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37d3b9-79c5-46d5-9309-213dcf5bd4b0 admin admin] RBAC: Adding query filter params (interface=public, service_id=e3f72504b6f84c16a3772715db981d85, region_id=RegionOne) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:56.307827 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37d3b9-79c5-46d5-9309-213dcf5bd4b0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:56.333247 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37d3b9-79c5-46d5-9309-213dcf5bd4b0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:56.338125 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 391/782] 10.222.0.20 () {56 vars in 1273 bytes} [Mon Aug 23 01:24:56 2021] GET /identity/v3/endpoints?service_id=e3f72504b6f84c16a3772715db981d85&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:56.343009 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce7166-91d3-4704-8024-249b2009fd6a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:56.352001 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce7166-91d3-4704-8024-249b2009fd6a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:56.356443 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f930996-47b6-4728-ab4e-7023dd83dca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:56.357029 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f930996-47b6-4728-ab4e-7023dd83dca7 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:56.357313 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f930996-47b6-4728-ab4e-7023dd83dca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:56.357589 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f930996-47b6-4728-ab4e-7023dd83dca7 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:56.358210 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f930996-47b6-4728-ab4e-7023dd83dca7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:56.383871 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f930996-47b6-4728-ab4e-7023dd83dca7 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:56.389900 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 392/783] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 23 01:24:56 2021] GET /identity/v3/services => generated 1739 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:24:58.319248 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba0bf3-ed84-48f4-a8ec-a8b10a96293b None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:58.319795 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba0bf3-ed84-48f4-a8ec-a8b10a96293b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:58.319795 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba0bf3-ed84-48f4-a8ec-a8b10a96293b None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:58.321602 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 392/784] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:24:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:24:58.327240 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebc10b-5d9a-4cfa-bb5c-fb6de3136bbd None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:58.327639 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebc10b-5d9a-4cfa-bb5c-fb6de3136bbd None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:58.327810 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebc10b-5d9a-4cfa-bb5c-fb6de3136bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:58.351185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-fdebc10b-5d9a-4cfa-bb5c-fb6de3136bbd None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:24:58.352322 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-fdebc10b-5d9a-4cfa-bb5c-fb6de3136bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:24:58.359022 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 393/785] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:24:58 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:24:58.381094 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba0bf3-ed84-48f4-a8ec-a8b10a96293b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:58.393293 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba0bf3-ed84-48f4-a8ec-a8b10a96293b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:58.397097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca1406-78cf-4a39-83b3-86e22ff951c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:58.397804 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca1406-78cf-4a39-83b3-86e22ff951c9 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:58.398087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca1406-78cf-4a39-83b3-86e22ff951c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:58.398360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca1406-78cf-4a39-83b3-86e22ff951c9 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:58.398965 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca1406-78cf-4a39-83b3-86e22ff951c9 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:58.424813 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca1406-78cf-4a39-83b3-86e22ff951c9 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:58.434908 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-cdca1406-78cf-4a39-83b3-86e22ff951c9 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 01:24:58.435943 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 393/786] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:24:58 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:24:58.441706 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebc10b-5d9a-4cfa-bb5c-fb6de3136bbd None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:58.450159 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebc10b-5d9a-4cfa-bb5c-fb6de3136bbd None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:58.454193 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4ba1f-b2d1-47e0-bace-4c080144a4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:58.454769 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4ba1f-b2d1-47e0-bace-4c080144a4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:58.455059 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4ba1f-b2d1-47e0-bace-4c080144a4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:58.455339 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4ba1f-b2d1-47e0-bace-4c080144a4d6 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:58.456004 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4ba1f-b2d1-47e0-bace-4c080144a4d6 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:58.456300 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4ba1f-b2d1-47e0-bace-4c080144a4d6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:58.482655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4ba1f-b2d1-47e0-bace-4c080144a4d6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:58.487199 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 394/787] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:24:58 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:58.492392 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca1406-78cf-4a39-83b3-86e22ff951c9 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:58.501350 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca1406-78cf-4a39-83b3-86e22ff951c9 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:58.505392 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce8b12-d320-41b4-84d4-60b12ade1060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:58.505960 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce8b12-d320-41b4-84d4-60b12ade1060 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:58.506249 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce8b12-d320-41b4-84d4-60b12ade1060 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:58.506531 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce8b12-d320-41b4-84d4-60b12ade1060 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:58.507184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce8b12-d320-41b4-84d4-60b12ade1060 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:24:58.507483 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce8b12-d320-41b4-84d4-60b12ade1060 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:58.533404 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce8b12-d320-41b4-84d4-60b12ade1060 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:58.537910 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 394/788] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:24:58 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:24:58.542963 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4ba1f-b2d1-47e0-bace-4c080144a4d6 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:24:58.551839 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4ba1f-b2d1-47e0-bace-4c080144a4d6 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:24:58.555839 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf49fe-af9d-4a60-9dbf-e2f027683d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:24:58.556392 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf49fe-af9d-4a60-9dbf-e2f027683d03 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:24:58.556720 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf49fe-af9d-4a60-9dbf-e2f027683d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:24:58.557003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf49fe-af9d-4a60-9dbf-e2f027683d03 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:24:58.557680 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf49fe-af9d-4a60-9dbf-e2f027683d03 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:24:58.583066 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf49fe-af9d-4a60-9dbf-e2f027683d03 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:24:58.665544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 395/789] 10.222.0.20 () {60 vars in 1166 bytes} [Mon Aug 23 01:24:58 2021] POST /identity/v3/endpoints => generated 346 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:25:00.604077 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90164334-45b3-432c-bf72-cbb9d8b8b621 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:00.604616 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90164334-45b3-432c-bf72-cbb9d8b8b621 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:00.604705 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90164334-45b3-432c-bf72-cbb9d8b8b621 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:00.606400 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 395/790] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:00.611441 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a183182-033d-4fb1-a10e-e802ad70cf06 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:00.611846 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a183182-033d-4fb1-a10e-e802ad70cf06 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:00.612006 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a183182-033d-4fb1-a10e-e802ad70cf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:00.634197 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-3a183182-033d-4fb1-a10e-e802ad70cf06 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:00.635304 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-3a183182-033d-4fb1-a10e-e802ad70cf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:00.651863 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 396/791] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:00 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:00.673838 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90164334-45b3-432c-bf72-cbb9d8b8b621 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:00.685787 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90164334-45b3-432c-bf72-cbb9d8b8b621 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:00.689626 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1f8e1-ff7f-4a5d-8315-4967cc40b058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:00.690192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1f8e1-ff7f-4a5d-8315-4967cc40b058 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:00.690480 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1f8e1-ff7f-4a5d-8315-4967cc40b058 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:00.690761 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1f8e1-ff7f-4a5d-8315-4967cc40b058 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:00.691403 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1f8e1-ff7f-4a5d-8315-4967cc40b058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:00.717034 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1f8e1-ff7f-4a5d-8315-4967cc40b058 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:00.718372 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.common [None req-7ac1f8e1-ff7f-4a5d-8315-4967cc40b058 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 01:25:00.762959 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.sql.core [None req-7ac1f8e1-ff7f-4a5d-8315-4967cc40b058 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 01:25:00.762959 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 01:25:00.762959 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [parameters: {'id': '05b2882f3dd84cbb8e81da377a0d7334', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 01:25:00.762959 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=60176) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Aug 23 01:25:00.776586 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-7ac1f8e1-ff7f-4a5d-8315-4967cc40b058 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 05b2882f3dd84cbb8e81da377a0d7334.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 05b2882f3dd84cbb8e81da377a0d7334. Aug 23 01:25:00.777807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 396/792] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Aug 23 01:25:00 2021] POST /identity/v3/projects => generated 262 bytes in 104 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:25:00.783590 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a183182-033d-4fb1-a10e-e802ad70cf06 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:00.792049 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a183182-033d-4fb1-a10e-e802ad70cf06 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:00.796579 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4dabe1-2294-4132-9e3a-f6835e3ef0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:00.797290 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dabe1-2294-4132-9e3a-f6835e3ef0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:00.797574 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dabe1-2294-4132-9e3a-f6835e3ef0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:00.797849 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dabe1-2294-4132-9e3a-f6835e3ef0f4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:00.805484 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4dabe1-2294-4132-9e3a-f6835e3ef0f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:00.831452 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4dabe1-2294-4132-9e3a-f6835e3ef0f4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:00.845456 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-1d4dabe1-2294-4132-9e3a-f6835e3ef0f4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:25:00.846486 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 397/793] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:25:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:00.852260 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1f8e1-ff7f-4a5d-8315-4967cc40b058 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:00.862247 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1f8e1-ff7f-4a5d-8315-4967cc40b058 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:00.866281 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371b29f-3851-4e75-9b79-c5c4471d7969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:00.866855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371b29f-3851-4e75-9b79-c5c4471d7969 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:00.867144 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371b29f-3851-4e75-9b79-c5c4471d7969 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:00.867426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371b29f-3851-4e75-9b79-c5c4471d7969 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:00.868128 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371b29f-3851-4e75-9b79-c5c4471d7969 admin admin] RBAC: Adding query filter params (name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:00.868430 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371b29f-3851-4e75-9b79-c5c4471d7969 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:00.894636 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371b29f-3851-4e75-9b79-c5c4471d7969 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:00.910689 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 397/794] 10.222.0.20 () {56 vars in 1134 bytes} [Mon Aug 23 01:25:00 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:02.877120 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c74dec-ba42-40f1-ab1c-699b4c4c418b None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:02.877611 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c74dec-ba42-40f1-ab1c-699b4c4c418b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:02.877611 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c74dec-ba42-40f1-ab1c-699b4c4c418b None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:02.879279 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 398/795] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:02.884273 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368126b-3653-46df-be2b-49b5af78bc99 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:02.884660 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368126b-3653-46df-be2b-49b5af78bc99 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:02.884865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368126b-3653-46df-be2b-49b5af78bc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:02.907074 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-1368126b-3653-46df-be2b-49b5af78bc99 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:02.908501 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1368126b-3653-46df-be2b-49b5af78bc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:02.915149 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 398/796] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:02 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:02.938527 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c74dec-ba42-40f1-ab1c-699b4c4c418b None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:02.950517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c74dec-ba42-40f1-ab1c-699b4c4c418b None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:02.954407 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042ba29-bf6e-4b39-a059-097adbd7b62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:02.954985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042ba29-bf6e-4b39-a059-097adbd7b62f admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:02.955273 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042ba29-bf6e-4b39-a059-097adbd7b62f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:02.955555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042ba29-bf6e-4b39-a059-097adbd7b62f admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:02.956197 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042ba29-bf6e-4b39-a059-097adbd7b62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:02.984747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042ba29-bf6e-4b39-a059-097adbd7b62f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:02.986055 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.common [None req-3042ba29-bf6e-4b39-a059-097adbd7b62f admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 01:25:03.057424 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.sql.core [None req-3042ba29-bf6e-4b39-a059-097adbd7b62f admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 01:25:03.057424 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 01:25:03.057424 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [parameters: {'user_id': 'b7d82d4d03ee461abdcb7c51b68456c6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 01:25:03.057424 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=60175) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Aug 23 01:25:03.071079 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-3042ba29-bf6e-4b39-a059-097adbd7b62f admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 01:25:03.072272 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 399/797] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:25:02 2021] POST /identity/v3/users => generated 160 bytes in 134 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:03.078378 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368126b-3653-46df-be2b-49b5af78bc99 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:03.087108 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368126b-3653-46df-be2b-49b5af78bc99 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:03.091194 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d91520-6137-4a9c-ad18-d87f23b1f7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:03.091902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d91520-6137-4a9c-ad18-d87f23b1f7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:03.092188 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d91520-6137-4a9c-ad18-d87f23b1f7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:03.095694 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d91520-6137-4a9c-ad18-d87f23b1f7c2 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:03.105469 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d91520-6137-4a9c-ad18-d87f23b1f7c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:03.131499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d91520-6137-4a9c-ad18-d87f23b1f7c2 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:03.148548 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-53d91520-6137-4a9c-ad18-d87f23b1f7c2 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 01:25:03.149614 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 399/798] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:25:03 2021] GET /identity/v3/users/cinder => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:03.155354 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042ba29-bf6e-4b39-a059-097adbd7b62f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:03.166492 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042ba29-bf6e-4b39-a059-097adbd7b62f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:03.170977 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02b69f-42bc-4299-94ed-1435576b69c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:03.171546 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02b69f-42bc-4299-94ed-1435576b69c3 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:03.171828 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02b69f-42bc-4299-94ed-1435576b69c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:03.172105 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02b69f-42bc-4299-94ed-1435576b69c3 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:03.172888 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02b69f-42bc-4299-94ed-1435576b69c3 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:03.173189 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02b69f-42bc-4299-94ed-1435576b69c3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:03.199076 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02b69f-42bc-4299-94ed-1435576b69c3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:03.231218 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 400/799] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Aug 23 01:25:03 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:25:05.263742 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dd8d4-adfd-46bf-8ddc-8f793ff56100 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:05.264268 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dd8d4-adfd-46bf-8ddc-8f793ff56100 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:05.264360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dd8d4-adfd-46bf-8ddc-8f793ff56100 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:05.266011 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 400/800] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:05.271362 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ee7a5-2ccf-447b-abaa-973db81027aa None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:05.271778 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ee7a5-2ccf-447b-abaa-973db81027aa None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:05.271927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ee7a5-2ccf-447b-abaa-973db81027aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:05.294244 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-bb6ee7a5-2ccf-447b-abaa-973db81027aa None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:05.295700 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-bb6ee7a5-2ccf-447b-abaa-973db81027aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:05.302471 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 401/801] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:05 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:05.326288 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dd8d4-adfd-46bf-8ddc-8f793ff56100 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:05.337546 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dd8d4-adfd-46bf-8ddc-8f793ff56100 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:05.341361 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e308c-7937-419b-bbd7-b8716c551f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:05.342052 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e308c-7937-419b-bbd7-b8716c551f8a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:05.342331 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e308c-7937-419b-bbd7-b8716c551f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:05.342597 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e308c-7937-419b-bbd7-b8716c551f8a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:05.354552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e308c-7937-419b-bbd7-b8716c551f8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:05.380614 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e308c-7937-419b-bbd7-b8716c551f8a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:05.396851 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-288e308c-7937-419b-bbd7-b8716c551f8a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:05.397902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 401/802] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:05.403732 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ee7a5-2ccf-447b-abaa-973db81027aa None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:05.412100 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ee7a5-2ccf-447b-abaa-973db81027aa None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:05.416084 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460dcab-aa7b-4d9c-a9c1-1c81f0ebd108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:05.416693 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460dcab-aa7b-4d9c-a9c1-1c81f0ebd108 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:05.416984 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460dcab-aa7b-4d9c-a9c1-1c81f0ebd108 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:05.417747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460dcab-aa7b-4d9c-a9c1-1c81f0ebd108 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:05.418417 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460dcab-aa7b-4d9c-a9c1-1c81f0ebd108 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:05.418710 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460dcab-aa7b-4d9c-a9c1-1c81f0ebd108 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:05.444319 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460dcab-aa7b-4d9c-a9c1-1c81f0ebd108 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:05.456707 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 402/803] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:05.462128 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e308c-7937-419b-bbd7-b8716c551f8a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:05.471529 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e308c-7937-419b-bbd7-b8716c551f8a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:05.475554 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e939d2a-2838-4880-bf4b-4303c52585c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:05.476136 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e939d2a-2838-4880-bf4b-4303c52585c0 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:05.476425 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e939d2a-2838-4880-bf4b-4303c52585c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:05.476750 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e939d2a-2838-4880-bf4b-4303c52585c0 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:05.477404 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e939d2a-2838-4880-bf4b-4303c52585c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:05.503878 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e939d2a-2838-4880-bf4b-4303c52585c0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:05.617784 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 402/804] 10.222.0.20 () {60 vars in 1154 bytes} [Mon Aug 23 01:25:05 2021] POST /identity/v3/users => generated 249 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:25:07.565715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08882028-81db-4359-81a9-40bccddf731a None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:07.566255 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08882028-81db-4359-81a9-40bccddf731a None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:07.566255 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08882028-81db-4359-81a9-40bccddf731a None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:07.567931 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 403/805] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 01:25:07.572954 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64163faa-3f05-4808-9109-ca2bd9924b03 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:07.573319 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64163faa-3f05-4808-9109-ca2bd9924b03 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:07.574036 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64163faa-3f05-4808-9109-ca2bd9924b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:07.598432 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-64163faa-3f05-4808-9109-ca2bd9924b03 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:07.599582 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-64163faa-3f05-4808-9109-ca2bd9924b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:07.606392 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 403/806] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:07 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:07.628082 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08882028-81db-4359-81a9-40bccddf731a None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:07.640005 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08882028-81db-4359-81a9-40bccddf731a None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:07.643880 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe03be-9314-4073-b2ca-b1c3f860f759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:07.644599 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe03be-9314-4073-b2ca-b1c3f860f759 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:07.644883 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe03be-9314-4073-b2ca-b1c3f860f759 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:07.645158 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe03be-9314-4073-b2ca-b1c3f860f759 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:07.656523 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe03be-9314-4073-b2ca-b1c3f860f759 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:25:07.662769 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-7afe03be-9314-4073-b2ca-b1c3f860f759 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:25:07.663864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 404/807] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:25:07 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:07.669374 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64163faa-3f05-4808-9109-ca2bd9924b03 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:07.677801 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64163faa-3f05-4808-9109-ca2bd9924b03 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:07.681876 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1d851-6ac7-402b-b2c2-63d814b50935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:07.682457 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1d851-6ac7-402b-b2c2-63d814b50935 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:07.682756 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1d851-6ac7-402b-b2c2-63d814b50935 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:07.683040 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1d851-6ac7-402b-b2c2-63d814b50935 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:07.683741 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1d851-6ac7-402b-b2c2-63d814b50935 admin admin] RBAC: Adding query filter params (name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:07.684040 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1d851-6ac7-402b-b2c2-63d814b50935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:07.709655 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1d851-6ac7-402b-b2c2-63d814b50935 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:07.718481 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 404/808] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:25:07 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:07.724053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe03be-9314-4073-b2ca-b1c3f860f759 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:07.733495 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe03be-9314-4073-b2ca-b1c3f860f759 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:07.737446 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda29f9-87c8-442d-89b1-5af4fe36cca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:07.738123 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda29f9-87c8-442d-89b1-5af4fe36cca5 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:07.738408 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda29f9-87c8-442d-89b1-5af4fe36cca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:07.738683 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda29f9-87c8-442d-89b1-5af4fe36cca5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:07.749436 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda29f9-87c8-442d-89b1-5af4fe36cca5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:07.774998 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda29f9-87c8-442d-89b1-5af4fe36cca5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:07.792364 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-8fda29f9-87c8-442d-89b1-5af4fe36cca5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:07.793426 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 405/809] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:07.798715 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1d851-6ac7-402b-b2c2-63d814b50935 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:07.807644 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1d851-6ac7-402b-b2c2-63d814b50935 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:07.811641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a0d14-8814-4af1-a522-05d09886e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:07.812210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a0d14-8814-4af1-a522-05d09886e13c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:07.812495 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a0d14-8814-4af1-a522-05d09886e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:07.812808 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a0d14-8814-4af1-a522-05d09886e13c admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:07.813480 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a0d14-8814-4af1-a522-05d09886e13c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:07.813778 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a0d14-8814-4af1-a522-05d09886e13c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:07.838931 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a0d14-8814-4af1-a522-05d09886e13c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:07.852020 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 405/810] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:07.857265 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda29f9-87c8-442d-89b1-5af4fe36cca5 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:07.867035 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda29f9-87c8-442d-89b1-5af4fe36cca5 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:07.871514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5e59b-800b-43cf-8525-6ef93fe4ff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:07.872196 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5e59b-800b-43cf-8525-6ef93fe4ff2d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:07.872480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5e59b-800b-43cf-8525-6ef93fe4ff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:07.872788 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5e59b-800b-43cf-8525-6ef93fe4ff2d admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:07.884938 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5e59b-800b-43cf-8525-6ef93fe4ff2d admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:07.910691 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5e59b-800b-43cf-8525-6ef93fe4ff2d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:07.927649 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-39d5e59b-800b-43cf-8525-6ef93fe4ff2d admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 01:25:07.928641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 406/811] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:25:07 2021] GET /identity/v3/users/neutron => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:07.934590 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a0d14-8814-4af1-a522-05d09886e13c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:07.943539 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a0d14-8814-4af1-a522-05d09886e13c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:07.947558 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc23de4-2765-4f31-a2ae-9bde5a36b6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:07.948135 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc23de4-2765-4f31-a2ae-9bde5a36b6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:07.949009 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc23de4-2765-4f31-a2ae-9bde5a36b6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:07.949295 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc23de4-2765-4f31-a2ae-9bde5a36b6e7 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:07.950067 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc23de4-2765-4f31-a2ae-9bde5a36b6e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:07.950364 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc23de4-2765-4f31-a2ae-9bde5a36b6e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:07.975737 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc23de4-2765-4f31-a2ae-9bde5a36b6e7 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:08.003842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 406/812] 10.222.0.20 () {56 vars in 1161 bytes} [Mon Aug 23 01:25:07 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:08.009122 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5e59b-800b-43cf-8525-6ef93fe4ff2d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:08.018163 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5e59b-800b-43cf-8525-6ef93fe4ff2d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:08.022116 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d07fad-2a47-4365-b14a-e5c33ab6cd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:08.022663 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d07fad-2a47-4365-b14a-e5c33ab6cd13 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:08.022948 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d07fad-2a47-4365-b14a-e5c33ab6cd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:08.023224 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d07fad-2a47-4365-b14a-e5c33ab6cd13 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:08.031113 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d07fad-2a47-4365-b14a-e5c33ab6cd13 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:08.056524 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d07fad-2a47-4365-b14a-e5c33ab6cd13 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:08.065486 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 407/813] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:25:08 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:25:08.070677 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc23de4-2765-4f31-a2ae-9bde5a36b6e7 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:08.079505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc23de4-2765-4f31-a2ae-9bde5a36b6e7 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:08.083523 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cafe3d-99d0-440c-9786-e513bd6a420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:08.084219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cafe3d-99d0-440c-9786-e513bd6a420e admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:08.084505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cafe3d-99d0-440c-9786-e513bd6a420e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:08.084817 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cafe3d-99d0-440c-9786-e513bd6a420e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:08.096548 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cafe3d-99d0-440c-9786-e513bd6a420e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:08.122198 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cafe3d-99d0-440c-9786-e513bd6a420e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:08.138359 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-f1cafe3d-99d0-440c-9786-e513bd6a420e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:08.139382 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 407/814] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:08.144421 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d07fad-2a47-4365-b14a-e5c33ab6cd13 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:08.153118 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d07fad-2a47-4365-b14a-e5c33ab6cd13 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:08.157092 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799806e-c713-4195-9a39-768907dd1965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:08.157646 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799806e-c713-4195-9a39-768907dd1965 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:08.157935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799806e-c713-4195-9a39-768907dd1965 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:08.158211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799806e-c713-4195-9a39-768907dd1965 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:08.158874 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799806e-c713-4195-9a39-768907dd1965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:08.159164 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799806e-c713-4195-9a39-768907dd1965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:08.184629 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799806e-c713-4195-9a39-768907dd1965 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:08.196096 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 408/815] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:25:08.200987 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cafe3d-99d0-440c-9786-e513bd6a420e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:08.209848 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cafe3d-99d0-440c-9786-e513bd6a420e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:08.213823 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccc524-bd10-4f05-a9a7-bc2b51e3c555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:08.215001 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccc524-bd10-4f05-a9a7-bc2b51e3c555 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:08.215280 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccc524-bd10-4f05-a9a7-bc2b51e3c555 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:08.215554 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccc524-bd10-4f05-a9a7-bc2b51e3c555 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:08.224363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccc524-bd10-4f05-a9a7-bc2b51e3c555 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:08.250999 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccc524-bd10-4f05-a9a7-bc2b51e3c555 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:08.264965 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-2bccc524-bd10-4f05-a9a7-bc2b51e3c555 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:25:08.266051 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 408/816] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:25:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:25:08.271577 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799806e-c713-4195-9a39-768907dd1965 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:08.281361 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799806e-c713-4195-9a39-768907dd1965 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:08.285385 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3c233-57f7-48df-825d-228cf043cdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:08.285958 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3c233-57f7-48df-825d-228cf043cdeb admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:08.286248 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3c233-57f7-48df-825d-228cf043cdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:08.286554 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3c233-57f7-48df-825d-228cf043cdeb admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:08.287291 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3c233-57f7-48df-825d-228cf043cdeb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:08.287595 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3c233-57f7-48df-825d-228cf043cdeb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:08.312913 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3c233-57f7-48df-825d-228cf043cdeb admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:08.325953 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 409/817] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:25:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:08.331344 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccc524-bd10-4f05-a9a7-bc2b51e3c555 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:08.340360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccc524-bd10-4f05-a9a7-bc2b51e3c555 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:08.344596 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c60456-b91e-4c79-a7a5-d23755a75453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:08.345158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c60456-b91e-4c79-a7a5-d23755a75453 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:08.345444 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c60456-b91e-4c79-a7a5-d23755a75453 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:08.345725 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c60456-b91e-4c79-a7a5-d23755a75453 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:08.346485 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c60456-b91e-4c79-a7a5-d23755a75453 admin admin] RBAC: Adding query filter params (role.id=aa34949eb3ac4431991f6c257fca79a9, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=eedaf4b880f24ac48ee6e04b75059ef4) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:08.346787 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c60456-b91e-4c79-a7a5-d23755a75453 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:08.373038 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c60456-b91e-4c79-a7a5-d23755a75453 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:08.378172 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 409/818] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:25:08 2021] GET /identity/v3/role_assignments?user.id=eedaf4b880f24ac48ee6e04b75059ef4&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=aa34949eb3ac4431991f6c257fca79a9 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:10.284746 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bbaf1-170f-48ca-9751-f5e1c065d0db None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:10.285267 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bbaf1-170f-48ca-9751-f5e1c065d0db None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:10.285355 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bbaf1-170f-48ca-9751-f5e1c065d0db None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:10.286953 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 410/819] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:10.291900 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f029f64-bb04-491e-832e-8ea02ee6bb26 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:10.292908 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f029f64-bb04-491e-832e-8ea02ee6bb26 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:10.293086 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f029f64-bb04-491e-832e-8ea02ee6bb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:10.315098 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-9f029f64-bb04-491e-832e-8ea02ee6bb26 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:10.316211 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-9f029f64-bb04-491e-832e-8ea02ee6bb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:10.322833 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 410/820] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:10 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:10.344806 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bbaf1-170f-48ca-9751-f5e1c065d0db None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:10.356794 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bbaf1-170f-48ca-9751-f5e1c065d0db None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:10.360618 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d103a66-0cf0-4e42-8f69-fe0b1f82fdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:10.361313 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d103a66-0cf0-4e42-8f69-fe0b1f82fdca admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:10.361598 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d103a66-0cf0-4e42-8f69-fe0b1f82fdca admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:10.361873 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d103a66-0cf0-4e42-8f69-fe0b1f82fdca admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:10.372632 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d103a66-0cf0-4e42-8f69-fe0b1f82fdca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:25:10.378791 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-2d103a66-0cf0-4e42-8f69-fe0b1f82fdca admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:25:10.379840 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 411/821] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:25:10 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:10.385264 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f029f64-bb04-491e-832e-8ea02ee6bb26 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:10.393798 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f029f64-bb04-491e-832e-8ea02ee6bb26 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:10.397828 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787994e-779d-4d69-b94c-65b4a0b2b0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:10.398414 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787994e-779d-4d69-b94c-65b4a0b2b0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:10.398703 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787994e-779d-4d69-b94c-65b4a0b2b0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:10.398983 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787994e-779d-4d69-b94c-65b4a0b2b0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:10.399683 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787994e-779d-4d69-b94c-65b4a0b2b0e5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:10.399980 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787994e-779d-4d69-b94c-65b4a0b2b0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:10.425965 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787994e-779d-4d69-b94c-65b4a0b2b0e5 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:10.434239 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 411/822] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:25:10 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:10.439718 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d103a66-0cf0-4e42-8f69-fe0b1f82fdca admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:10.449365 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d103a66-0cf0-4e42-8f69-fe0b1f82fdca admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:10.453349 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef75344-3df6-48ae-a2c7-3b25046f285b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:10.454041 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef75344-3df6-48ae-a2c7-3b25046f285b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:10.454329 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef75344-3df6-48ae-a2c7-3b25046f285b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:10.454607 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef75344-3df6-48ae-a2c7-3b25046f285b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:10.466027 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef75344-3df6-48ae-a2c7-3b25046f285b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:10.491954 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef75344-3df6-48ae-a2c7-3b25046f285b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:10.508806 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-1ef75344-3df6-48ae-a2c7-3b25046f285b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:10.509839 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 412/823] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:10.515583 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787994e-779d-4d69-b94c-65b4a0b2b0e5 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:10.524501 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787994e-779d-4d69-b94c-65b4a0b2b0e5 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:10.528636 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1589b5-5314-4960-9c1d-7131df1d55a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:10.529209 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1589b5-5314-4960-9c1d-7131df1d55a6 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:10.529498 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1589b5-5314-4960-9c1d-7131df1d55a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:10.529778 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1589b5-5314-4960-9c1d-7131df1d55a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:10.530453 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1589b5-5314-4960-9c1d-7131df1d55a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:10.530755 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1589b5-5314-4960-9c1d-7131df1d55a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:10.556158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1589b5-5314-4960-9c1d-7131df1d55a6 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:10.568951 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 412/824] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:10.574480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef75344-3df6-48ae-a2c7-3b25046f285b admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:10.583421 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef75344-3df6-48ae-a2c7-3b25046f285b admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:10.587377 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d63eb-858b-4a43-a44c-d51c486d6519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:10.588066 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d63eb-858b-4a43-a44c-d51c486d6519 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:10.588354 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d63eb-858b-4a43-a44c-d51c486d6519 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:10.588667 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d63eb-858b-4a43-a44c-d51c486d6519 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:10.601775 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d63eb-858b-4a43-a44c-d51c486d6519 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:10.627037 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d63eb-858b-4a43-a44c-d51c486d6519 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:10.644546 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-a40d63eb-858b-4a43-a44c-d51c486d6519 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 01:25:10.645581 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 413/825] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:25:10 2021] GET /identity/v3/users/neutron => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:25:10.650742 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1589b5-5314-4960-9c1d-7131df1d55a6 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:10.660164 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1589b5-5314-4960-9c1d-7131df1d55a6 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:10.664105 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb2b6f-a821-4863-8fff-48b7f9ac972a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:10.664709 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb2b6f-a821-4863-8fff-48b7f9ac972a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:10.664994 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb2b6f-a821-4863-8fff-48b7f9ac972a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:10.665270 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb2b6f-a821-4863-8fff-48b7f9ac972a admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:10.666033 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb2b6f-a821-4863-8fff-48b7f9ac972a admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:10.666327 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb2b6f-a821-4863-8fff-48b7f9ac972a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:10.691323 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb2b6f-a821-4863-8fff-48b7f9ac972a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:10.720303 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 413/826] 10.222.0.20 () {56 vars in 1161 bytes} [Mon Aug 23 01:25:10 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:10.725438 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d63eb-858b-4a43-a44c-d51c486d6519 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:10.734405 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d63eb-858b-4a43-a44c-d51c486d6519 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:10.738401 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096c274-78b0-48bb-b534-336ed40c665a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:10.739087 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096c274-78b0-48bb-b534-336ed40c665a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:10.739370 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096c274-78b0-48bb-b534-336ed40c665a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:10.739645 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096c274-78b0-48bb-b534-336ed40c665a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:10.751448 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096c274-78b0-48bb-b534-336ed40c665a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:10.777641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096c274-78b0-48bb-b534-336ed40c665a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:10.793769 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-9096c274-78b0-48bb-b534-336ed40c665a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:10.794796 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 414/827] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:10.799841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb2b6f-a821-4863-8fff-48b7f9ac972a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:10.808703 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb2b6f-a821-4863-8fff-48b7f9ac972a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:10.812587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b8139-d7b9-4e9c-951c-ec82619216bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:10.813156 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b8139-d7b9-4e9c-951c-ec82619216bd admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:10.813440 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b8139-d7b9-4e9c-951c-ec82619216bd admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:10.813717 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b8139-d7b9-4e9c-951c-ec82619216bd admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:10.814381 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b8139-d7b9-4e9c-951c-ec82619216bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:10.814673 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b8139-d7b9-4e9c-951c-ec82619216bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:10.840787 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b8139-d7b9-4e9c-951c-ec82619216bd admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:10.853078 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 414/828] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:10.858306 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096c274-78b0-48bb-b534-336ed40c665a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:10.867182 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096c274-78b0-48bb-b534-336ed40c665a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:10.871620 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea05b2d-7649-4ecf-82bf-4c3eadc759b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:10.872302 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea05b2d-7649-4ecf-82bf-4c3eadc759b7 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:10.872615 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea05b2d-7649-4ecf-82bf-4c3eadc759b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:10.872897 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea05b2d-7649-4ecf-82bf-4c3eadc759b7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:10.882546 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea05b2d-7649-4ecf-82bf-4c3eadc759b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:10.908415 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea05b2d-7649-4ecf-82bf-4c3eadc759b7 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:10.921452 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-fea05b2d-7649-4ecf-82bf-4c3eadc759b7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:25:10.922472 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 415/829] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:25:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:25:10.927740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b8139-d7b9-4e9c-951c-ec82619216bd admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:10.937150 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b8139-d7b9-4e9c-951c-ec82619216bd admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:10.941164 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f86e7c-a067-4bea-bc70-f2b855bcd279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:10.941726 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f86e7c-a067-4bea-bc70-f2b855bcd279 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:10.942010 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f86e7c-a067-4bea-bc70-f2b855bcd279 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:10.942289 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f86e7c-a067-4bea-bc70-f2b855bcd279 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:10.943013 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f86e7c-a067-4bea-bc70-f2b855bcd279 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:10.943313 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f86e7c-a067-4bea-bc70-f2b855bcd279 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:10.969307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f86e7c-a067-4bea-bc70-f2b855bcd279 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:10.981836 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 415/830] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:25:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:10.986880 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea05b2d-7649-4ecf-82bf-4c3eadc759b7 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:10.996142 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea05b2d-7649-4ecf-82bf-4c3eadc759b7 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:11.000079 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dad3c-f091-476b-9138-9fd095343537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:11.000883 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dad3c-f091-476b-9138-9fd095343537 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:11.001167 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dad3c-f091-476b-9138-9fd095343537 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:11.001443 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dad3c-f091-476b-9138-9fd095343537 admin admin] PATH_INFO: `/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/eedaf4b880f24ac48ee6e04b75059ef4/roles/aa34949eb3ac4431991f6c257fca79a9` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:11.021051 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4dad3c-f091-476b-9138-9fd095343537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2728fddda1c4691b33daad4fa4ef3d2, user_id=eedaf4b880f24ac48ee6e04b75059ef4, role_id=aa34949eb3ac4431991f6c257fca79a9)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:11.047018 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4dad3c-f091-476b-9138-9fd095343537 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:11.127831 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 416/831] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:25:10 2021] PUT /identity/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/eedaf4b880f24ac48ee6e04b75059ef4/roles/aa34949eb3ac4431991f6c257fca79a9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:25:13.029841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35e307-4a3f-44ea-bad5-24237a279177 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:13.030359 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35e307-4a3f-44ea-bad5-24237a279177 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:13.030449 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35e307-4a3f-44ea-bad5-24237a279177 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:13.032062 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 416/832] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:13.036984 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b1b7f-9b94-4bfe-af9c-9d6f330d1afa None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:13.037398 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b1b7f-9b94-4bfe-af9c-9d6f330d1afa None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:13.037539 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b1b7f-9b94-4bfe-af9c-9d6f330d1afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:13.060272 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-2d7b1b7f-9b94-4bfe-af9c-9d6f330d1afa None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:13.061404 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2d7b1b7f-9b94-4bfe-af9c-9d6f330d1afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:13.122360 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 417/833] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:13 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:25:13.144669 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35e307-4a3f-44ea-bad5-24237a279177 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:13.156474 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35e307-4a3f-44ea-bad5-24237a279177 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:13.160320 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5d27a-8582-4129-a617-e0f6b3428cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:13.161047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5d27a-8582-4129-a617-e0f6b3428cea admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:13.161334 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5d27a-8582-4129-a617-e0f6b3428cea admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:13.161610 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5d27a-8582-4129-a617-e0f6b3428cea admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:13.173155 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5d27a-8582-4129-a617-e0f6b3428cea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:25:13.179407 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-b9e5d27a-8582-4129-a617-e0f6b3428cea admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:25:13.180455 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 417/834] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:25:13 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:13.185792 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b1b7f-9b94-4bfe-af9c-9d6f330d1afa None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:13.193984 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b1b7f-9b94-4bfe-af9c-9d6f330d1afa None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:13.197897 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892ccea-ae81-46e5-852e-63ad45260e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:13.198489 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892ccea-ae81-46e5-852e-63ad45260e8c admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:13.198776 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892ccea-ae81-46e5-852e-63ad45260e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:13.199091 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892ccea-ae81-46e5-852e-63ad45260e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:13.199787 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892ccea-ae81-46e5-852e-63ad45260e8c admin admin] RBAC: Adding query filter params (name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:13.200081 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892ccea-ae81-46e5-852e-63ad45260e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:13.225696 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892ccea-ae81-46e5-852e-63ad45260e8c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:13.234350 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 418/835] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:25:13 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:13.239497 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5d27a-8582-4129-a617-e0f6b3428cea admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:13.251159 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5d27a-8582-4129-a617-e0f6b3428cea admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:13.255191 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217c9d3-3278-4e19-82dd-7c4098f0cf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:13.255870 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217c9d3-3278-4e19-82dd-7c4098f0cf35 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:13.256156 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217c9d3-3278-4e19-82dd-7c4098f0cf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:13.256438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217c9d3-3278-4e19-82dd-7c4098f0cf35 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:13.267256 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217c9d3-3278-4e19-82dd-7c4098f0cf35 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:13.293238 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217c9d3-3278-4e19-82dd-7c4098f0cf35 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:13.309963 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-d217c9d3-3278-4e19-82dd-7c4098f0cf35 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:13.310983 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 418/836] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:13.316456 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892ccea-ae81-46e5-852e-63ad45260e8c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:13.325547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892ccea-ae81-46e5-852e-63ad45260e8c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:13.329519 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88690bf-d02b-4cf6-9cc7-b5f74c88bec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:13.330087 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88690bf-d02b-4cf6-9cc7-b5f74c88bec1 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:13.330371 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88690bf-d02b-4cf6-9cc7-b5f74c88bec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:13.330670 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88690bf-d02b-4cf6-9cc7-b5f74c88bec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:13.331342 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88690bf-d02b-4cf6-9cc7-b5f74c88bec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:13.331637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88690bf-d02b-4cf6-9cc7-b5f74c88bec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:13.358044 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88690bf-d02b-4cf6-9cc7-b5f74c88bec1 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:13.370676 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 419/837] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:13.376213 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217c9d3-3278-4e19-82dd-7c4098f0cf35 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:13.385439 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217c9d3-3278-4e19-82dd-7c4098f0cf35 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:13.389507 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488b778-de12-4378-a614-85be88ed12bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:13.390217 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488b778-de12-4378-a614-85be88ed12bd admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:13.390508 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488b778-de12-4378-a614-85be88ed12bd admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:13.390789 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488b778-de12-4378-a614-85be88ed12bd admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:13.403529 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488b778-de12-4378-a614-85be88ed12bd admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:13.429603 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488b778-de12-4378-a614-85be88ed12bd admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:13.446908 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-9488b778-de12-4378-a614-85be88ed12bd admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 01:25:13.447961 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 419/838] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:25:13 2021] GET /identity/v3/users/neutron => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:13.453634 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88690bf-d02b-4cf6-9cc7-b5f74c88bec1 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:13.462715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88690bf-d02b-4cf6-9cc7-b5f74c88bec1 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:13.467205 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf607f-1db2-4fea-b5e6-584776920c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:13.467784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf607f-1db2-4fea-b5e6-584776920c1d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:13.468067 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf607f-1db2-4fea-b5e6-584776920c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:13.468343 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf607f-1db2-4fea-b5e6-584776920c1d admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:13.469404 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf607f-1db2-4fea-b5e6-584776920c1d admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:13.469702 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf607f-1db2-4fea-b5e6-584776920c1d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:13.495445 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf607f-1db2-4fea-b5e6-584776920c1d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:13.523345 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 420/839] 10.222.0.20 () {56 vars in 1161 bytes} [Mon Aug 23 01:25:13 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:13.529272 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488b778-de12-4378-a614-85be88ed12bd admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:13.538258 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488b778-de12-4378-a614-85be88ed12bd admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:13.542296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88130423-73c5-4eac-94cc-29d82cae6941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:13.542859 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88130423-73c5-4eac-94cc-29d82cae6941 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:13.543148 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88130423-73c5-4eac-94cc-29d82cae6941 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:13.543475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88130423-73c5-4eac-94cc-29d82cae6941 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:13.550854 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88130423-73c5-4eac-94cc-29d82cae6941 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:13.576341 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88130423-73c5-4eac-94cc-29d82cae6941 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:13.585409 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 420/840] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:25:13 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:25:13.591279 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf607f-1db2-4fea-b5e6-584776920c1d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:13.600383 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf607f-1db2-4fea-b5e6-584776920c1d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:13.604368 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59453bba-6f9d-4950-9b81-5e9fb6545153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:13.605138 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59453bba-6f9d-4950-9b81-5e9fb6545153 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:13.605423 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59453bba-6f9d-4950-9b81-5e9fb6545153 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:13.605700 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59453bba-6f9d-4950-9b81-5e9fb6545153 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:13.616796 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59453bba-6f9d-4950-9b81-5e9fb6545153 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:13.642313 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59453bba-6f9d-4950-9b81-5e9fb6545153 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:13.659094 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-59453bba-6f9d-4950-9b81-5e9fb6545153 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:13.660176 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 421/841] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:25:13.665985 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88130423-73c5-4eac-94cc-29d82cae6941 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:13.674810 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88130423-73c5-4eac-94cc-29d82cae6941 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:13.679474 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc76999-9860-4b8d-ad01-74a362cdf580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:13.680059 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc76999-9860-4b8d-ad01-74a362cdf580 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:13.680349 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc76999-9860-4b8d-ad01-74a362cdf580 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:13.680660 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc76999-9860-4b8d-ad01-74a362cdf580 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:13.681343 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc76999-9860-4b8d-ad01-74a362cdf580 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:13.681643 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc76999-9860-4b8d-ad01-74a362cdf580 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:13.707172 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc76999-9860-4b8d-ad01-74a362cdf580 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:13.720654 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 421/842] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:13.726113 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59453bba-6f9d-4950-9b81-5e9fb6545153 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:13.735225 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59453bba-6f9d-4950-9b81-5e9fb6545153 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:13.739162 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e8e4d-8dbf-410e-b086-57922dcb4aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:13.739856 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e8e4d-8dbf-410e-b086-57922dcb4aee admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:13.740139 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e8e4d-8dbf-410e-b086-57922dcb4aee admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:13.740412 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e8e4d-8dbf-410e-b086-57922dcb4aee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:13.749074 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e8e4d-8dbf-410e-b086-57922dcb4aee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:13.774669 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e8e4d-8dbf-410e-b086-57922dcb4aee admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:13.788371 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-1f6e8e4d-8dbf-410e-b086-57922dcb4aee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:25:13.789429 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 422/843] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:25:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:13.794870 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc76999-9860-4b8d-ad01-74a362cdf580 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:13.803798 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc76999-9860-4b8d-ad01-74a362cdf580 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:13.807932 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6a472-f955-4bfd-9364-a45a7d2814b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:13.808498 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6a472-f955-4bfd-9364-a45a7d2814b0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:13.808820 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6a472-f955-4bfd-9364-a45a7d2814b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:13.809105 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6a472-f955-4bfd-9364-a45a7d2814b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:13.809831 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6a472-f955-4bfd-9364-a45a7d2814b0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:13.810134 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6a472-f955-4bfd-9364-a45a7d2814b0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:13.835938 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6a472-f955-4bfd-9364-a45a7d2814b0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:13.848845 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 422/844] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:25:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:13.854306 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e8e4d-8dbf-410e-b086-57922dcb4aee admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:13.863208 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e8e4d-8dbf-410e-b086-57922dcb4aee admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:13.867135 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897b3bb-49ad-4820-8b0d-6d18471b9e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:13.867682 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897b3bb-49ad-4820-8b0d-6d18471b9e38 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:13.867962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897b3bb-49ad-4820-8b0d-6d18471b9e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:13.868236 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897b3bb-49ad-4820-8b0d-6d18471b9e38 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:13.869035 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897b3bb-49ad-4820-8b0d-6d18471b9e38 admin admin] RBAC: Adding query filter params (role.id=aa34949eb3ac4431991f6c257fca79a9, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=eedaf4b880f24ac48ee6e04b75059ef4) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:13.869334 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897b3bb-49ad-4820-8b0d-6d18471b9e38 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:13.895597 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897b3bb-49ad-4820-8b0d-6d18471b9e38 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:13.905651 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 423/845] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:25:13 2021] GET /identity/v3/role_assignments?user.id=eedaf4b880f24ac48ee6e04b75059ef4&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=aa34949eb3ac4431991f6c257fca79a9 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:15.835871 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f0192-773c-4303-a993-3f1e82413031 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:15.836361 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f0192-773c-4303-a993-3f1e82413031 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:15.836361 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f0192-773c-4303-a993-3f1e82413031 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:15.838052 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 423/846] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:15.843575 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03f1a6-d2b1-42e3-a780-072b5dc27a46 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:15.844207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03f1a6-d2b1-42e3-a780-072b5dc27a46 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:15.844397 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03f1a6-d2b1-42e3-a780-072b5dc27a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:15.866433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-9a03f1a6-d2b1-42e3-a780-072b5dc27a46 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:15.867541 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-9a03f1a6-d2b1-42e3-a780-072b5dc27a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:15.874117 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 424/847] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:15 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:15.895508 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f0192-773c-4303-a993-3f1e82413031 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:15.907535 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f0192-773c-4303-a993-3f1e82413031 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:15.911450 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbbcd7-7c4e-470e-bb2c-7db8c9cc86bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:15.912145 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbbcd7-7c4e-470e-bb2c-7db8c9cc86bc admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:15.912434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbbcd7-7c4e-470e-bb2c-7db8c9cc86bc admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:15.912751 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbbcd7-7c4e-470e-bb2c-7db8c9cc86bc admin admin] PATH_INFO: `/v3/services/network` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:15.913367 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbbcd7-7c4e-470e-bb2c-7db8c9cc86bc admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:15.938209 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbbcd7-7c4e-470e-bb2c-7db8c9cc86bc admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:15.948836 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-55cbbcd7-7c4e-470e-bb2c-7db8c9cc86bc admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 01:25:15.949866 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 424/848] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:25:15 2021] GET /identity/v3/services/network => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:15.955269 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03f1a6-d2b1-42e3-a780-072b5dc27a46 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:15.963528 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03f1a6-d2b1-42e3-a780-072b5dc27a46 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:15.967592 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82467304-21d2-4bca-b28f-09e239365bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:15.968154 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82467304-21d2-4bca-b28f-09e239365bbe admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:15.968438 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82467304-21d2-4bca-b28f-09e239365bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:15.968748 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82467304-21d2-4bca-b28f-09e239365bbe admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:15.969669 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82467304-21d2-4bca-b28f-09e239365bbe admin admin] RBAC: Adding query filter params (name=network) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:15.969960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82467304-21d2-4bca-b28f-09e239365bbe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:15.995925 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82467304-21d2-4bca-b28f-09e239365bbe admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:16.000490 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 425/849] 10.222.0.20 () {56 vars in 1134 bytes} [Mon Aug 23 01:25:15 2021] GET /identity/v3/services?name=network => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:16.005707 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbbcd7-7c4e-470e-bb2c-7db8c9cc86bc admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:16.014631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbbcd7-7c4e-470e-bb2c-7db8c9cc86bc admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:16.018616 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58a457-549f-452e-b517-52a864e405d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:16.019171 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58a457-549f-452e-b517-52a864e405d5 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:16.019461 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58a457-549f-452e-b517-52a864e405d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:16.019743 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58a457-549f-452e-b517-52a864e405d5 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:16.020386 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58a457-549f-452e-b517-52a864e405d5 admin admin] RBAC: Adding query filter params (type=network) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:16.020717 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58a457-549f-452e-b517-52a864e405d5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:16.046043 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58a457-549f-452e-b517-52a864e405d5 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:16.050278 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 425/850] 10.222.0.20 () {56 vars in 1134 bytes} [Mon Aug 23 01:25:16 2021] GET /identity/v3/services?type=network => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:17.968070 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41e759-fae3-4c15-bfb7-e074d66c72b4 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:17.968628 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41e759-fae3-4c15-bfb7-e074d66c72b4 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:17.968734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41e759-fae3-4c15-bfb7-e074d66c72b4 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:17.970558 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 426/851] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:17.975561 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24580863-d103-40c9-be2e-2ae23edd17ba None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:17.975991 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24580863-d103-40c9-be2e-2ae23edd17ba None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:17.976129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24580863-d103-40c9-be2e-2ae23edd17ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:17.998611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-24580863-d103-40c9-be2e-2ae23edd17ba None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:17.999761 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-24580863-d103-40c9-be2e-2ae23edd17ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:18.006475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 426/852] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:17 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:25:18.028307 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41e759-fae3-4c15-bfb7-e074d66c72b4 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:18.039668 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41e759-fae3-4c15-bfb7-e074d66c72b4 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:18.044041 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee9e0e-f4e2-46b0-a21f-8a61314cd416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:18.044634 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee9e0e-f4e2-46b0-a21f-8a61314cd416 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:18.044922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee9e0e-f4e2-46b0-a21f-8a61314cd416 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:18.045200 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee9e0e-f4e2-46b0-a21f-8a61314cd416 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:18.045868 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee9e0e-f4e2-46b0-a21f-8a61314cd416 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:18.071374 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee9e0e-f4e2-46b0-a21f-8a61314cd416 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:18.154701 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 427/853] 10.222.0.20 () {60 vars in 1163 bytes} [Mon Aug 23 01:25:18 2021] POST /identity/v3/services => generated 240 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:25:20.093116 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28348f05-ac98-4eeb-b4ec-1a6fef6ecf3d None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:20.093636 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28348f05-ac98-4eeb-b4ec-1a6fef6ecf3d None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:20.093984 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28348f05-ac98-4eeb-b4ec-1a6fef6ecf3d None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:20.095591 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 427/854] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:20.100795 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43771789-29e5-41f3-83b2-2a225dc67144 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:20.101203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43771789-29e5-41f3-83b2-2a225dc67144 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:20.101374 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43771789-29e5-41f3-83b2-2a225dc67144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:20.124241 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-43771789-29e5-41f3-83b2-2a225dc67144 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:20.125433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-43771789-29e5-41f3-83b2-2a225dc67144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:20.142342 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 428/855] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:20 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:20.164864 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28348f05-ac98-4eeb-b4ec-1a6fef6ecf3d None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:20.177910 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28348f05-ac98-4eeb-b4ec-1a6fef6ecf3d None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:20.181894 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85547a-fedf-4f7f-b0e2-f0781c39f4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:20.182598 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85547a-fedf-4f7f-b0e2-f0781c39f4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:20.182885 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85547a-fedf-4f7f-b0e2-f0781c39f4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:20.183257 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85547a-fedf-4f7f-b0e2-f0781c39f4c1 admin admin] PATH_INFO: `/v3/services/network` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:20.183926 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85547a-fedf-4f7f-b0e2-f0781c39f4c1 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:20.210889 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85547a-fedf-4f7f-b0e2-f0781c39f4c1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:20.221793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-dd85547a-fedf-4f7f-b0e2-f0781c39f4c1 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 01:25:20.222827 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 428/856] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:25:20 2021] GET /identity/v3/services/network => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:20.228578 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43771789-29e5-41f3-83b2-2a225dc67144 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:20.237620 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43771789-29e5-41f3-83b2-2a225dc67144 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:20.241624 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592c604-c667-489b-a6ec-c67d50c2a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:20.242198 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592c604-c667-489b-a6ec-c67d50c2a458 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:20.242482 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592c604-c667-489b-a6ec-c67d50c2a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:20.242760 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592c604-c667-489b-a6ec-c67d50c2a458 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:20.243426 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592c604-c667-489b-a6ec-c67d50c2a458 admin admin] RBAC: Adding query filter params (name=network) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:20.243720 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592c604-c667-489b-a6ec-c67d50c2a458 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:20.269376 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592c604-c667-489b-a6ec-c67d50c2a458 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:20.273974 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 429/857] 10.222.0.20 () {56 vars in 1134 bytes} [Mon Aug 23 01:25:20 2021] GET /identity/v3/services?name=network => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:20.279807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85547a-fedf-4f7f-b0e2-f0781c39f4c1 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:20.288741 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85547a-fedf-4f7f-b0e2-f0781c39f4c1 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:20.292750 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdab77b-6fc1-4bbc-85f0-58b36c7093ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:20.293311 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdab77b-6fc1-4bbc-85f0-58b36c7093ce admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:20.293600 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdab77b-6fc1-4bbc-85f0-58b36c7093ce admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:20.293882 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdab77b-6fc1-4bbc-85f0-58b36c7093ce admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:20.294536 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdab77b-6fc1-4bbc-85f0-58b36c7093ce admin admin] RBAC: Adding query filter params (type=network) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:20.294834 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdab77b-6fc1-4bbc-85f0-58b36c7093ce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:20.319570 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdab77b-6fc1-4bbc-85f0-58b36c7093ce admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:20.324518 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 429/858] 10.222.0.20 () {56 vars in 1134 bytes} [Mon Aug 23 01:25:20 2021] GET /identity/v3/services?type=network => generated 350 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:20.329804 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592c604-c667-489b-a6ec-c67d50c2a458 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:20.339157 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592c604-c667-489b-a6ec-c67d50c2a458 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:20.343189 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb849f55-0702-43fc-bc1a-7dbb0e0e99c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:20.343686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb849f55-0702-43fc-bc1a-7dbb0e0e99c8 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:20.344230 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb849f55-0702-43fc-bc1a-7dbb0e0e99c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:20.344506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb849f55-0702-43fc-bc1a-7dbb0e0e99c8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:20.345260 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb849f55-0702-43fc-bc1a-7dbb0e0e99c8 admin admin] RBAC: Adding query filter params (interface=public, service_id=31d34bfb18374537aaabd91c19617fda, region_id=RegionOne) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:20.345554 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb849f55-0702-43fc-bc1a-7dbb0e0e99c8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:20.370336 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb849f55-0702-43fc-bc1a-7dbb0e0e99c8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:20.375336 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 430/859] 10.222.0.20 () {56 vars in 1273 bytes} [Mon Aug 23 01:25:20 2021] GET /identity/v3/endpoints?service_id=31d34bfb18374537aaabd91c19617fda&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:20.380242 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdab77b-6fc1-4bbc-85f0-58b36c7093ce admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:20.389641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdab77b-6fc1-4bbc-85f0-58b36c7093ce admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:20.397541 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e782d0-a156-4ecd-9170-e9cbb909c178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:20.398170 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e782d0-a156-4ecd-9170-e9cbb909c178 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:20.398459 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e782d0-a156-4ecd-9170-e9cbb909c178 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:20.398739 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e782d0-a156-4ecd-9170-e9cbb909c178 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:20.399390 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e782d0-a156-4ecd-9170-e9cbb909c178 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:20.425072 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e782d0-a156-4ecd-9170-e9cbb909c178 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:20.433704 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 430/860] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 23 01:25:20 2021] GET /identity/v3/services => generated 1967 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:25:22.353098 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22f75f-4e55-4ae0-a5f3-d704944476ac None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:22.353662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22f75f-4e55-4ae0-a5f3-d704944476ac None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:22.353662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22f75f-4e55-4ae0-a5f3-d704944476ac None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:22.355889 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 431/861] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:22.360836 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d1682-0cf0-4c9a-958b-cf92e5892600 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:22.361259 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d1682-0cf0-4c9a-958b-cf92e5892600 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:22.361407 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d1682-0cf0-4c9a-958b-cf92e5892600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:22.383342 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-4a7d1682-0cf0-4c9a-958b-cf92e5892600 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:22.384457 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-4a7d1682-0cf0-4c9a-958b-cf92e5892600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:22.391182 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 431/862] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:22 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:22.413344 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22f75f-4e55-4ae0-a5f3-d704944476ac None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:22.425475 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22f75f-4e55-4ae0-a5f3-d704944476ac None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:22.429423 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44216c1-5d9f-43a4-9d54-4f5deae74bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:22.430124 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44216c1-5d9f-43a4-9d54-4f5deae74bfd admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:22.430412 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44216c1-5d9f-43a4-9d54-4f5deae74bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:22.430694 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44216c1-5d9f-43a4-9d54-4f5deae74bfd admin admin] PATH_INFO: `/v3/services/network` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:22.431311 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44216c1-5d9f-43a4-9d54-4f5deae74bfd admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:22.456437 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44216c1-5d9f-43a4-9d54-4f5deae74bfd admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:22.467073 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-e44216c1-5d9f-43a4-9d54-4f5deae74bfd admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 01:25:22.468110 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 432/863] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:25:22 2021] GET /identity/v3/services/network => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:22.473968 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d1682-0cf0-4c9a-958b-cf92e5892600 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:22.483015 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d1682-0cf0-4c9a-958b-cf92e5892600 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:22.487061 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92d6d8-9e3a-4f46-8a3d-582e9793bdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:22.487637 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92d6d8-9e3a-4f46-8a3d-582e9793bdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:22.487925 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92d6d8-9e3a-4f46-8a3d-582e9793bdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:22.488207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92d6d8-9e3a-4f46-8a3d-582e9793bdb6 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:22.488904 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92d6d8-9e3a-4f46-8a3d-582e9793bdb6 admin admin] RBAC: Adding query filter params (name=network) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:22.489208 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92d6d8-9e3a-4f46-8a3d-582e9793bdb6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:22.514511 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92d6d8-9e3a-4f46-8a3d-582e9793bdb6 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:22.519131 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 432/864] 10.222.0.20 () {56 vars in 1134 bytes} [Mon Aug 23 01:25:22 2021] GET /identity/v3/services?name=network => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:22.524329 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44216c1-5d9f-43a4-9d54-4f5deae74bfd admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:22.533900 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44216c1-5d9f-43a4-9d54-4f5deae74bfd admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:22.537971 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352b54d-dbb1-462d-9846-76e61faf3d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:22.538532 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352b54d-dbb1-462d-9846-76e61faf3d33 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:22.538821 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352b54d-dbb1-462d-9846-76e61faf3d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:22.539103 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352b54d-dbb1-462d-9846-76e61faf3d33 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:22.539760 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352b54d-dbb1-462d-9846-76e61faf3d33 admin admin] RBAC: Adding query filter params (type=network) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:22.540058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352b54d-dbb1-462d-9846-76e61faf3d33 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:22.566222 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352b54d-dbb1-462d-9846-76e61faf3d33 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:22.570890 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 433/865] 10.222.0.20 () {56 vars in 1134 bytes} [Mon Aug 23 01:25:22 2021] GET /identity/v3/services?type=network => generated 350 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:25:22.576363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92d6d8-9e3a-4f46-8a3d-582e9793bdb6 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:22.585188 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92d6d8-9e3a-4f46-8a3d-582e9793bdb6 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:22.589754 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e800d-1610-44eb-a5ff-2d25365b4bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:22.590307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e800d-1610-44eb-a5ff-2d25365b4bcc admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:22.590591 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e800d-1610-44eb-a5ff-2d25365b4bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:22.590871 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e800d-1610-44eb-a5ff-2d25365b4bcc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:22.591543 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e800d-1610-44eb-a5ff-2d25365b4bcc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:22.616470 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e800d-1610-44eb-a5ff-2d25365b4bcc admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:22.708534 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 433/866] 10.222.0.20 () {60 vars in 1166 bytes} [Mon Aug 23 01:25:22 2021] POST /identity/v3/endpoints => generated 327 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:25:24.706661 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd5247-4680-4091-b3c2-3374f88179e9 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:24.707151 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd5247-4680-4091-b3c2-3374f88179e9 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:24.707151 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd5247-4680-4091-b3c2-3374f88179e9 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:24.708862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 434/867] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:24.714501 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacec377-f965-4006-a508-a71d534d014b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:24.714910 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacec377-f965-4006-a508-a71d534d014b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:24.715070 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacec377-f965-4006-a508-a71d534d014b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:24.737699 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-eacec377-f965-4006-a508-a71d534d014b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:24.738823 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-eacec377-f965-4006-a508-a71d534d014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:24.755929 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 434/868] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:24 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:24.778829 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd5247-4680-4091-b3c2-3374f88179e9 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:24.790173 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd5247-4680-4091-b3c2-3374f88179e9 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:24.794080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80276f-ff1b-49c2-a11b-4e320815cd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:24.794658 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80276f-ff1b-49c2-a11b-4e320815cd46 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:24.794944 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80276f-ff1b-49c2-a11b-4e320815cd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:24.795224 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80276f-ff1b-49c2-a11b-4e320815cd46 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:24.795918 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80276f-ff1b-49c2-a11b-4e320815cd46 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:24.820814 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80276f-ff1b-49c2-a11b-4e320815cd46 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:24.865358 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.sql.core [None req-ae80276f-ff1b-49c2-a11b-4e320815cd46 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 01:25:24.865358 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 01:25:24.865358 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [parameters: {'id': '7b860ffaf67043f294e55320e5c80402', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 01:25:24.865358 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=60175) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Aug 23 01:25:24.872445 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-ae80276f-ff1b-49c2-a11b-4e320815cd46 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 01:25:24.873587 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 435/869] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:25:24 2021] POST /identity/v3/roles => generated 144 bytes in 95 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:24.879427 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacec377-f965-4006-a508-a71d534d014b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:24.888410 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacec377-f965-4006-a508-a71d534d014b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:24.892483 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c2c2c-4ca6-4653-b85e-33292c696044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:24.896794 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c2c2c-4ca6-4653-b85e-33292c696044 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:24.896794 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c2c2c-4ca6-4653-b85e-33292c696044 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:24.896794 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c2c2c-4ca6-4653-b85e-33292c696044 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:24.905335 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c2c2c-4ca6-4653-b85e-33292c696044 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:25:24.911915 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-918c2c2c-4ca6-4653-b85e-33292c696044 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 01:25:24.912993 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 435/870] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Aug 23 01:25:24 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:25:24.918498 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80276f-ff1b-49c2-a11b-4e320815cd46 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:24.927511 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80276f-ff1b-49c2-a11b-4e320815cd46 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:24.931559 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691738ca-9af9-4d47-b823-4a4dc16d2d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:24.932119 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691738ca-9af9-4d47-b823-4a4dc16d2d42 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:24.932400 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691738ca-9af9-4d47-b823-4a4dc16d2d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:24.932723 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691738ca-9af9-4d47-b823-4a4dc16d2d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:24.933421 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691738ca-9af9-4d47-b823-4a4dc16d2d42 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:24.933715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691738ca-9af9-4d47-b823-4a4dc16d2d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:24.959101 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691738ca-9af9-4d47-b823-4a4dc16d2d42 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:24.967672 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 436/871] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:25:24 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:26.910257 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002cb63-de18-4c29-a454-6b7371350e2a None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:26.910794 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002cb63-de18-4c29-a454-6b7371350e2a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:26.910880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002cb63-de18-4c29-a454-6b7371350e2a None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:26.912526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 436/872] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 01:25:26.917545 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827fd83-a89b-425f-8666-629cf7d1b6cd None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:26.918552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827fd83-a89b-425f-8666-629cf7d1b6cd None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:26.918687 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827fd83-a89b-425f-8666-629cf7d1b6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:26.940570 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-b827fd83-a89b-425f-8666-629cf7d1b6cd None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:26.941715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-b827fd83-a89b-425f-8666-629cf7d1b6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:26.948442 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 437/873] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:26.972788 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002cb63-de18-4c29-a454-6b7371350e2a None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:26.984987 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002cb63-de18-4c29-a454-6b7371350e2a None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:26.988955 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d57f69-c0a0-4b28-9335-0f28297572cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:26.989650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57f69-c0a0-4b28-9335-0f28297572cc admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:26.989937 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57f69-c0a0-4b28-9335-0f28297572cc admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:26.990216 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57f69-c0a0-4b28-9335-0f28297572cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:27.001088 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d57f69-c0a0-4b28-9335-0f28297572cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:27.026623 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d57f69-c0a0-4b28-9335-0f28297572cc admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:27.044141 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-e3d57f69-c0a0-4b28-9335-0f28297572cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:27.045210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 437/874] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:25:27.050871 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827fd83-a89b-425f-8666-629cf7d1b6cd None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:27.059835 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827fd83-a89b-425f-8666-629cf7d1b6cd None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:27.063886 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298018ce-b463-46a2-8880-b7cf10646bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:27.064462 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298018ce-b463-46a2-8880-b7cf10646bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:27.064779 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298018ce-b463-46a2-8880-b7cf10646bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:27.065060 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298018ce-b463-46a2-8880-b7cf10646bc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:27.065738 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298018ce-b463-46a2-8880-b7cf10646bc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:27.066034 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298018ce-b463-46a2-8880-b7cf10646bc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:27.090994 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298018ce-b463-46a2-8880-b7cf10646bc1 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:27.103479 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 438/875] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:27.109269 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d57f69-c0a0-4b28-9335-0f28297572cc admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:27.118129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d57f69-c0a0-4b28-9335-0f28297572cc admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:27.122717 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adb747-51e8-47e7-962e-4f4137a931ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:27.123282 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adb747-51e8-47e7-962e-4f4137a931ad admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:27.123564 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adb747-51e8-47e7-962e-4f4137a931ad admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:27.123843 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adb747-51e8-47e7-962e-4f4137a931ad admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:27.124478 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3adb747-51e8-47e7-962e-4f4137a931ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:27.149440 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3adb747-51e8-47e7-962e-4f4137a931ad admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:27.222803 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 438/876] 10.222.0.20 () {60 vars in 1154 bytes} [Mon Aug 23 01:25:27 2021] POST /identity/v3/users => generated 247 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:25:29.172833 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9961109-fb79-493c-af8c-620e2029d0d5 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:29.173377 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9961109-fb79-493c-af8c-620e2029d0d5 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:29.173377 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9961109-fb79-493c-af8c-620e2029d0d5 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:29.175064 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 439/877] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:29.180017 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f413d-4783-43dd-a9a3-d2f52f483538 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:29.180400 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f413d-4783-43dd-a9a3-d2f52f483538 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:29.180605 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f413d-4783-43dd-a9a3-d2f52f483538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:29.203059 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-cc6f413d-4783-43dd-a9a3-d2f52f483538 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:29.204172 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-cc6f413d-4783-43dd-a9a3-d2f52f483538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:29.210872 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 439/878] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:29 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:29.233334 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9961109-fb79-493c-af8c-620e2029d0d5 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:29.244828 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9961109-fb79-493c-af8c-620e2029d0d5 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:29.249438 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a78e51-b4ac-4f7c-ac29-0c64aa3f10aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:29.250136 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a78e51-b4ac-4f7c-ac29-0c64aa3f10aa admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:29.250425 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a78e51-b4ac-4f7c-ac29-0c64aa3f10aa admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:29.250707 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a78e51-b4ac-4f7c-ac29-0c64aa3f10aa admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:29.261662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a78e51-b4ac-4f7c-ac29-0c64aa3f10aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:25:29.267993 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-61a78e51-b4ac-4f7c-ac29-0c64aa3f10aa admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:25:29.269073 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 440/879] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:25:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:25:29.274560 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f413d-4783-43dd-a9a3-d2f52f483538 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:29.282794 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f413d-4783-43dd-a9a3-d2f52f483538 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:29.286797 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b3376-30b3-45db-b207-a808fbba13db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:29.287373 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b3376-30b3-45db-b207-a808fbba13db admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:29.287659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b3376-30b3-45db-b207-a808fbba13db admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:29.287936 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b3376-30b3-45db-b207-a808fbba13db admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:29.288674 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b3376-30b3-45db-b207-a808fbba13db admin admin] RBAC: Adding query filter params (name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:29.288972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b3376-30b3-45db-b207-a808fbba13db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:29.314920 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b3376-30b3-45db-b207-a808fbba13db admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:29.322922 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 440/880] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:25:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:29.328147 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a78e51-b4ac-4f7c-ac29-0c64aa3f10aa admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:29.337541 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a78e51-b4ac-4f7c-ac29-0c64aa3f10aa admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:29.341588 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5608cf4-d54e-487f-bda1-47e873a58e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:29.342292 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5608cf4-d54e-487f-bda1-47e873a58e73 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:29.342583 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5608cf4-d54e-487f-bda1-47e873a58e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:29.342864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5608cf4-d54e-487f-bda1-47e873a58e73 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:29.353949 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5608cf4-d54e-487f-bda1-47e873a58e73 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:29.380255 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5608cf4-d54e-487f-bda1-47e873a58e73 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:29.397592 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-f5608cf4-d54e-487f-bda1-47e873a58e73 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:29.398659 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 441/881] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:29.404092 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b3376-30b3-45db-b207-a808fbba13db admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:29.413145 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b3376-30b3-45db-b207-a808fbba13db admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:29.417190 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93875468-8730-4f67-aa9e-0bafc7c00eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:29.418254 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93875468-8730-4f67-aa9e-0bafc7c00eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:29.418606 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93875468-8730-4f67-aa9e-0bafc7c00eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:29.418888 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93875468-8730-4f67-aa9e-0bafc7c00eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:29.419564 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93875468-8730-4f67-aa9e-0bafc7c00eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:29.419862 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93875468-8730-4f67-aa9e-0bafc7c00eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:29.445376 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93875468-8730-4f67-aa9e-0bafc7c00eb4 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:29.458825 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 441/882] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:29.464413 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5608cf4-d54e-487f-bda1-47e873a58e73 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:29.473862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5608cf4-d54e-487f-bda1-47e873a58e73 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:29.477940 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c43b49-8a3e-4499-a76c-0fb5af37b91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:29.478639 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c43b49-8a3e-4499-a76c-0fb5af37b91e admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:29.478926 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c43b49-8a3e-4499-a76c-0fb5af37b91e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:29.479205 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c43b49-8a3e-4499-a76c-0fb5af37b91e admin admin] PATH_INFO: `/v3/users/swift` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:29.491938 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c43b49-8a3e-4499-a76c-0fb5af37b91e admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:29.518139 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c43b49-8a3e-4499-a76c-0fb5af37b91e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:29.535018 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-64c43b49-8a3e-4499-a76c-0fb5af37b91e admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 01:25:29.536056 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 442/883] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:25:29 2021] GET /identity/v3/users/swift => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:25:29.541429 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93875468-8730-4f67-aa9e-0bafc7c00eb4 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:29.550828 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93875468-8730-4f67-aa9e-0bafc7c00eb4 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:29.554975 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e34e1-b4f2-44f9-bd7b-b0e8640cb71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:29.555548 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e34e1-b4f2-44f9-bd7b-b0e8640cb71b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:29.555831 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e34e1-b4f2-44f9-bd7b-b0e8640cb71b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:29.556107 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e34e1-b4f2-44f9-bd7b-b0e8640cb71b admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:29.556906 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e34e1-b4f2-44f9-bd7b-b0e8640cb71b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:29.557210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e34e1-b4f2-44f9-bd7b-b0e8640cb71b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:29.582938 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e34e1-b4f2-44f9-bd7b-b0e8640cb71b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:29.612057 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 442/884] 10.222.0.20 () {56 vars in 1157 bytes} [Mon Aug 23 01:25:29 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:29.617446 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c43b49-8a3e-4499-a76c-0fb5af37b91e admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:29.626878 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c43b49-8a3e-4499-a76c-0fb5af37b91e admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:29.630821 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfac557-7e40-4986-a7f7-6a53e7a6c635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:29.631367 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfac557-7e40-4986-a7f7-6a53e7a6c635 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:29.631650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfac557-7e40-4986-a7f7-6a53e7a6c635 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:29.631923 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfac557-7e40-4986-a7f7-6a53e7a6c635 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:29.639863 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfac557-7e40-4986-a7f7-6a53e7a6c635 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:29.664646 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfac557-7e40-4986-a7f7-6a53e7a6c635 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:29.673585 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 443/885] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:25:29 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:25:29.678810 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e34e1-b4f2-44f9-bd7b-b0e8640cb71b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:29.688127 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e34e1-b4f2-44f9-bd7b-b0e8640cb71b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:29.692135 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d4e2c-4d13-4a9c-a775-562215c2bdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:29.692853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d4e2c-4d13-4a9c-a775-562215c2bdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:29.693138 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d4e2c-4d13-4a9c-a775-562215c2bdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:29.693417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d4e2c-4d13-4a9c-a775-562215c2bdd0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:29.705473 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d4e2c-4d13-4a9c-a775-562215c2bdd0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:29.731047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d4e2c-4d13-4a9c-a775-562215c2bdd0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:29.747631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-3e1d4e2c-4d13-4a9c-a775-562215c2bdd0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:29.748680 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 443/886] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:29.753900 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfac557-7e40-4986-a7f7-6a53e7a6c635 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:29.762795 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfac557-7e40-4986-a7f7-6a53e7a6c635 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:29.766962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9251ca-b5e4-4b53-9af1-1e7415c8c3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:29.767530 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9251ca-b5e4-4b53-9af1-1e7415c8c3ff admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:29.767819 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9251ca-b5e4-4b53-9af1-1e7415c8c3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:29.768106 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9251ca-b5e4-4b53-9af1-1e7415c8c3ff admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:29.768817 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9251ca-b5e4-4b53-9af1-1e7415c8c3ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:29.769117 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9251ca-b5e4-4b53-9af1-1e7415c8c3ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:29.794077 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9251ca-b5e4-4b53-9af1-1e7415c8c3ff admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:29.805893 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 444/887] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:29.811191 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d4e2c-4d13-4a9c-a775-562215c2bdd0 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:29.820004 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d4e2c-4d13-4a9c-a775-562215c2bdd0 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:29.823969 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b04f9-df6d-4567-b07e-2c56503ad564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:29.825214 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b04f9-df6d-4567-b07e-2c56503ad564 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:29.825498 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b04f9-df6d-4567-b07e-2c56503ad564 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:29.825777 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b04f9-df6d-4567-b07e-2c56503ad564 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:29.834788 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b04f9-df6d-4567-b07e-2c56503ad564 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:29.860015 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b04f9-df6d-4567-b07e-2c56503ad564 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:29.873608 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-a65b04f9-df6d-4567-b07e-2c56503ad564 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:25:29.874657 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 444/888] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:25:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:29.879877 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9251ca-b5e4-4b53-9af1-1e7415c8c3ff admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:29.889407 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9251ca-b5e4-4b53-9af1-1e7415c8c3ff admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:29.893619 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1bdd4-ce89-4834-b8b9-4c8fbbe9e5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:29.898803 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1bdd4-ce89-4834-b8b9-4c8fbbe9e5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:29.898803 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1bdd4-ce89-4834-b8b9-4c8fbbe9e5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:29.898803 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1bdd4-ce89-4834-b8b9-4c8fbbe9e5f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:29.898803 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1bdd4-ce89-4834-b8b9-4c8fbbe9e5f3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:29.898803 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1bdd4-ce89-4834-b8b9-4c8fbbe9e5f3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:29.921880 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1bdd4-ce89-4834-b8b9-4c8fbbe9e5f3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:29.935278 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 445/889] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:25:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:25:29.940834 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b04f9-df6d-4567-b07e-2c56503ad564 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:29.949721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b04f9-df6d-4567-b07e-2c56503ad564 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:29.953719 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e7124-d08d-4b69-a46e-25fd55388c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:29.954276 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e7124-d08d-4b69-a46e-25fd55388c08 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:29.954560 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e7124-d08d-4b69-a46e-25fd55388c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:29.954837 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e7124-d08d-4b69-a46e-25fd55388c08 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:29.955636 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e7124-d08d-4b69-a46e-25fd55388c08 admin admin] RBAC: Adding query filter params (role.id=aa34949eb3ac4431991f6c257fca79a9, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=82e4cab3c8cb4a18bf3c1a8a85d1675c) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:29.955890 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e7124-d08d-4b69-a46e-25fd55388c08 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:29.981647 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e7124-d08d-4b69-a46e-25fd55388c08 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:29.986726 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 445/890] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:25:29 2021] GET /identity/v3/role_assignments?user.id=82e4cab3c8cb4a18bf3c1a8a85d1675c&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=aa34949eb3ac4431991f6c257fca79a9 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:31.869768 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad08d0a-34fd-403c-abdb-897c522983e4 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:31.870257 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad08d0a-34fd-403c-abdb-897c522983e4 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:31.870257 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad08d0a-34fd-403c-abdb-897c522983e4 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:31.872408 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 446/891] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:31.877729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5694567-93fe-4b3c-96b3-e4c5e3567ce5 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:31.878164 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5694567-93fe-4b3c-96b3-e4c5e3567ce5 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:31.878296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5694567-93fe-4b3c-96b3-e4c5e3567ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:31.900898 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-b5694567-93fe-4b3c-96b3-e4c5e3567ce5 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:31.902046 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-b5694567-93fe-4b3c-96b3-e4c5e3567ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:31.908669 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 446/892] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:31 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:31.930082 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad08d0a-34fd-403c-abdb-897c522983e4 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:31.941972 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad08d0a-34fd-403c-abdb-897c522983e4 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:31.945871 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e080e17-c53f-4287-9010-fa41a8e186c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:31.946564 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e080e17-c53f-4287-9010-fa41a8e186c3 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:31.946851 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e080e17-c53f-4287-9010-fa41a8e186c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:31.947131 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e080e17-c53f-4287-9010-fa41a8e186c3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:31.958544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e080e17-c53f-4287-9010-fa41a8e186c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:25:31.964900 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-0e080e17-c53f-4287-9010-fa41a8e186c3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:25:31.965951 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 447/893] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:25:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:31.971607 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5694567-93fe-4b3c-96b3-e4c5e3567ce5 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:31.979919 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5694567-93fe-4b3c-96b3-e4c5e3567ce5 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:31.983926 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728fc76-8147-4cc8-b0cf-c71037054af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:31.984502 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728fc76-8147-4cc8-b0cf-c71037054af7 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:31.984824 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728fc76-8147-4cc8-b0cf-c71037054af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:31.985138 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728fc76-8147-4cc8-b0cf-c71037054af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:31.985835 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728fc76-8147-4cc8-b0cf-c71037054af7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:31.986135 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728fc76-8147-4cc8-b0cf-c71037054af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:32.012079 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728fc76-8147-4cc8-b0cf-c71037054af7 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:32.020157 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 447/894] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:25:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:32.025590 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e080e17-c53f-4287-9010-fa41a8e186c3 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:32.034903 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e080e17-c53f-4287-9010-fa41a8e186c3 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:32.038924 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df19f8-8294-4b71-9e81-f94ef7b3eb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:32.039597 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df19f8-8294-4b71-9e81-f94ef7b3eb57 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:32.039878 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df19f8-8294-4b71-9e81-f94ef7b3eb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:32.040150 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df19f8-8294-4b71-9e81-f94ef7b3eb57 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:32.051780 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df19f8-8294-4b71-9e81-f94ef7b3eb57 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:32.078036 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df19f8-8294-4b71-9e81-f94ef7b3eb57 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:32.095048 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-d2df19f8-8294-4b71-9e81-f94ef7b3eb57 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:32.096071 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 448/895] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:32.101392 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728fc76-8147-4cc8-b0cf-c71037054af7 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:32.110304 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728fc76-8147-4cc8-b0cf-c71037054af7 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:32.114389 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae213d65-6dbc-4717-bc92-82bf2b43209c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:32.114957 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae213d65-6dbc-4717-bc92-82bf2b43209c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:32.115250 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae213d65-6dbc-4717-bc92-82bf2b43209c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:32.115534 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae213d65-6dbc-4717-bc92-82bf2b43209c admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:32.116203 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae213d65-6dbc-4717-bc92-82bf2b43209c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:32.116505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae213d65-6dbc-4717-bc92-82bf2b43209c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:32.142461 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae213d65-6dbc-4717-bc92-82bf2b43209c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:32.154733 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 448/896] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:32.159957 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df19f8-8294-4b71-9e81-f94ef7b3eb57 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:32.169560 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df19f8-8294-4b71-9e81-f94ef7b3eb57 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:32.173602 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45220ee9-9a66-4c93-88fb-1c446969af93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:32.174292 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45220ee9-9a66-4c93-88fb-1c446969af93 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:32.174582 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45220ee9-9a66-4c93-88fb-1c446969af93 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:32.174858 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45220ee9-9a66-4c93-88fb-1c446969af93 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:32.188015 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45220ee9-9a66-4c93-88fb-1c446969af93 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:32.213469 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45220ee9-9a66-4c93-88fb-1c446969af93 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:32.231578 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-45220ee9-9a66-4c93-88fb-1c446969af93 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 01:25:32.232678 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 449/897] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:25:32 2021] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:32.238315 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae213d65-6dbc-4717-bc92-82bf2b43209c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:32.248024 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae213d65-6dbc-4717-bc92-82bf2b43209c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:32.252094 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef7dd5-e579-449d-9a12-b98d5e124abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:32.252719 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef7dd5-e579-449d-9a12-b98d5e124abc admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:32.253012 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef7dd5-e579-449d-9a12-b98d5e124abc admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:32.253294 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef7dd5-e579-449d-9a12-b98d5e124abc admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:32.254077 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef7dd5-e579-449d-9a12-b98d5e124abc admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:32.254381 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef7dd5-e579-449d-9a12-b98d5e124abc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:32.279646 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef7dd5-e579-449d-9a12-b98d5e124abc admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:32.307665 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 449/898] 10.222.0.20 () {56 vars in 1157 bytes} [Mon Aug 23 01:25:32 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:32.313461 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45220ee9-9a66-4c93-88fb-1c446969af93 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:32.322506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45220ee9-9a66-4c93-88fb-1c446969af93 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:32.326518 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8c61c-e610-43cd-aa8c-67d19a686f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:32.327234 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8c61c-e610-43cd-aa8c-67d19a686f25 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:32.327520 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8c61c-e610-43cd-aa8c-67d19a686f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:32.327797 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8c61c-e610-43cd-aa8c-67d19a686f25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:32.339980 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8c61c-e610-43cd-aa8c-67d19a686f25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:32.365910 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8c61c-e610-43cd-aa8c-67d19a686f25 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:32.382717 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-33c8c61c-e610-43cd-aa8c-67d19a686f25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:32.383768 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 450/899] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:32.389178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef7dd5-e579-449d-9a12-b98d5e124abc admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:32.398281 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef7dd5-e579-449d-9a12-b98d5e124abc admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:32.402307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11d0e3-2fc9-42b9-9de8-75f7f0f65bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:32.402880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11d0e3-2fc9-42b9-9de8-75f7f0f65bcd admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:32.403171 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11d0e3-2fc9-42b9-9de8-75f7f0f65bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:32.403456 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11d0e3-2fc9-42b9-9de8-75f7f0f65bcd admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:32.404129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11d0e3-2fc9-42b9-9de8-75f7f0f65bcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:32.404426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11d0e3-2fc9-42b9-9de8-75f7f0f65bcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:32.429987 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11d0e3-2fc9-42b9-9de8-75f7f0f65bcd admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:32.443014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 450/900] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:32.448345 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8c61c-e610-43cd-aa8c-67d19a686f25 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:32.457371 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8c61c-e610-43cd-aa8c-67d19a686f25 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:32.461347 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c4066-ef50-4e1f-9517-8c376e3612a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:32.462044 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c4066-ef50-4e1f-9517-8c376e3612a2 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:32.462326 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c4066-ef50-4e1f-9517-8c376e3612a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:32.462600 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c4066-ef50-4e1f-9517-8c376e3612a2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:32.474635 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c4066-ef50-4e1f-9517-8c376e3612a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:32.514249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c4066-ef50-4e1f-9517-8c376e3612a2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:32.530314 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-4b6c4066-ef50-4e1f-9517-8c376e3612a2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:25:32.531452 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 451/901] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:25:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:32.537338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11d0e3-2fc9-42b9-9de8-75f7f0f65bcd admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:32.547044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11d0e3-2fc9-42b9-9de8-75f7f0f65bcd admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:32.551089 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c3982-8258-4d44-8b3a-341b8d59163a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:32.551665 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c3982-8258-4d44-8b3a-341b8d59163a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:32.551950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c3982-8258-4d44-8b3a-341b8d59163a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:32.552229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c3982-8258-4d44-8b3a-341b8d59163a admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:32.552993 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c3982-8258-4d44-8b3a-341b8d59163a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:32.553294 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c3982-8258-4d44-8b3a-341b8d59163a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:32.579149 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c3982-8258-4d44-8b3a-341b8d59163a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:32.592083 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 451/902] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:25:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:25:32.597930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c4066-ef50-4e1f-9517-8c376e3612a2 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:32.607462 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c4066-ef50-4e1f-9517-8c376e3612a2 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:32.611411 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67b33b-cc60-4cef-afd8-c8332940e664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:32.612194 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67b33b-cc60-4cef-afd8-c8332940e664 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:32.612475 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67b33b-cc60-4cef-afd8-c8332940e664 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:32.612783 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67b33b-cc60-4cef-afd8-c8332940e664 admin admin] PATH_INFO: `/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/82e4cab3c8cb4a18bf3c1a8a85d1675c/roles/aa34949eb3ac4431991f6c257fca79a9` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:32.631994 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67b33b-cc60-4cef-afd8-c8332940e664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2728fddda1c4691b33daad4fa4ef3d2, user_id=82e4cab3c8cb4a18bf3c1a8a85d1675c, role_id=aa34949eb3ac4431991f6c257fca79a9)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:32.658657 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67b33b-cc60-4cef-afd8-c8332940e664 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:32.734011 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 452/903] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:25:32 2021] PUT /identity/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/82e4cab3c8cb4a18bf3c1a8a85d1675c/roles/aa34949eb3ac4431991f6c257fca79a9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:25:34.656032 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f790d-467a-4be2-9ff2-8fd09c39c5d2 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:34.656579 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f790d-467a-4be2-9ff2-8fd09c39c5d2 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:34.656685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f790d-467a-4be2-9ff2-8fd09c39c5d2 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:34.658320 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 452/904] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:34.663286 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9bf63-7965-4eec-ac74-544fdaeb6a43 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:34.663698 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9bf63-7965-4eec-ac74-544fdaeb6a43 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:34.663840 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9bf63-7965-4eec-ac74-544fdaeb6a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:34.686572 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-33d9bf63-7965-4eec-ac74-544fdaeb6a43 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:34.687614 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-33d9bf63-7965-4eec-ac74-544fdaeb6a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:34.748627 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 453/905] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:34 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:34.770662 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f790d-467a-4be2-9ff2-8fd09c39c5d2 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:34.782437 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f790d-467a-4be2-9ff2-8fd09c39c5d2 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:34.786345 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114dd0a-267e-4504-9737-be46f623a2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:34.787046 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114dd0a-267e-4504-9737-be46f623a2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:34.787326 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114dd0a-267e-4504-9737-be46f623a2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:34.787598 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114dd0a-267e-4504-9737-be46f623a2e3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:34.798985 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114dd0a-267e-4504-9737-be46f623a2e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:25:34.805175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-b114dd0a-267e-4504-9737-be46f623a2e3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:25:34.806226 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 453/906] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:25:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:25:34.812729 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9bf63-7965-4eec-ac74-544fdaeb6a43 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:34.821205 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9bf63-7965-4eec-ac74-544fdaeb6a43 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:34.825341 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8273b14-4be6-4c20-8ee5-25cde1e5d0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:34.825922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8273b14-4be6-4c20-8ee5-25cde1e5d0eb admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:34.826210 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8273b14-4be6-4c20-8ee5-25cde1e5d0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:34.826487 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8273b14-4be6-4c20-8ee5-25cde1e5d0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:34.827187 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8273b14-4be6-4c20-8ee5-25cde1e5d0eb admin admin] RBAC: Adding query filter params (name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:34.827484 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8273b14-4be6-4c20-8ee5-25cde1e5d0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:34.853330 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8273b14-4be6-4c20-8ee5-25cde1e5d0eb admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:34.862118 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 454/907] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:25:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:34.867543 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114dd0a-267e-4504-9737-be46f623a2e3 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:34.877356 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114dd0a-267e-4504-9737-be46f623a2e3 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:34.881460 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e6dec-8805-4606-9639-1e0005e785bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:34.882160 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e6dec-8805-4606-9639-1e0005e785bd admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:34.882449 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e6dec-8805-4606-9639-1e0005e785bd admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:34.882731 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e6dec-8805-4606-9639-1e0005e785bd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:34.893604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e6dec-8805-4606-9639-1e0005e785bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:34.920182 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e6dec-8805-4606-9639-1e0005e785bd admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:34.938456 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-6a7e6dec-8805-4606-9639-1e0005e785bd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:34.939446 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 454/908] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:34.944867 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8273b14-4be6-4c20-8ee5-25cde1e5d0eb admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:34.953829 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8273b14-4be6-4c20-8ee5-25cde1e5d0eb admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:34.957851 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c38be0-7fbe-4fc7-9749-3ff4584ee448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:34.958417 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c38be0-7fbe-4fc7-9749-3ff4584ee448 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:34.958706 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c38be0-7fbe-4fc7-9749-3ff4584ee448 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:34.958992 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c38be0-7fbe-4fc7-9749-3ff4584ee448 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:34.959664 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c38be0-7fbe-4fc7-9749-3ff4584ee448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:34.959962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c38be0-7fbe-4fc7-9749-3ff4584ee448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:34.986568 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c38be0-7fbe-4fc7-9749-3ff4584ee448 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:34.998839 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 455/909] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:35.004098 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e6dec-8805-4606-9639-1e0005e785bd admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:35.013076 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e6dec-8805-4606-9639-1e0005e785bd admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:35.017097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054f47c-2d78-4094-b300-e93888dc9eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:35.017786 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054f47c-2d78-4094-b300-e93888dc9eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:35.018073 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054f47c-2d78-4094-b300-e93888dc9eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:35.018353 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054f47c-2d78-4094-b300-e93888dc9eb8 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:35.117341 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054f47c-2d78-4094-b300-e93888dc9eb8 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:35.145909 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054f47c-2d78-4094-b300-e93888dc9eb8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:35.164699 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-9054f47c-2d78-4094-b300-e93888dc9eb8 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 01:25:35.165770 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 455/910] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:25:35 2021] GET /identity/v3/users/swift => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:35.172200 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c38be0-7fbe-4fc7-9749-3ff4584ee448 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:35.181336 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c38be0-7fbe-4fc7-9749-3ff4584ee448 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:35.185522 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e159d15-f5a8-467c-b39f-e1fe92831ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:35.186099 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e159d15-f5a8-467c-b39f-e1fe92831ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:35.186380 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e159d15-f5a8-467c-b39f-e1fe92831ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:35.186654 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e159d15-f5a8-467c-b39f-e1fe92831ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:35.187427 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e159d15-f5a8-467c-b39f-e1fe92831ee7 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:35.187723 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e159d15-f5a8-467c-b39f-e1fe92831ee7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:35.213351 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e159d15-f5a8-467c-b39f-e1fe92831ee7 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:35.241647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 456/911] 10.222.0.20 () {56 vars in 1157 bytes} [Mon Aug 23 01:25:35 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:35.247007 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054f47c-2d78-4094-b300-e93888dc9eb8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:35.255966 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054f47c-2d78-4094-b300-e93888dc9eb8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:35.259932 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fbb92-779e-491c-83d1-a3a389454988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:35.260486 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fbb92-779e-491c-83d1-a3a389454988 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:35.260801 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fbb92-779e-491c-83d1-a3a389454988 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:35.261078 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fbb92-779e-491c-83d1-a3a389454988 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:35.268941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fbb92-779e-491c-83d1-a3a389454988 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:35.294458 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fbb92-779e-491c-83d1-a3a389454988 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:35.302772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 456/912] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:25:35 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:25:35.308316 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e159d15-f5a8-467c-b39f-e1fe92831ee7 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:35.317289 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e159d15-f5a8-467c-b39f-e1fe92831ee7 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:35.321171 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d873e1-913f-4274-acb5-207dd570eb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:35.321898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d873e1-913f-4274-acb5-207dd570eb59 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:35.322186 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d873e1-913f-4274-acb5-207dd570eb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:35.322465 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d873e1-913f-4274-acb5-207dd570eb59 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:35.334095 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d873e1-913f-4274-acb5-207dd570eb59 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:35.359935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d873e1-913f-4274-acb5-207dd570eb59 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:35.376245 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-b9d873e1-913f-4274-acb5-207dd570eb59 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:35.377307 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 457/913] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:35.382504 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fbb92-779e-491c-83d1-a3a389454988 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:35.391241 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fbb92-779e-491c-83d1-a3a389454988 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:35.395222 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1858cf0-4147-4c63-a3ab-6af2a6bfdee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:35.395791 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1858cf0-4147-4c63-a3ab-6af2a6bfdee1 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:35.396075 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1858cf0-4147-4c63-a3ab-6af2a6bfdee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:35.396348 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1858cf0-4147-4c63-a3ab-6af2a6bfdee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:35.397043 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1858cf0-4147-4c63-a3ab-6af2a6bfdee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:35.397334 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1858cf0-4147-4c63-a3ab-6af2a6bfdee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:35.422729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1858cf0-4147-4c63-a3ab-6af2a6bfdee1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:35.435722 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 457/914] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:35.441476 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d873e1-913f-4274-acb5-207dd570eb59 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:35.451179 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d873e1-913f-4274-acb5-207dd570eb59 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:35.455180 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9953da-0093-43c5-bb26-77ed14c1ec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:35.455884 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9953da-0093-43c5-bb26-77ed14c1ec82 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:35.456170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9953da-0093-43c5-bb26-77ed14c1ec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:35.456447 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9953da-0093-43c5-bb26-77ed14c1ec82 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:35.465819 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9953da-0093-43c5-bb26-77ed14c1ec82 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:35.491289 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9953da-0093-43c5-bb26-77ed14c1ec82 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:35.504343 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-1e9953da-0093-43c5-bb26-77ed14c1ec82 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:25:35.505409 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 458/915] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:25:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:35.510782 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1858cf0-4147-4c63-a3ab-6af2a6bfdee1 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:35.520173 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1858cf0-4147-4c63-a3ab-6af2a6bfdee1 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:35.524207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4f296-cac1-4bca-93ff-b507a68f4ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:35.524804 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4f296-cac1-4bca-93ff-b507a68f4ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:35.525087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4f296-cac1-4bca-93ff-b507a68f4ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:35.525361 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4f296-cac1-4bca-93ff-b507a68f4ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:35.526079 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4f296-cac1-4bca-93ff-b507a68f4ea0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:35.526373 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4f296-cac1-4bca-93ff-b507a68f4ea0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:35.553433 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4f296-cac1-4bca-93ff-b507a68f4ea0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:35.567192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 458/916] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:25:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:25:35.573011 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9953da-0093-43c5-bb26-77ed14c1ec82 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:35.582857 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9953da-0093-43c5-bb26-77ed14c1ec82 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:35.586901 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac7c49-ec3e-4ca1-92a9-e11f8944d69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:35.587466 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac7c49-ec3e-4ca1-92a9-e11f8944d69b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:35.587753 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac7c49-ec3e-4ca1-92a9-e11f8944d69b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:35.588032 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac7c49-ec3e-4ca1-92a9-e11f8944d69b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:35.588840 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac7c49-ec3e-4ca1-92a9-e11f8944d69b admin admin] RBAC: Adding query filter params (role.id=aa34949eb3ac4431991f6c257fca79a9, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=82e4cab3c8cb4a18bf3c1a8a85d1675c) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:35.589143 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac7c49-ec3e-4ca1-92a9-e11f8944d69b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:35.614640 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac7c49-ec3e-4ca1-92a9-e11f8944d69b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:35.620163 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 459/917] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:25:35 2021] GET /identity/v3/role_assignments?user.id=82e4cab3c8cb4a18bf3c1a8a85d1675c&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=aa34949eb3ac4431991f6c257fca79a9 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:37.581298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47803bc8-dc5d-4be1-8214-6fee9563c06b None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:37.581826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47803bc8-dc5d-4be1-8214-6fee9563c06b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:37.581935 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47803bc8-dc5d-4be1-8214-6fee9563c06b None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:37.583521 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 459/918] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:37.588579 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e942c-2e1b-4a61-ad15-94c5239a7c6c None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:37.588982 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e942c-2e1b-4a61-ad15-94c5239a7c6c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:37.589143 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e942c-2e1b-4a61-ad15-94c5239a7c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:37.611926 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-5c5e942c-2e1b-4a61-ad15-94c5239a7c6c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:37.613078 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5c5e942c-2e1b-4a61-ad15-94c5239a7c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:37.619644 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 460/919] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:37 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:37.641386 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47803bc8-dc5d-4be1-8214-6fee9563c06b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:37.653298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47803bc8-dc5d-4be1-8214-6fee9563c06b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:37.657231 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f504e16-20a9-4d1c-9726-6957f832e4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:37.657927 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f504e16-20a9-4d1c-9726-6957f832e4cf admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:37.658216 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f504e16-20a9-4d1c-9726-6957f832e4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:37.658499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f504e16-20a9-4d1c-9726-6957f832e4cf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:37.669411 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f504e16-20a9-4d1c-9726-6957f832e4cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:25:37.675659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-0f504e16-20a9-4d1c-9726-6957f832e4cf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:25:37.676735 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 460/920] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:25:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:37.682066 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e942c-2e1b-4a61-ad15-94c5239a7c6c None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:37.690301 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e942c-2e1b-4a61-ad15-94c5239a7c6c None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:37.694253 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc109f-f67c-4560-a443-4719f7708d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:37.694821 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc109f-f67c-4560-a443-4719f7708d2f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:37.695106 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc109f-f67c-4560-a443-4719f7708d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:37.695383 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc109f-f67c-4560-a443-4719f7708d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:37.696075 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc109f-f67c-4560-a443-4719f7708d2f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:37.696367 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc109f-f67c-4560-a443-4719f7708d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:37.722647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc109f-f67c-4560-a443-4719f7708d2f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:37.731419 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 461/921] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:25:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:37.736672 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f504e16-20a9-4d1c-9726-6957f832e4cf admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:37.746006 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f504e16-20a9-4d1c-9726-6957f832e4cf admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:37.750079 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589f9e6-c307-4aa6-837d-b8124f73e33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:37.750755 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589f9e6-c307-4aa6-837d-b8124f73e33c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:37.751044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589f9e6-c307-4aa6-837d-b8124f73e33c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:37.751327 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589f9e6-c307-4aa6-837d-b8124f73e33c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:37.762623 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589f9e6-c307-4aa6-837d-b8124f73e33c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:37.788394 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589f9e6-c307-4aa6-837d-b8124f73e33c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:37.805205 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-8589f9e6-c307-4aa6-837d-b8124f73e33c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:37.806225 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 461/922] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:37.812053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc109f-f67c-4560-a443-4719f7708d2f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:37.821036 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc109f-f67c-4560-a443-4719f7708d2f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:37.825671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64c3c0-a7fc-4209-8210-040d97cc7ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:37.826239 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64c3c0-a7fc-4209-8210-040d97cc7ace admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:37.826525 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64c3c0-a7fc-4209-8210-040d97cc7ace admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:37.826806 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64c3c0-a7fc-4209-8210-040d97cc7ace admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:37.827471 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64c3c0-a7fc-4209-8210-040d97cc7ace admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:37.827769 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64c3c0-a7fc-4209-8210-040d97cc7ace admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:37.853415 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64c3c0-a7fc-4209-8210-040d97cc7ace admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:37.865739 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 462/923] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:37.871525 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589f9e6-c307-4aa6-837d-b8124f73e33c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:37.880447 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589f9e6-c307-4aa6-837d-b8124f73e33c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:37.884490 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b0293-1009-4aea-aa4e-d1c188363b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:37.885220 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b0293-1009-4aea-aa4e-d1c188363b9b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:37.885512 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b0293-1009-4aea-aa4e-d1c188363b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:37.885797 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b0293-1009-4aea-aa4e-d1c188363b9b admin admin] PATH_INFO: `/v3/users/swift` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:37.898539 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b0293-1009-4aea-aa4e-d1c188363b9b admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:37.923685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b0293-1009-4aea-aa4e-d1c188363b9b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:37.941136 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-8a7b0293-1009-4aea-aa4e-d1c188363b9b admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 01:25:37.942169 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 462/924] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:25:37 2021] GET /identity/v3/users/swift => generated 83 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:37.947441 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64c3c0-a7fc-4209-8210-040d97cc7ace admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:37.957067 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64c3c0-a7fc-4209-8210-040d97cc7ace admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:37.961075 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f79469-d509-4f73-8197-96fad1642416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:37.961647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f79469-d509-4f73-8197-96fad1642416 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:37.961930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f79469-d509-4f73-8197-96fad1642416 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:37.962207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f79469-d509-4f73-8197-96fad1642416 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:37.962974 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f79469-d509-4f73-8197-96fad1642416 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:37.963279 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f79469-d509-4f73-8197-96fad1642416 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:37.988843 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f79469-d509-4f73-8197-96fad1642416 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:38.095726 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 463/925] 10.222.0.20 () {56 vars in 1157 bytes} [Mon Aug 23 01:25:37 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:38.101499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b0293-1009-4aea-aa4e-d1c188363b9b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:38.110649 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b0293-1009-4aea-aa4e-d1c188363b9b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:38.114661 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bcd80-6ee5-4bf1-8f3c-d007afeec7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:38.115225 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bcd80-6ee5-4bf1-8f3c-d007afeec7ce admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:38.115513 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bcd80-6ee5-4bf1-8f3c-d007afeec7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:38.115793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bcd80-6ee5-4bf1-8f3c-d007afeec7ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:38.123685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bcd80-6ee5-4bf1-8f3c-d007afeec7ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:38.149184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bcd80-6ee5-4bf1-8f3c-d007afeec7ce admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:38.158273 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 463/926] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:25:38 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:25:38.163682 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f79469-d509-4f73-8197-96fad1642416 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:38.173174 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f79469-d509-4f73-8197-96fad1642416 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:38.177200 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32f68d-8ecd-4e4b-9db1-1076484b6afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:38.177854 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32f68d-8ecd-4e4b-9db1-1076484b6afa admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:38.178137 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32f68d-8ecd-4e4b-9db1-1076484b6afa admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:38.178412 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32f68d-8ecd-4e4b-9db1-1076484b6afa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:38.190220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32f68d-8ecd-4e4b-9db1-1076484b6afa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:38.215761 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32f68d-8ecd-4e4b-9db1-1076484b6afa admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:38.232822 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-5a32f68d-8ecd-4e4b-9db1-1076484b6afa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:38.233855 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 464/927] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:38.239294 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bcd80-6ee5-4bf1-8f3c-d007afeec7ce admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:38.248107 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bcd80-6ee5-4bf1-8f3c-d007afeec7ce admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:38.252114 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6b350-3cef-4db1-949f-5afa07af5587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:38.252725 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6b350-3cef-4db1-949f-5afa07af5587 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:38.253014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6b350-3cef-4db1-949f-5afa07af5587 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:38.253292 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6b350-3cef-4db1-949f-5afa07af5587 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:38.253955 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6b350-3cef-4db1-949f-5afa07af5587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:38.254250 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6b350-3cef-4db1-949f-5afa07af5587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:38.279017 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6b350-3cef-4db1-949f-5afa07af5587 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:38.291113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 464/928] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:25:38.296780 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32f68d-8ecd-4e4b-9db1-1076484b6afa admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:38.305629 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32f68d-8ecd-4e4b-9db1-1076484b6afa admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:38.309713 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0d160-ef3d-42d5-99db-d7b80bccbf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:38.310391 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0d160-ef3d-42d5-99db-d7b80bccbf46 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:38.310674 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0d160-ef3d-42d5-99db-d7b80bccbf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:38.310952 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0d160-ef3d-42d5-99db-d7b80bccbf46 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:38.319477 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0d160-ef3d-42d5-99db-d7b80bccbf46 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:38.345936 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0d160-ef3d-42d5-99db-d7b80bccbf46 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:38.358954 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-1ab0d160-ef3d-42d5-99db-d7b80bccbf46 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:25:38.359961 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 465/929] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:25:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:25:38.365234 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6b350-3cef-4db1-949f-5afa07af5587 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:38.374095 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6b350-3cef-4db1-949f-5afa07af5587 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:38.378099 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a99c46-e8ea-4aca-8e75-21aa00bb82d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:38.378662 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a99c46-e8ea-4aca-8e75-21aa00bb82d8 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:38.378948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a99c46-e8ea-4aca-8e75-21aa00bb82d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:38.379229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a99c46-e8ea-4aca-8e75-21aa00bb82d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:38.379946 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a99c46-e8ea-4aca-8e75-21aa00bb82d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:38.380244 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a99c46-e8ea-4aca-8e75-21aa00bb82d8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:38.406577 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a99c46-e8ea-4aca-8e75-21aa00bb82d8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:38.419351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 465/930] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:25:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:38.425159 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0d160-ef3d-42d5-99db-d7b80bccbf46 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:38.434279 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0d160-ef3d-42d5-99db-d7b80bccbf46 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:38.438235 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73912b-7b94-4b91-82d5-dd37cb7b337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:38.438796 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73912b-7b94-4b91-82d5-dd37cb7b337b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:38.439083 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73912b-7b94-4b91-82d5-dd37cb7b337b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:38.439358 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73912b-7b94-4b91-82d5-dd37cb7b337b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:38.440124 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73912b-7b94-4b91-82d5-dd37cb7b337b admin admin] RBAC: Adding query filter params (role.id=56d36413cf4047229b6f9d36a3990b0d, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=82e4cab3c8cb4a18bf3c1a8a85d1675c) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:38.440423 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73912b-7b94-4b91-82d5-dd37cb7b337b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:38.466241 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73912b-7b94-4b91-82d5-dd37cb7b337b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:38.471662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 466/931] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:25:38 2021] GET /identity/v3/role_assignments?user.id=82e4cab3c8cb4a18bf3c1a8a85d1675c&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:40.372527 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064ee03-ca3a-4322-95fb-1348eba7da23 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:40.373102 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064ee03-ca3a-4322-95fb-1348eba7da23 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:40.373102 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064ee03-ca3a-4322-95fb-1348eba7da23 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:40.374798 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 466/932] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:40.379969 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9195c7-1f82-4a94-8394-bf30ba028d42 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:40.380354 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9195c7-1f82-4a94-8394-bf30ba028d42 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:40.380538 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9195c7-1f82-4a94-8394-bf30ba028d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:40.403104 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-aa9195c7-1f82-4a94-8394-bf30ba028d42 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:40.404231 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-aa9195c7-1f82-4a94-8394-bf30ba028d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:40.411081 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 467/933] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:40 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:40.432997 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064ee03-ca3a-4322-95fb-1348eba7da23 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:40.444810 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064ee03-ca3a-4322-95fb-1348eba7da23 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:40.448618 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e5628-32af-4565-b45f-a28cec716090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:40.449318 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e5628-32af-4565-b45f-a28cec716090 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:40.449602 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e5628-32af-4565-b45f-a28cec716090 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:40.449879 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e5628-32af-4565-b45f-a28cec716090 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:40.460489 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e5628-32af-4565-b45f-a28cec716090 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:25:40.466670 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-d96e5628-32af-4565-b45f-a28cec716090 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:25:40.467717 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 467/934] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:25:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:25:40.473354 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9195c7-1f82-4a94-8394-bf30ba028d42 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:40.482147 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9195c7-1f82-4a94-8394-bf30ba028d42 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:40.486162 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71b500-0a23-4538-8663-b7d763606cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:40.486737 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71b500-0a23-4538-8663-b7d763606cdc admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:40.487021 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71b500-0a23-4538-8663-b7d763606cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:40.487300 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71b500-0a23-4538-8663-b7d763606cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:40.488001 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71b500-0a23-4538-8663-b7d763606cdc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:40.488297 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71b500-0a23-4538-8663-b7d763606cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:40.513872 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71b500-0a23-4538-8663-b7d763606cdc admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:40.522105 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 468/935] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:25:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:40.527453 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e5628-32af-4565-b45f-a28cec716090 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:40.537010 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e5628-32af-4565-b45f-a28cec716090 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:40.541078 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03eb7fc-56c4-4c0e-bf9b-ab081e6e599e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:40.541766 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eb7fc-56c4-4c0e-bf9b-ab081e6e599e admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:40.542049 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eb7fc-56c4-4c0e-bf9b-ab081e6e599e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:40.542831 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eb7fc-56c4-4c0e-bf9b-ab081e6e599e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:40.553588 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03eb7fc-56c4-4c0e-bf9b-ab081e6e599e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:40.579224 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03eb7fc-56c4-4c0e-bf9b-ab081e6e599e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:40.596307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-f03eb7fc-56c4-4c0e-bf9b-ab081e6e599e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:40.597358 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 468/936] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:40.602675 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71b500-0a23-4538-8663-b7d763606cdc admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:40.612077 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71b500-0a23-4538-8663-b7d763606cdc admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:40.616104 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25554f6a-c11e-4c60-9abe-baf0cf80c6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:40.616702 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25554f6a-c11e-4c60-9abe-baf0cf80c6fb admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:40.616993 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25554f6a-c11e-4c60-9abe-baf0cf80c6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:40.617275 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25554f6a-c11e-4c60-9abe-baf0cf80c6fb admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:40.617950 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25554f6a-c11e-4c60-9abe-baf0cf80c6fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:40.618249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25554f6a-c11e-4c60-9abe-baf0cf80c6fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:40.643845 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25554f6a-c11e-4c60-9abe-baf0cf80c6fb admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:40.656121 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 469/937] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:40.661291 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03eb7fc-56c4-4c0e-bf9b-ab081e6e599e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:40.670659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03eb7fc-56c4-4c0e-bf9b-ab081e6e599e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:40.674694 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacfda3-08d7-4b29-9d6b-173b9aec6d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:40.675376 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacfda3-08d7-4b29-9d6b-173b9aec6d32 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:40.675658 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacfda3-08d7-4b29-9d6b-173b9aec6d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:40.675935 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacfda3-08d7-4b29-9d6b-173b9aec6d32 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:40.690136 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacfda3-08d7-4b29-9d6b-173b9aec6d32 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:40.715014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacfda3-08d7-4b29-9d6b-173b9aec6d32 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:40.732653 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-bcacfda3-08d7-4b29-9d6b-173b9aec6d32 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 01:25:40.733673 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 469/938] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:25:40 2021] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:40.738903 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25554f6a-c11e-4c60-9abe-baf0cf80c6fb admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:40.747959 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25554f6a-c11e-4c60-9abe-baf0cf80c6fb admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:40.751982 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d59406-2700-4c41-a476-1523347ce71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:40.752552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d59406-2700-4c41-a476-1523347ce71e admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:40.752867 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d59406-2700-4c41-a476-1523347ce71e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:40.753147 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d59406-2700-4c41-a476-1523347ce71e admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:40.753918 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d59406-2700-4c41-a476-1523347ce71e admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:40.754219 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d59406-2700-4c41-a476-1523347ce71e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:40.780383 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d59406-2700-4c41-a476-1523347ce71e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:40.807912 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 470/939] 10.222.0.20 () {56 vars in 1157 bytes} [Mon Aug 23 01:25:40 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:40.813510 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacfda3-08d7-4b29-9d6b-173b9aec6d32 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:40.822380 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacfda3-08d7-4b29-9d6b-173b9aec6d32 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:40.826952 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82133bb3-6134-45ab-9caa-6e4d677884cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:40.827639 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82133bb3-6134-45ab-9caa-6e4d677884cd admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:40.827922 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82133bb3-6134-45ab-9caa-6e4d677884cd admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:40.828198 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82133bb3-6134-45ab-9caa-6e4d677884cd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:40.840002 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82133bb3-6134-45ab-9caa-6e4d677884cd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:40.865050 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82133bb3-6134-45ab-9caa-6e4d677884cd admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:40.881644 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-82133bb3-6134-45ab-9caa-6e4d677884cd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:40.882671 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 470/940] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:40.888548 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d59406-2700-4c41-a476-1523347ce71e admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:40.897548 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d59406-2700-4c41-a476-1523347ce71e admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:40.901531 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d09bc-8d34-43f2-ade1-7acc5ba52ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:40.902124 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d09bc-8d34-43f2-ade1-7acc5ba52ead admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:40.902411 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d09bc-8d34-43f2-ade1-7acc5ba52ead admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:40.902691 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d09bc-8d34-43f2-ade1-7acc5ba52ead admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:40.903361 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d09bc-8d34-43f2-ade1-7acc5ba52ead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:40.903659 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d09bc-8d34-43f2-ade1-7acc5ba52ead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:40.928424 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d09bc-8d34-43f2-ade1-7acc5ba52ead admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:40.941302 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 471/941] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:40.946266 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82133bb3-6134-45ab-9caa-6e4d677884cd admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:40.955649 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82133bb3-6134-45ab-9caa-6e4d677884cd admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:40.959636 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a36c40-65eb-4aaa-b1c5-b63e0406c9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:40.960316 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a36c40-65eb-4aaa-b1c5-b63e0406c9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:40.960629 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a36c40-65eb-4aaa-b1c5-b63e0406c9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:40.960925 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a36c40-65eb-4aaa-b1c5-b63e0406c9e5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:40.969712 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a36c40-65eb-4aaa-b1c5-b63e0406c9e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:40.994504 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a36c40-65eb-4aaa-b1c5-b63e0406c9e5 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:41.008113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-42a36c40-65eb-4aaa-b1c5-b63e0406c9e5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:25:41.009151 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 471/942] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:25:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:41.014951 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d09bc-8d34-43f2-ade1-7acc5ba52ead admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:41.023840 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d09bc-8d34-43f2-ade1-7acc5ba52ead admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:41.027885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcd5da-5574-4d3a-af18-9a65cd04a60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:41.028453 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcd5da-5574-4d3a-af18-9a65cd04a60c admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:41.028768 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcd5da-5574-4d3a-af18-9a65cd04a60c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:41.029049 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcd5da-5574-4d3a-af18-9a65cd04a60c admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:41.029772 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcd5da-5574-4d3a-af18-9a65cd04a60c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:41.030071 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcd5da-5574-4d3a-af18-9a65cd04a60c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:41.055191 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcd5da-5574-4d3a-af18-9a65cd04a60c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:41.068185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 472/943] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:25:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:41.073501 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a36c40-65eb-4aaa-b1c5-b63e0406c9e5 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:41.082870 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a36c40-65eb-4aaa-b1c5-b63e0406c9e5 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:41.086857 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27737d-a04a-48df-ba9f-d07ebcb6e89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:41.087636 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27737d-a04a-48df-ba9f-d07ebcb6e89c admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:41.087921 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27737d-a04a-48df-ba9f-d07ebcb6e89c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:41.088198 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27737d-a04a-48df-ba9f-d07ebcb6e89c admin admin] PATH_INFO: `/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/82e4cab3c8cb4a18bf3c1a8a85d1675c/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:41.089950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27737d-a04a-48df-ba9f-d07ebcb6e89c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2728fddda1c4691b33daad4fa4ef3d2, user_id=82e4cab3c8cb4a18bf3c1a8a85d1675c, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:41.116313 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27737d-a04a-48df-ba9f-d07ebcb6e89c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:41.222278 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 472/944] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:25:41 2021] PUT /identity/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/82e4cab3c8cb4a18bf3c1a8a85d1675c/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:25:43.143167 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9abf5e-dc5d-4c6b-94c4-341987422314 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:43.143691 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9abf5e-dc5d-4c6b-94c4-341987422314 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:43.143793 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9abf5e-dc5d-4c6b-94c4-341987422314 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:43.145427 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 473/945] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:43.150504 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c389349-4031-4af9-866d-605226470508 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:43.150928 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c389349-4031-4af9-866d-605226470508 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:43.151073 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c389349-4031-4af9-866d-605226470508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:43.172869 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-2c389349-4031-4af9-866d-605226470508 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:43.173983 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-2c389349-4031-4af9-866d-605226470508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:43.235316 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 473/946] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:43 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:43.258203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9abf5e-dc5d-4c6b-94c4-341987422314 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:43.270123 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9abf5e-dc5d-4c6b-94c4-341987422314 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:43.274059 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96300e-ad9c-46de-82db-96a50fbea225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:43.274753 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96300e-ad9c-46de-82db-96a50fbea225 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:43.275042 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96300e-ad9c-46de-82db-96a50fbea225 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:43.275321 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96300e-ad9c-46de-82db-96a50fbea225 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:43.285971 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96300e-ad9c-46de-82db-96a50fbea225 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:25:43.292161 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-bf96300e-ad9c-46de-82db-96a50fbea225 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:25:43.293252 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 474/947] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:25:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:43.298844 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c389349-4031-4af9-866d-605226470508 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:43.307097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c389349-4031-4af9-866d-605226470508 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:43.311639 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8c701-7406-457d-a7ba-9934aa4ed43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:43.312222 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8c701-7406-457d-a7ba-9934aa4ed43d admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:43.312507 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8c701-7406-457d-a7ba-9934aa4ed43d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:43.312815 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8c701-7406-457d-a7ba-9934aa4ed43d admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:43.313512 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8c701-7406-457d-a7ba-9934aa4ed43d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:43.313808 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8c701-7406-457d-a7ba-9934aa4ed43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:43.339180 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8c701-7406-457d-a7ba-9934aa4ed43d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:43.347584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 474/948] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:25:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:43.352857 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96300e-ad9c-46de-82db-96a50fbea225 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:43.362214 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96300e-ad9c-46de-82db-96a50fbea225 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:43.366278 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf3e65-55a8-453b-a944-342a0bb40340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:43.366957 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf3e65-55a8-453b-a944-342a0bb40340 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:43.367243 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf3e65-55a8-453b-a944-342a0bb40340 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:43.367523 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf3e65-55a8-453b-a944-342a0bb40340 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:43.378874 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf3e65-55a8-453b-a944-342a0bb40340 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:43.404728 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf3e65-55a8-453b-a944-342a0bb40340 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:43.422190 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-bedf3e65-55a8-453b-a944-342a0bb40340 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:43.423261 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 475/949] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:43.428692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8c701-7406-457d-a7ba-9934aa4ed43d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:43.438396 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8c701-7406-457d-a7ba-9934aa4ed43d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:43.442487 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef3cbb-6f1b-473b-8eb4-2651f9c96582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:43.443066 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef3cbb-6f1b-473b-8eb4-2651f9c96582 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:43.443354 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef3cbb-6f1b-473b-8eb4-2651f9c96582 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:43.443633 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef3cbb-6f1b-473b-8eb4-2651f9c96582 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:43.444334 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef3cbb-6f1b-473b-8eb4-2651f9c96582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:43.444665 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef3cbb-6f1b-473b-8eb4-2651f9c96582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:43.469564 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef3cbb-6f1b-473b-8eb4-2651f9c96582 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:43.482358 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 475/950] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:25:43.487636 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf3e65-55a8-453b-a944-342a0bb40340 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:43.497375 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf3e65-55a8-453b-a944-342a0bb40340 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:43.501474 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64c4b8-f480-40ff-aca0-edae7ecbcb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:43.502161 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64c4b8-f480-40ff-aca0-edae7ecbcb46 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:43.502447 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64c4b8-f480-40ff-aca0-edae7ecbcb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:43.502727 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64c4b8-f480-40ff-aca0-edae7ecbcb46 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:43.514884 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64c4b8-f480-40ff-aca0-edae7ecbcb46 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:43.540223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64c4b8-f480-40ff-aca0-edae7ecbcb46 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:43.557571 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-6a64c4b8-f480-40ff-aca0-edae7ecbcb46 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 01:25:43.559209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 476/951] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:25:43 2021] GET /identity/v3/users/swift => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:43.564539 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef3cbb-6f1b-473b-8eb4-2651f9c96582 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:43.573548 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef3cbb-6f1b-473b-8eb4-2651f9c96582 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:43.577600 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818db43-e134-4588-824b-9c79754ed831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:43.578172 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818db43-e134-4588-824b-9c79754ed831 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:43.578456 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818db43-e134-4588-824b-9c79754ed831 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:43.578734 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818db43-e134-4588-824b-9c79754ed831 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:43.579503 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818db43-e134-4588-824b-9c79754ed831 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:43.579803 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818db43-e134-4588-824b-9c79754ed831 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:43.605679 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818db43-e134-4588-824b-9c79754ed831 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:43.633662 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 476/952] 10.222.0.20 () {56 vars in 1157 bytes} [Mon Aug 23 01:25:43 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:43.638861 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64c4b8-f480-40ff-aca0-edae7ecbcb46 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:43.647745 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64c4b8-f480-40ff-aca0-edae7ecbcb46 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:43.651706 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418989f2-d12f-4a21-86f3-fdaaaa127ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:43.652252 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418989f2-d12f-4a21-86f3-fdaaaa127ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:43.652533 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418989f2-d12f-4a21-86f3-fdaaaa127ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:43.652838 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418989f2-d12f-4a21-86f3-fdaaaa127ad4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:43.660172 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418989f2-d12f-4a21-86f3-fdaaaa127ad4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:43.686210 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418989f2-d12f-4a21-86f3-fdaaaa127ad4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:43.696337 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 477/953] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:25:43 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:25:43.701544 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818db43-e134-4588-824b-9c79754ed831 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:43.710331 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818db43-e134-4588-824b-9c79754ed831 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:43.714365 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08711b4-1192-46af-809c-0e7f0ecfc215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:43.715056 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08711b4-1192-46af-809c-0e7f0ecfc215 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:43.715341 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08711b4-1192-46af-809c-0e7f0ecfc215 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:43.715620 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08711b4-1192-46af-809c-0e7f0ecfc215 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:43.727013 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08711b4-1192-46af-809c-0e7f0ecfc215 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:43.752595 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08711b4-1192-46af-809c-0e7f0ecfc215 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:43.769209 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-a08711b4-1192-46af-809c-0e7f0ecfc215 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:25:43.770232 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 477/954] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:43.775282 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418989f2-d12f-4a21-86f3-fdaaaa127ad4 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:43.784010 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418989f2-d12f-4a21-86f3-fdaaaa127ad4 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:43.788009 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a63ba2-e126-4c3a-8e97-56496dc98bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:43.788593 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a63ba2-e126-4c3a-8e97-56496dc98bdd admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:43.788867 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a63ba2-e126-4c3a-8e97-56496dc98bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:43.789141 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a63ba2-e126-4c3a-8e97-56496dc98bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:43.789803 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a63ba2-e126-4c3a-8e97-56496dc98bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:43.790095 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a63ba2-e126-4c3a-8e97-56496dc98bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:43.815532 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a63ba2-e126-4c3a-8e97-56496dc98bdd admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:43.827531 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 478/955] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:25:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:43.832528 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08711b4-1192-46af-809c-0e7f0ecfc215 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:43.841489 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08711b4-1192-46af-809c-0e7f0ecfc215 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:43.845735 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecda7fd-9845-4386-b41e-f0bc0e0c58a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:43.846415 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecda7fd-9845-4386-b41e-f0bc0e0c58a4 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:43.846698 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecda7fd-9845-4386-b41e-f0bc0e0c58a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:43.846975 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecda7fd-9845-4386-b41e-f0bc0e0c58a4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:43.855524 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecda7fd-9845-4386-b41e-f0bc0e0c58a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:43.881233 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecda7fd-9845-4386-b41e-f0bc0e0c58a4 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:43.894733 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-cecda7fd-9845-4386-b41e-f0bc0e0c58a4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:25:43.895757 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 478/956] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:25:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:43.904454 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a63ba2-e126-4c3a-8e97-56496dc98bdd admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:43.909885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a63ba2-e126-4c3a-8e97-56496dc98bdd admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:43.913936 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98d139-a061-4e90-8d90-0f454623e563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:43.914442 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98d139-a061-4e90-8d90-0f454623e563 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:43.914723 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98d139-a061-4e90-8d90-0f454623e563 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:43.914999 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98d139-a061-4e90-8d90-0f454623e563 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:43.915718 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98d139-a061-4e90-8d90-0f454623e563 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:43.916016 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98d139-a061-4e90-8d90-0f454623e563 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:43.941605 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98d139-a061-4e90-8d90-0f454623e563 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:43.954655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 479/957] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:25:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:43.960145 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecda7fd-9845-4386-b41e-f0bc0e0c58a4 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:43.969382 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecda7fd-9845-4386-b41e-f0bc0e0c58a4 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:43.973373 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7140981-6c48-4c2e-a0a5-8ffe3a01499b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:43.973926 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7140981-6c48-4c2e-a0a5-8ffe3a01499b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:43.974210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7140981-6c48-4c2e-a0a5-8ffe3a01499b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:43.974487 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7140981-6c48-4c2e-a0a5-8ffe3a01499b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:43.975252 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7140981-6c48-4c2e-a0a5-8ffe3a01499b admin admin] RBAC: Adding query filter params (role.id=56d36413cf4047229b6f9d36a3990b0d, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=82e4cab3c8cb4a18bf3c1a8a85d1675c) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:43.975552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7140981-6c48-4c2e-a0a5-8ffe3a01499b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:44.001151 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7140981-6c48-4c2e-a0a5-8ffe3a01499b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:44.006595 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 479/958] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:25:43 2021] GET /identity/v3/role_assignments?user.id=82e4cab3c8cb4a18bf3c1a8a85d1675c&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:45.941034 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cbe71-8071-43c6-9c60-dde7c65fa7c1 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:45.941565 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cbe71-8071-43c6-9c60-dde7c65fa7c1 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:45.941655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cbe71-8071-43c6-9c60-dde7c65fa7c1 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:45.943271 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 480/959] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:45.948366 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d75c9-5bc6-4c2b-97c9-f6cb48f25012 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:45.949289 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d75c9-5bc6-4c2b-97c9-f6cb48f25012 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:45.949449 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d75c9-5bc6-4c2b-97c9-f6cb48f25012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:45.972157 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-808d75c9-5bc6-4c2b-97c9-f6cb48f25012 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:45.973313 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-808d75c9-5bc6-4c2b-97c9-f6cb48f25012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:45.979890 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 480/960] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:46.001247 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cbe71-8071-43c6-9c60-dde7c65fa7c1 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:46.013158 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cbe71-8071-43c6-9c60-dde7c65fa7c1 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:46.017044 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cc781-43f1-41d8-8350-acf5e427d39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:46.017749 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cc781-43f1-41d8-8350-acf5e427d39d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:46.018034 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cc781-43f1-41d8-8350-acf5e427d39d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:46.018312 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cc781-43f1-41d8-8350-acf5e427d39d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:46.018926 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4cc781-43f1-41d8-8350-acf5e427d39d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:46.044584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4cc781-43f1-41d8-8350-acf5e427d39d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:46.055032 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-de4cc781-43f1-41d8-8350-acf5e427d39d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 01:25:46.056060 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 481/961] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 23 01:25:46 2021] GET /identity/v3/services/object-store => generated 93 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:25:46.061944 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d75c9-5bc6-4c2b-97c9-f6cb48f25012 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:46.070221 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d75c9-5bc6-4c2b-97c9-f6cb48f25012 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:46.074793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ebb94-7966-46a3-9f2f-ebbf0122f50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:46.075360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ebb94-7966-46a3-9f2f-ebbf0122f50a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:46.075649 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ebb94-7966-46a3-9f2f-ebbf0122f50a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:46.075928 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ebb94-7966-46a3-9f2f-ebbf0122f50a admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:46.076611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ebb94-7966-46a3-9f2f-ebbf0122f50a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:46.076917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ebb94-7966-46a3-9f2f-ebbf0122f50a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:46.102002 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ebb94-7966-46a3-9f2f-ebbf0122f50a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:46.106597 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 481/962] 10.222.0.20 () {56 vars in 1144 bytes} [Mon Aug 23 01:25:46 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:25:46.111909 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cc781-43f1-41d8-8350-acf5e427d39d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:46.121323 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cc781-43f1-41d8-8350-acf5e427d39d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:46.125383 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11d00f-2fc0-41e7-8771-c6e2861fad7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:46.125941 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11d00f-2fc0-41e7-8771-c6e2861fad7f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:46.126230 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11d00f-2fc0-41e7-8771-c6e2861fad7f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:46.126511 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11d00f-2fc0-41e7-8771-c6e2861fad7f admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:46.127168 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11d00f-2fc0-41e7-8771-c6e2861fad7f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:46.127465 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11d00f-2fc0-41e7-8771-c6e2861fad7f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:46.153032 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11d00f-2fc0-41e7-8771-c6e2861fad7f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:46.157201 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 482/963] 10.222.0.20 () {56 vars in 1144 bytes} [Mon Aug 23 01:25:46 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:48.051714 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d64bed-9bfb-459e-8366-313be0dcd83c None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:48.052231 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d64bed-9bfb-459e-8366-313be0dcd83c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:48.052324 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d64bed-9bfb-459e-8366-313be0dcd83c None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:48.053975 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 482/964] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:48.059659 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3a0ab-8782-4847-b2dd-bafa28f97f52 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:48.060054 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3a0ab-8782-4847-b2dd-bafa28f97f52 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:48.060222 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3a0ab-8782-4847-b2dd-bafa28f97f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:48.082102 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-a4e3a0ab-8782-4847-b2dd-bafa28f97f52 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:48.083228 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a4e3a0ab-8782-4847-b2dd-bafa28f97f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:48.089957 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 483/965] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:48.112193 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d64bed-9bfb-459e-8366-313be0dcd83c None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:48.124089 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d64bed-9bfb-459e-8366-313be0dcd83c None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:48.128044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404d51b-5885-4754-89de-01f9f21d6991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:48.128654 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404d51b-5885-4754-89de-01f9f21d6991 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:48.128945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404d51b-5885-4754-89de-01f9f21d6991 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:48.129224 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404d51b-5885-4754-89de-01f9f21d6991 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:48.129899 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404d51b-5885-4754-89de-01f9f21d6991 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:48.154726 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404d51b-5885-4754-89de-01f9f21d6991 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:48.227991 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 483/966] 10.222.0.20 () {60 vars in 1163 bytes} [Mon Aug 23 01:25:48 2021] POST /identity/v3/services => generated 241 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:25:50.170001 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e531d-fd04-48a8-9ba7-c848f1e475cf None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:50.170519 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e531d-fd04-48a8-9ba7-c848f1e475cf None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:50.170631 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e531d-fd04-48a8-9ba7-c848f1e475cf None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:50.172234 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 484/967] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:50.177263 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e1d05-2d1b-4e4a-a64d-e413c9be16d7 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:50.177689 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e1d05-2d1b-4e4a-a64d-e413c9be16d7 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:50.177829 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e1d05-2d1b-4e4a-a64d-e413c9be16d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:50.201327 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-858e1d05-2d1b-4e4a-a64d-e413c9be16d7 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:50.202437 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-858e1d05-2d1b-4e4a-a64d-e413c9be16d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:50.219560 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 484/968] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:50 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:25:50.241165 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e531d-fd04-48a8-9ba7-c848f1e475cf None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:50.252693 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e531d-fd04-48a8-9ba7-c848f1e475cf None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:50.256724 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed124ea8-59df-4579-9422-37a2b17b4da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:50.257433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed124ea8-59df-4579-9422-37a2b17b4da4 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:50.257720 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed124ea8-59df-4579-9422-37a2b17b4da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:50.258000 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed124ea8-59df-4579-9422-37a2b17b4da4 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:50.258621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed124ea8-59df-4579-9422-37a2b17b4da4 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:50.284686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed124ea8-59df-4579-9422-37a2b17b4da4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:50.295030 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-ed124ea8-59df-4579-9422-37a2b17b4da4 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 01:25:50.296060 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 485/969] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 23 01:25:50 2021] GET /identity/v3/services/object-store => generated 93 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:50.301609 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e1d05-2d1b-4e4a-a64d-e413c9be16d7 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:50.309880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e1d05-2d1b-4e4a-a64d-e413c9be16d7 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:50.313908 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af0ed5-8c91-4e76-ad7d-1bcab65eceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:50.314480 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af0ed5-8c91-4e76-ad7d-1bcab65eceb0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:50.314765 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af0ed5-8c91-4e76-ad7d-1bcab65eceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:50.315041 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af0ed5-8c91-4e76-ad7d-1bcab65eceb0 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:50.315698 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af0ed5-8c91-4e76-ad7d-1bcab65eceb0 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:50.315992 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af0ed5-8c91-4e76-ad7d-1bcab65eceb0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:50.341396 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af0ed5-8c91-4e76-ad7d-1bcab65eceb0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:50.346434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 485/970] 10.222.0.20 () {56 vars in 1144 bytes} [Mon Aug 23 01:25:50 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:50.352060 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed124ea8-59df-4579-9422-37a2b17b4da4 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:50.361514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed124ea8-59df-4579-9422-37a2b17b4da4 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:50.365549 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f479d-bc3f-4ca5-bd85-9adfb1ecaf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:50.366110 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f479d-bc3f-4ca5-bd85-9adfb1ecaf75 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:50.366395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f479d-bc3f-4ca5-bd85-9adfb1ecaf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:50.366675 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f479d-bc3f-4ca5-bd85-9adfb1ecaf75 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:50.367356 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f479d-bc3f-4ca5-bd85-9adfb1ecaf75 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:50.367652 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f479d-bc3f-4ca5-bd85-9adfb1ecaf75 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:50.393510 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f479d-bc3f-4ca5-bd85-9adfb1ecaf75 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:50.398507 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 486/971] 10.222.0.20 () {56 vars in 1144 bytes} [Mon Aug 23 01:25:50 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:50.404342 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af0ed5-8c91-4e76-ad7d-1bcab65eceb0 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:50.413561 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af0ed5-8c91-4e76-ad7d-1bcab65eceb0 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:50.418313 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae642b-df36-498d-8357-152ba676bbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:50.418885 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae642b-df36-498d-8357-152ba676bbdc admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:50.419167 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae642b-df36-498d-8357-152ba676bbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:50.419441 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae642b-df36-498d-8357-152ba676bbdc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:50.420225 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae642b-df36-498d-8357-152ba676bbdc admin admin] RBAC: Adding query filter params (interface=public, service_id=ce811edc941f45fe9c4ff688a0bdd31d, region_id=RegionOne) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:50.420499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae642b-df36-498d-8357-152ba676bbdc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:50.445748 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae642b-df36-498d-8357-152ba676bbdc admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:50.450862 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 486/972] 10.222.0.20 () {56 vars in 1273 bytes} [Mon Aug 23 01:25:50 2021] GET /identity/v3/endpoints?service_id=ce811edc941f45fe9c4ff688a0bdd31d&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:25:50.456223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f479d-bc3f-4ca5-bd85-9adfb1ecaf75 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:50.465194 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f479d-bc3f-4ca5-bd85-9adfb1ecaf75 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:50.469445 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0dab6-ce69-4134-82e9-2fe2fc94757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:50.470008 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0dab6-ce69-4134-82e9-2fe2fc94757e admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:50.470291 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0dab6-ce69-4134-82e9-2fe2fc94757e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:50.470568 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0dab6-ce69-4134-82e9-2fe2fc94757e admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:50.471209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0dab6-ce69-4134-82e9-2fe2fc94757e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:50.497262 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0dab6-ce69-4134-82e9-2fe2fc94757e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:50.503725 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 487/973] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 23 01:25:50 2021] GET /identity/v3/services => generated 2196 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:25:52.423693 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18560414-0806-41f3-8a0b-0ba5d1a2189c None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:52.424193 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18560414-0806-41f3-8a0b-0ba5d1a2189c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:52.424287 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18560414-0806-41f3-8a0b-0ba5d1a2189c None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:52.425948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 487/974] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:52.431170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b05a9e-014b-4b23-ba86-3a189b5cb237 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:52.431613 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b05a9e-014b-4b23-ba86-3a189b5cb237 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:52.431718 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b05a9e-014b-4b23-ba86-3a189b5cb237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:52.454020 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-b9b05a9e-014b-4b23-ba86-3a189b5cb237 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:52.455137 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-b9b05a9e-014b-4b23-ba86-3a189b5cb237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:52.461823 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 488/975] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:52 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:52.484283 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18560414-0806-41f3-8a0b-0ba5d1a2189c None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:52.495775 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18560414-0806-41f3-8a0b-0ba5d1a2189c None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:52.499703 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3aa7b6-69a6-481a-849f-4810faa5fe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:52.500416 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3aa7b6-69a6-481a-849f-4810faa5fe06 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:52.500742 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3aa7b6-69a6-481a-849f-4810faa5fe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:52.501024 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3aa7b6-69a6-481a-849f-4810faa5fe06 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:52.501642 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3aa7b6-69a6-481a-849f-4810faa5fe06 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:52.527371 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3aa7b6-69a6-481a-849f-4810faa5fe06 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:52.537615 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-1c3aa7b6-69a6-481a-849f-4810faa5fe06 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 01:25:52.538654 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 488/976] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 23 01:25:52 2021] GET /identity/v3/services/object-store => generated 93 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:52.544187 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b05a9e-014b-4b23-ba86-3a189b5cb237 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:52.552512 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b05a9e-014b-4b23-ba86-3a189b5cb237 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:52.556547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc30a2a-2169-4871-9a77-660b51d3068c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:52.557143 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc30a2a-2169-4871-9a77-660b51d3068c admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:52.557428 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc30a2a-2169-4871-9a77-660b51d3068c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:52.557706 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc30a2a-2169-4871-9a77-660b51d3068c admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:52.558379 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc30a2a-2169-4871-9a77-660b51d3068c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:52.558676 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc30a2a-2169-4871-9a77-660b51d3068c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:52.584034 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc30a2a-2169-4871-9a77-660b51d3068c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:52.588805 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 489/977] 10.222.0.20 () {56 vars in 1144 bytes} [Mon Aug 23 01:25:52 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:52.594763 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3aa7b6-69a6-481a-849f-4810faa5fe06 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:52.603555 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3aa7b6-69a6-481a-849f-4810faa5fe06 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:52.607623 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0443b-7539-488d-9b9d-84b92b95eb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:52.608178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0443b-7539-488d-9b9d-84b92b95eb38 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:52.608464 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0443b-7539-488d-9b9d-84b92b95eb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:52.608782 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0443b-7539-488d-9b9d-84b92b95eb38 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:52.609427 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0443b-7539-488d-9b9d-84b92b95eb38 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:52.609722 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0443b-7539-488d-9b9d-84b92b95eb38 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:52.634256 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0443b-7539-488d-9b9d-84b92b95eb38 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:52.639229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 489/978] 10.222.0.20 () {56 vars in 1144 bytes} [Mon Aug 23 01:25:52 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:52.644228 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc30a2a-2169-4871-9a77-660b51d3068c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:52.653508 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc30a2a-2169-4871-9a77-660b51d3068c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:52.657534 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf669d8-71d6-44f0-99c3-179a93c675aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:52.658080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf669d8-71d6-44f0-99c3-179a93c675aa admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:52.658365 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf669d8-71d6-44f0-99c3-179a93c675aa admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:52.658643 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf669d8-71d6-44f0-99c3-179a93c675aa admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:52.659311 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf669d8-71d6-44f0-99c3-179a93c675aa admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:52.684011 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf669d8-71d6-44f0-99c3-179a93c675aa admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:52.770679 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 490/979] 10.222.0.20 () {60 vars in 1166 bytes} [Mon Aug 23 01:25:52 2021] POST /identity/v3/endpoints => generated 349 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:25:54.717541 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca096634-5294-4796-8c59-18e4bfcc472a None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:54.718045 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca096634-5294-4796-8c59-18e4bfcc472a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:54.718045 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca096634-5294-4796-8c59-18e4bfcc472a None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:54.719934 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 490/980] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:54.725006 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe669-917e-45db-bce4-be8ca1a50a9e None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:54.725369 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe669-917e-45db-bce4-be8ca1a50a9e None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:54.725573 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe669-917e-45db-bce4-be8ca1a50a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:54.747288 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-799fe669-917e-45db-bce4-be8ca1a50a9e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:54.748411 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-799fe669-917e-45db-bce4-be8ca1a50a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:54.765416 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 491/981] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:54 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:54.787945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca096634-5294-4796-8c59-18e4bfcc472a None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:54.799827 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca096634-5294-4796-8c59-18e4bfcc472a None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:54.803739 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897b112-c88d-4478-8566-3df9414196c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:54.804444 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897b112-c88d-4478-8566-3df9414196c9 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:54.804772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897b112-c88d-4478-8566-3df9414196c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:54.805053 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897b112-c88d-4478-8566-3df9414196c9 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:54.805664 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897b112-c88d-4478-8566-3df9414196c9 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:54.831099 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897b112-c88d-4478-8566-3df9414196c9 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:54.842032 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-3897b112-c88d-4478-8566-3df9414196c9 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 01:25:54.843068 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 491/982] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 23 01:25:54 2021] GET /identity/v3/services/object-store => generated 93 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:54.848943 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fe669-917e-45db-bce4-be8ca1a50a9e None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:54.857395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fe669-917e-45db-bce4-be8ca1a50a9e None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:54.861491 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53461-e73b-487b-b55c-603569c4fe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:54.862066 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53461-e73b-487b-b55c-603569c4fe5a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:54.862357 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53461-e73b-487b-b55c-603569c4fe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:54.862639 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53461-e73b-487b-b55c-603569c4fe5a admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:54.863311 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf53461-e73b-487b-b55c-603569c4fe5a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:54.863616 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf53461-e73b-487b-b55c-603569c4fe5a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:54.889105 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf53461-e73b-487b-b55c-603569c4fe5a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:54.893800 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 492/983] 10.222.0.20 () {56 vars in 1144 bytes} [Mon Aug 23 01:25:54 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:54.899119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897b112-c88d-4478-8566-3df9414196c9 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:54.909432 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897b112-c88d-4478-8566-3df9414196c9 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:54.913426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe2373-efa5-47b4-94cc-104f5b83e220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:54.913979 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe2373-efa5-47b4-94cc-104f5b83e220 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:54.914260 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe2373-efa5-47b4-94cc-104f5b83e220 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:54.914536 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe2373-efa5-47b4-94cc-104f5b83e220 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:54.915182 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe2373-efa5-47b4-94cc-104f5b83e220 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:54.915475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe2373-efa5-47b4-94cc-104f5b83e220 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:54.940955 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe2373-efa5-47b4-94cc-104f5b83e220 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:54.945399 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 492/984] 10.222.0.20 () {56 vars in 1144 bytes} [Mon Aug 23 01:25:54 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:54.950698 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53461-e73b-487b-b55c-603569c4fe5a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:54.959576 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53461-e73b-487b-b55c-603569c4fe5a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:54.963677 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c146279-a593-4410-af47-82da05e8857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:54.964230 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c146279-a593-4410-af47-82da05e8857b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:54.964521 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c146279-a593-4410-af47-82da05e8857b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:54.964837 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c146279-a593-4410-af47-82da05e8857b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:54.965598 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c146279-a593-4410-af47-82da05e8857b admin admin] RBAC: Adding query filter params (interface=admin, service_id=ce811edc941f45fe9c4ff688a0bdd31d, region_id=RegionOne) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:54.965903 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c146279-a593-4410-af47-82da05e8857b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:54.991941 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c146279-a593-4410-af47-82da05e8857b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:54.997532 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 493/985] 10.222.0.20 () {56 vars in 1271 bytes} [Mon Aug 23 01:25:54 2021] GET /identity/v3/endpoints?service_id=ce811edc941f45fe9c4ff688a0bdd31d&interface=admin®ion_id=RegionOne => generated 193 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:55.002503 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe2373-efa5-47b4-94cc-104f5b83e220 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:55.011338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe2373-efa5-47b4-94cc-104f5b83e220 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:55.015376 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a53ef6-e9de-41ef-953a-3cec420f09cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:55.015934 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a53ef6-e9de-41ef-953a-3cec420f09cc admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:55.016217 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a53ef6-e9de-41ef-953a-3cec420f09cc admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:55.016492 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a53ef6-e9de-41ef-953a-3cec420f09cc admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:55.017152 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a53ef6-e9de-41ef-953a-3cec420f09cc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:55.042335 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a53ef6-e9de-41ef-953a-3cec420f09cc admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:55.048827 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 493/986] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 23 01:25:55 2021] GET /identity/v3/services => generated 2196 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:25:56.986169 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142f98a-4d6b-4f1d-ba9b-ba5aa3cef811 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:56.986703 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142f98a-4d6b-4f1d-ba9b-ba5aa3cef811 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:56.986801 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142f98a-4d6b-4f1d-ba9b-ba5aa3cef811 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:56.988428 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 494/987] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 01:25:56.993420 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fb985-23bb-463f-978c-4594bf2b47f8 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:56.993858 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fb985-23bb-463f-978c-4594bf2b47f8 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:56.993986 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fb985-23bb-463f-978c-4594bf2b47f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:57.016176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-0c3fb985-23bb-463f-978c-4594bf2b47f8 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:57.017328 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0c3fb985-23bb-463f-978c-4594bf2b47f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:57.023961 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 494/988] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:56 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:57.046705 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142f98a-4d6b-4f1d-ba9b-ba5aa3cef811 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:57.058775 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142f98a-4d6b-4f1d-ba9b-ba5aa3cef811 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:57.062713 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4014c1-dc7e-44d7-ae62-35e5ebc0f78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:57.063421 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4014c1-dc7e-44d7-ae62-35e5ebc0f78f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:57.063710 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4014c1-dc7e-44d7-ae62-35e5ebc0f78f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:57.063989 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4014c1-dc7e-44d7-ae62-35e5ebc0f78f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:57.064642 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4014c1-dc7e-44d7-ae62-35e5ebc0f78f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:57.089864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4014c1-dc7e-44d7-ae62-35e5ebc0f78f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:57.100428 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-1c4014c1-dc7e-44d7-ae62-35e5ebc0f78f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 01:25:57.101480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 495/989] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 23 01:25:57 2021] GET /identity/v3/services/object-store => generated 93 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:25:57.107481 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fb985-23bb-463f-978c-4594bf2b47f8 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:57.115786 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fb985-23bb-463f-978c-4594bf2b47f8 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:57.119824 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244c1c5-feb6-48e2-916f-fe26ad359792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:57.120551 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244c1c5-feb6-48e2-916f-fe26ad359792 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:57.120867 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244c1c5-feb6-48e2-916f-fe26ad359792 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:57.121146 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244c1c5-feb6-48e2-916f-fe26ad359792 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:57.121806 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244c1c5-feb6-48e2-916f-fe26ad359792 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:57.122105 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244c1c5-feb6-48e2-916f-fe26ad359792 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:57.147216 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244c1c5-feb6-48e2-916f-fe26ad359792 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:57.152501 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 495/990] 10.222.0.20 () {56 vars in 1144 bytes} [Mon Aug 23 01:25:57 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:57.157727 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4014c1-dc7e-44d7-ae62-35e5ebc0f78f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:57.166613 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4014c1-dc7e-44d7-ae62-35e5ebc0f78f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:57.170713 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec4dff-682b-4ba4-a34a-e3266151ffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:57.171269 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec4dff-682b-4ba4-a34a-e3266151ffd5 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:57.171557 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec4dff-682b-4ba4-a34a-e3266151ffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:57.171840 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec4dff-682b-4ba4-a34a-e3266151ffd5 admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:57.172494 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec4dff-682b-4ba4-a34a-e3266151ffd5 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:25:57.172815 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec4dff-682b-4ba4-a34a-e3266151ffd5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:57.197957 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec4dff-682b-4ba4-a34a-e3266151ffd5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:57.202962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 496/991] 10.222.0.20 () {56 vars in 1144 bytes} [Mon Aug 23 01:25:57 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:57.207962 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244c1c5-feb6-48e2-916f-fe26ad359792 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:57.217255 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244c1c5-feb6-48e2-916f-fe26ad359792 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:57.221551 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c3132-380a-4b26-8464-a575d48f0a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:57.222099 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c3132-380a-4b26-8464-a575d48f0a8d admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:57.222385 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c3132-380a-4b26-8464-a575d48f0a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:57.222664 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c3132-380a-4b26-8464-a575d48f0a8d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:57.223331 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c3132-380a-4b26-8464-a575d48f0a8d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:57.248366 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c3132-380a-4b26-8464-a575d48f0a8d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:57.331109 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 496/992] 10.222.0.20 () {60 vars in 1166 bytes} [Mon Aug 23 01:25:57 2021] POST /identity/v3/endpoints => generated 325 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:25:59.246027 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7192a-22b8-4e5d-847b-e1d608ffef1d None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:59.246550 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7192a-22b8-4e5d-847b-e1d608ffef1d None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:59.246635 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7192a-22b8-4e5d-847b-e1d608ffef1d None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:59.248245 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 497/993] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:25:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:25:59.253450 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473186d3-c4c8-44f9-818c-ac39c8edd4f9 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:59.253863 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473186d3-c4c8-44f9-818c-ac39c8edd4f9 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:59.254048 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473186d3-c4c8-44f9-818c-ac39c8edd4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:59.276899 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-473186d3-c4c8-44f9-818c-ac39c8edd4f9 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:25:59.278034 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-473186d3-c4c8-44f9-818c-ac39c8edd4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:25:59.294801 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 497/994] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:25:59 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:25:59.317175 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7192a-22b8-4e5d-847b-e1d608ffef1d None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:59.329099 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7192a-22b8-4e5d-847b-e1d608ffef1d None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:59.333013 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d5311-782f-4a54-b949-d2e5464847c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:59.333709 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d5311-782f-4a54-b949-d2e5464847c7 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:59.333995 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d5311-782f-4a54-b949-d2e5464847c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:59.334275 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d5311-782f-4a54-b949-d2e5464847c7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:59.335308 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d5311-782f-4a54-b949-d2e5464847c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:59.361188 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d5311-782f-4a54-b949-d2e5464847c7 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:59.362591 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 498/995] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:25:59 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:25:59.367965 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473186d3-c4c8-44f9-818c-ac39c8edd4f9 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:25:59.376408 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473186d3-c4c8-44f9-818c-ac39c8edd4f9 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:25:59.380503 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370ed7e-e40f-4c62-bbf9-2b9e18d3fb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:25:59.381108 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370ed7e-e40f-4c62-bbf9-2b9e18d3fb1c admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:25:59.381396 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370ed7e-e40f-4c62-bbf9-2b9e18d3fb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:25:59.381676 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370ed7e-e40f-4c62-bbf9-2b9e18d3fb1c admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:25:59.382319 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370ed7e-e40f-4c62-bbf9-2b9e18d3fb1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:25:59.408462 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370ed7e-e40f-4c62-bbf9-2b9e18d3fb1c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:25:59.500111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 498/996] 10.222.0.20 () {60 vars in 1163 bytes} [Mon Aug 23 01:25:59 2021] POST /identity/v3/projects => generated 311 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:26:01.440818 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19d025-8691-47c4-8c53-ddb64c6f3423 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:01.441216 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19d025-8691-47c4-8c53-ddb64c6f3423 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:01.441384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19d025-8691-47c4-8c53-ddb64c6f3423 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:01.443038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 499/997] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:01.448651 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f5708-db5c-41ff-8686-b6b3f7abaee4 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:01.449067 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f5708-db5c-41ff-8686-b6b3f7abaee4 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:01.449226 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f5708-db5c-41ff-8686-b6b3f7abaee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:01.471359 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-a36f5708-db5c-41ff-8686-b6b3f7abaee4 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:01.472479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-a36f5708-db5c-41ff-8686-b6b3f7abaee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:01.533450 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 499/998] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:01 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:26:01.557817 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19d025-8691-47c4-8c53-ddb64c6f3423 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:01.569102 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19d025-8691-47c4-8c53-ddb64c6f3423 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:01.573172 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a5fc6-fdbc-40d1-b8c0-d238a586f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:01.573870 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a5fc6-fdbc-40d1-b8c0-d238a586f461 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:01.574155 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a5fc6-fdbc-40d1-b8c0-d238a586f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:01.574432 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a5fc6-fdbc-40d1-b8c0-d238a586f461 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:01.575475 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a5fc6-fdbc-40d1-b8c0-d238a586f461 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:01.601012 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a5fc6-fdbc-40d1-b8c0-d238a586f461 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:01.602414 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 500/999] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:26:01 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:01.608173 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f5708-db5c-41ff-8686-b6b3f7abaee4 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:01.616531 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f5708-db5c-41ff-8686-b6b3f7abaee4 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:01.621224 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8ab0c-ee8f-4893-958e-e9e597cd21e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:01.621808 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8ab0c-ee8f-4893-958e-e9e597cd21e6 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:01.622099 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8ab0c-ee8f-4893-958e-e9e597cd21e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:01.622380 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8ab0c-ee8f-4893-958e-e9e597cd21e6 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:01.623022 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8ab0c-ee8f-4893-958e-e9e597cd21e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:01.648095 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8ab0c-ee8f-4893-958e-e9e597cd21e6 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:01.755907 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 500/1000] 10.222.0.20 () {60 vars in 1154 bytes} [Mon Aug 23 01:26:01 2021] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:26:03.745735 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869cf79-6996-4128-bff9-eb0499452007 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:03.746249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869cf79-6996-4128-bff9-eb0499452007 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:03.746249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869cf79-6996-4128-bff9-eb0499452007 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:03.747862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 501/1001] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:03.752880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715b1f3-7589-45c9-926b-203824ac3962 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:03.753287 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715b1f3-7589-45c9-926b-203824ac3962 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:03.753453 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715b1f3-7589-45c9-926b-203824ac3962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:03.775674 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-3715b1f3-7589-45c9-926b-203824ac3962 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:03.777456 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-3715b1f3-7589-45c9-926b-203824ac3962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:03.784183 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 501/1002] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:03 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:26:03.806549 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869cf79-6996-4128-bff9-eb0499452007 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:03.818204 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869cf79-6996-4128-bff9-eb0499452007 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:03.822252 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4789396-dfba-47f2-b998-5e02e8352aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:03.823487 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4789396-dfba-47f2-b998-5e02e8352aef admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:03.823775 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4789396-dfba-47f2-b998-5e02e8352aef admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:03.824056 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4789396-dfba-47f2-b998-5e02e8352aef admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:03.836547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4789396-dfba-47f2-b998-5e02e8352aef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:26:03.843660 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-e4789396-dfba-47f2-b998-5e02e8352aef admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:26:03.844796 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 502/1003] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:26:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:26:03.850870 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715b1f3-7589-45c9-926b-203824ac3962 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:03.859405 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715b1f3-7589-45c9-926b-203824ac3962 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:03.863473 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f04974-5cc0-474d-992a-83b781ca69eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:03.864056 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f04974-5cc0-474d-992a-83b781ca69eb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:03.864343 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f04974-5cc0-474d-992a-83b781ca69eb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:03.864659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f04974-5cc0-474d-992a-83b781ca69eb admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:03.865361 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f04974-5cc0-474d-992a-83b781ca69eb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:26:03.865656 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f04974-5cc0-474d-992a-83b781ca69eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:03.890942 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f04974-5cc0-474d-992a-83b781ca69eb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:03.899153 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 502/1004] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:26:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:03.905426 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4789396-dfba-47f2-b998-5e02e8352aef admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:03.914688 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4789396-dfba-47f2-b998-5e02e8352aef admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:03.918914 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe849a40-ffc0-411f-bdde-b3d34207d0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:03.919686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe849a40-ffc0-411f-bdde-b3d34207d0de admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:03.919977 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe849a40-ffc0-411f-bdde-b3d34207d0de admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:03.920260 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe849a40-ffc0-411f-bdde-b3d34207d0de admin admin] PATH_INFO: `/v3/users/f0da9292d72f4e74a6ec28b70a9fc352` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:03.938349 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe849a40-ffc0-411f-bdde-b3d34207d0de admin admin] RBAC: Authorizing `identity:get_user(user_id=f0da9292d72f4e74a6ec28b70a9fc352)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:03.965676 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe849a40-ffc0-411f-bdde-b3d34207d0de admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:03.967137 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 503/1005] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:26:03 2021] GET /identity/v3/users/f0da9292d72f4e74a6ec28b70a9fc352 => generated 285 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:03.972998 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f04974-5cc0-474d-992a-83b781ca69eb admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:03.982156 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f04974-5cc0-474d-992a-83b781ca69eb admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:03.986263 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8193f-bfae-4ab6-a497-19e77c10511b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:03.986824 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8193f-bfae-4ab6-a497-19e77c10511b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:03.987112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8193f-bfae-4ab6-a497-19e77c10511b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:03.987393 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8193f-bfae-4ab6-a497-19e77c10511b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:03.994789 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8193f-bfae-4ab6-a497-19e77c10511b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:04.020154 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8193f-bfae-4ab6-a497-19e77c10511b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:04.028939 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 503/1006] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:26:03 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:26:04.034353 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe849a40-ffc0-411f-bdde-b3d34207d0de admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:04.043226 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe849a40-ffc0-411f-bdde-b3d34207d0de admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:04.047225 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372be962-3193-42f3-9dc9-57a2cb09267f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:04.047981 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372be962-3193-42f3-9dc9-57a2cb09267f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:04.048263 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372be962-3193-42f3-9dc9-57a2cb09267f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:04.048540 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372be962-3193-42f3-9dc9-57a2cb09267f admin admin] PATH_INFO: `/v3/projects/0ea79b37877f4192a0638335e14355f9` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:04.049609 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372be962-3193-42f3-9dc9-57a2cb09267f admin admin] RBAC: Authorizing `identity:get_project(project_id=0ea79b37877f4192a0638335e14355f9)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:04.076001 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372be962-3193-42f3-9dc9-57a2cb09267f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:04.077481 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 504/1007] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:26:04 2021] GET /identity/v3/projects/0ea79b37877f4192a0638335e14355f9 => generated 311 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:04.082842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8193f-bfae-4ab6-a497-19e77c10511b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:04.091004 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8193f-bfae-4ab6-a497-19e77c10511b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:04.095315 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fa79a-2c7a-4f96-8d87-f89c9d114284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:04.095865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fa79a-2c7a-4f96-8d87-f89c9d114284 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:04.096149 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fa79a-2c7a-4f96-8d87-f89c9d114284 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:04.096429 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fa79a-2c7a-4f96-8d87-f89c9d114284 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:04.097221 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fa79a-2c7a-4f96-8d87-f89c9d114284 admin admin] RBAC: Adding query filter params (role.id=56d36413cf4047229b6f9d36a3990b0d, scope.project.id=0ea79b37877f4192a0638335e14355f9, user.id=f0da9292d72f4e74a6ec28b70a9fc352) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:26:04.097521 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fa79a-2c7a-4f96-8d87-f89c9d114284 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:04.124910 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fa79a-2c7a-4f96-8d87-f89c9d114284 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:04.130629 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 504/1008] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:26:04 2021] GET /identity/v3/role_assignments?user.id=f0da9292d72f4e74a6ec28b70a9fc352&scope.project.id=0ea79b37877f4192a0638335e14355f9&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:06.043066 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97247a4b-e597-4c4a-a30b-c9ed1215d22a None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:06.043625 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97247a4b-e597-4c4a-a30b-c9ed1215d22a None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:06.043625 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97247a4b-e597-4c4a-a30b-c9ed1215d22a None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:06.045309 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 505/1009] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:06.050459 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74f59-4519-4ede-b326-5a160a5bc9e8 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:06.050829 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74f59-4519-4ede-b326-5a160a5bc9e8 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:06.051035 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74f59-4519-4ede-b326-5a160a5bc9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:06.073265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-0da74f59-4519-4ede-b326-5a160a5bc9e8 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:06.074396 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0da74f59-4519-4ede-b326-5a160a5bc9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:06.081291 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 505/1010] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:06 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:26:06.103987 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97247a4b-e597-4c4a-a30b-c9ed1215d22a None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:06.115313 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97247a4b-e597-4c4a-a30b-c9ed1215d22a None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:06.119154 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a51ae-20d9-410f-b6aa-94582d7e9fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:06.119849 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a51ae-20d9-410f-b6aa-94582d7e9fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:06.120132 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a51ae-20d9-410f-b6aa-94582d7e9fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:06.120408 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a51ae-20d9-410f-b6aa-94582d7e9fa5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:06.131230 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a51ae-20d9-410f-b6aa-94582d7e9fa5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:26:06.137945 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-cb7a51ae-20d9-410f-b6aa-94582d7e9fa5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:26:06.138991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 506/1011] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:26:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:26:06.144376 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da74f59-4519-4ede-b326-5a160a5bc9e8 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:06.153428 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da74f59-4519-4ede-b326-5a160a5bc9e8 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:06.157496 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82184c92-6cf9-43bc-86fa-cfe689950586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:06.158077 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82184c92-6cf9-43bc-86fa-cfe689950586 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:06.158373 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82184c92-6cf9-43bc-86fa-cfe689950586 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:06.158654 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82184c92-6cf9-43bc-86fa-cfe689950586 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:06.159353 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82184c92-6cf9-43bc-86fa-cfe689950586 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:26:06.159652 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82184c92-6cf9-43bc-86fa-cfe689950586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:06.184614 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82184c92-6cf9-43bc-86fa-cfe689950586 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:06.192828 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 506/1012] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:26:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:06.198715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a51ae-20d9-410f-b6aa-94582d7e9fa5 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:06.208441 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a51ae-20d9-410f-b6aa-94582d7e9fa5 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:06.212417 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca40b9-258e-4dbb-8059-dc56769235a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:06.213206 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca40b9-258e-4dbb-8059-dc56769235a2 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:06.213586 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca40b9-258e-4dbb-8059-dc56769235a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:06.213867 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca40b9-258e-4dbb-8059-dc56769235a2 admin admin] PATH_INFO: `/v3/users/f0da9292d72f4e74a6ec28b70a9fc352` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:06.214932 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca40b9-258e-4dbb-8059-dc56769235a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=f0da9292d72f4e74a6ec28b70a9fc352)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:06.241101 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca40b9-258e-4dbb-8059-dc56769235a2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:06.242629 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 507/1013] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:26:06 2021] GET /identity/v3/users/f0da9292d72f4e74a6ec28b70a9fc352 => generated 285 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:06.248100 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82184c92-6cf9-43bc-86fa-cfe689950586 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:06.256954 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82184c92-6cf9-43bc-86fa-cfe689950586 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:06.261080 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ccd1a-39d3-4b06-a20d-b29fd20b0adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:06.261835 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ccd1a-39d3-4b06-a20d-b29fd20b0adb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:06.262124 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ccd1a-39d3-4b06-a20d-b29fd20b0adb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:06.262412 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ccd1a-39d3-4b06-a20d-b29fd20b0adb admin admin] PATH_INFO: `/v3/projects/0ea79b37877f4192a0638335e14355f9` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:06.263500 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ccd1a-39d3-4b06-a20d-b29fd20b0adb admin admin] RBAC: Authorizing `identity:get_project(project_id=0ea79b37877f4192a0638335e14355f9)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:06.288751 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ccd1a-39d3-4b06-a20d-b29fd20b0adb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:06.290219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 507/1014] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:26:06 2021] GET /identity/v3/projects/0ea79b37877f4192a0638335e14355f9 => generated 311 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:06.295912 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca40b9-258e-4dbb-8059-dc56769235a2 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:06.304770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca40b9-258e-4dbb-8059-dc56769235a2 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:06.309340 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dddb79-c0d2-4c82-8951-e30b8433285c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:06.310105 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dddb79-c0d2-4c82-8951-e30b8433285c admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:06.310387 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dddb79-c0d2-4c82-8951-e30b8433285c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:06.310665 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dddb79-c0d2-4c82-8951-e30b8433285c admin admin] PATH_INFO: `/v3/projects/0ea79b37877f4192a0638335e14355f9/users/f0da9292d72f4e74a6ec28b70a9fc352/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:06.312342 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dddb79-c0d2-4c82-8951-e30b8433285c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea79b37877f4192a0638335e14355f9, user_id=f0da9292d72f4e74a6ec28b70a9fc352, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:06.338788 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dddb79-c0d2-4c82-8951-e30b8433285c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:06.431131 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 508/1015] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:26:06 2021] PUT /identity/v3/projects/0ea79b37877f4192a0638335e14355f9/users/f0da9292d72f4e74a6ec28b70a9fc352/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:26:08.360833 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a57b73-baa7-4b1a-8358-f814d1a499a5 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:08.361358 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a57b73-baa7-4b1a-8358-f814d1a499a5 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:08.361465 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a57b73-baa7-4b1a-8358-f814d1a499a5 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:08.363058 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 508/1016] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:08.368384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd41de8-6459-4318-b9f6-63c5df2a7e23 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:08.368801 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd41de8-6459-4318-b9f6-63c5df2a7e23 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:08.368999 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd41de8-6459-4318-b9f6-63c5df2a7e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:08.391418 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-6fd41de8-6459-4318-b9f6-63c5df2a7e23 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:08.392552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-6fd41de8-6459-4318-b9f6-63c5df2a7e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:08.454329 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 509/1017] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:08 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:26:08.476916 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a57b73-baa7-4b1a-8358-f814d1a499a5 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:08.488729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a57b73-baa7-4b1a-8358-f814d1a499a5 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:08.492602 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43035c69-c87d-4178-887f-6f7cd350de1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:08.493302 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43035c69-c87d-4178-887f-6f7cd350de1c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:08.493588 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43035c69-c87d-4178-887f-6f7cd350de1c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:08.493867 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43035c69-c87d-4178-887f-6f7cd350de1c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:08.506122 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43035c69-c87d-4178-887f-6f7cd350de1c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:26:08.512360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-43035c69-c87d-4178-887f-6f7cd350de1c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:26:08.513472 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 509/1018] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:26:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:26:08.519007 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd41de8-6459-4318-b9f6-63c5df2a7e23 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:08.527452 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd41de8-6459-4318-b9f6-63c5df2a7e23 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:08.531509 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e142120-2d35-46d6-95bf-d8e68120823d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:08.532095 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e142120-2d35-46d6-95bf-d8e68120823d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:08.532386 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e142120-2d35-46d6-95bf-d8e68120823d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:08.532706 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e142120-2d35-46d6-95bf-d8e68120823d admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:08.533415 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e142120-2d35-46d6-95bf-d8e68120823d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:26:08.533717 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e142120-2d35-46d6-95bf-d8e68120823d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:08.559839 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e142120-2d35-46d6-95bf-d8e68120823d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:08.568016 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 510/1019] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:26:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:08.573263 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43035c69-c87d-4178-887f-6f7cd350de1c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:08.582192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43035c69-c87d-4178-887f-6f7cd350de1c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:08.586221 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11201033-c7ad-485e-871e-c5cac6130bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:08.586981 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11201033-c7ad-485e-871e-c5cac6130bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:08.587265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11201033-c7ad-485e-871e-c5cac6130bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:08.587542 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11201033-c7ad-485e-871e-c5cac6130bc3 admin admin] PATH_INFO: `/v3/users/f0da9292d72f4e74a6ec28b70a9fc352` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:08.589122 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11201033-c7ad-485e-871e-c5cac6130bc3 admin admin] RBAC: Authorizing `identity:get_user(user_id=f0da9292d72f4e74a6ec28b70a9fc352)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:08.615375 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11201033-c7ad-485e-871e-c5cac6130bc3 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:08.616858 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 510/1020] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:26:08 2021] GET /identity/v3/users/f0da9292d72f4e74a6ec28b70a9fc352 => generated 285 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:08.621816 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e142120-2d35-46d6-95bf-d8e68120823d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:08.630658 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e142120-2d35-46d6-95bf-d8e68120823d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:08.634716 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e1196-634b-4234-87d4-687e90fbf435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:08.635273 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e1196-634b-4234-87d4-687e90fbf435 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:08.635555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e1196-634b-4234-87d4-687e90fbf435 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:08.635839 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e1196-634b-4234-87d4-687e90fbf435 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:08.643245 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e1196-634b-4234-87d4-687e90fbf435 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:08.668907 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e1196-634b-4234-87d4-687e90fbf435 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:08.677208 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 511/1021] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:26:08 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:26:08.682921 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11201033-c7ad-485e-871e-c5cac6130bc3 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:08.691652 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11201033-c7ad-485e-871e-c5cac6130bc3 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:08.695682 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0436f-aa30-4ad8-83d3-b8814641bca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:08.696419 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0436f-aa30-4ad8-83d3-b8814641bca3 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:08.696744 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0436f-aa30-4ad8-83d3-b8814641bca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:08.697023 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0436f-aa30-4ad8-83d3-b8814641bca3 admin admin] PATH_INFO: `/v3/projects/0ea79b37877f4192a0638335e14355f9` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:08.698693 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0436f-aa30-4ad8-83d3-b8814641bca3 admin admin] RBAC: Authorizing `identity:get_project(project_id=0ea79b37877f4192a0638335e14355f9)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:08.724104 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0436f-aa30-4ad8-83d3-b8814641bca3 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:08.725698 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 511/1022] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:26:08 2021] GET /identity/v3/projects/0ea79b37877f4192a0638335e14355f9 => generated 311 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:26:08.730698 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e1196-634b-4234-87d4-687e90fbf435 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:08.738747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e1196-634b-4234-87d4-687e90fbf435 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:08.742871 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84561f-dc2a-47c6-bbaf-276f62ab463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:08.743412 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84561f-dc2a-47c6-bbaf-276f62ab463f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:08.743702 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84561f-dc2a-47c6-bbaf-276f62ab463f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:08.743985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84561f-dc2a-47c6-bbaf-276f62ab463f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:08.745275 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84561f-dc2a-47c6-bbaf-276f62ab463f admin admin] RBAC: Adding query filter params (role.id=56d36413cf4047229b6f9d36a3990b0d, scope.project.id=0ea79b37877f4192a0638335e14355f9, user.id=f0da9292d72f4e74a6ec28b70a9fc352) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:26:08.745580 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84561f-dc2a-47c6-bbaf-276f62ab463f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:08.771278 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84561f-dc2a-47c6-bbaf-276f62ab463f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:08.776833 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 512/1023] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:26:08 2021] GET /identity/v3/role_assignments?user.id=f0da9292d72f4e74a6ec28b70a9fc352&scope.project.id=0ea79b37877f4192a0638335e14355f9&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:10.740316 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd71107-64e6-42e9-8d37-4f541185d70c None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:10.740837 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd71107-64e6-42e9-8d37-4f541185d70c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:10.740837 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd71107-64e6-42e9-8d37-4f541185d70c None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:10.742487 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 512/1024] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:10.747654 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e7bc7-9a36-4c6e-942a-71c71aab3f72 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:10.748037 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e7bc7-9a36-4c6e-942a-71c71aab3f72 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:10.748227 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e7bc7-9a36-4c6e-942a-71c71aab3f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:10.770488 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-872e7bc7-9a36-4c6e-942a-71c71aab3f72 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:10.771621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-872e7bc7-9a36-4c6e-942a-71c71aab3f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:10.778946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 513/1025] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:10 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:26:10.801940 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd71107-64e6-42e9-8d37-4f541185d70c None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:10.813727 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd71107-64e6-42e9-8d37-4f541185d70c None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:10.817641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f1ec3-bcf5-4a52-a91a-acd7c645495a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:10.818334 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f1ec3-bcf5-4a52-a91a-acd7c645495a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:10.818618 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f1ec3-bcf5-4a52-a91a-acd7c645495a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:10.818896 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f1ec3-bcf5-4a52-a91a-acd7c645495a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:10.819938 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f1ec3-bcf5-4a52-a91a-acd7c645495a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:10.845828 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f1ec3-bcf5-4a52-a91a-acd7c645495a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:10.847231 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 513/1026] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:26:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:26:10.852512 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e7bc7-9a36-4c6e-942a-71c71aab3f72 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:10.861032 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e7bc7-9a36-4c6e-942a-71c71aab3f72 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:10.865185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c5bb3-f2a9-483f-b45b-e56bc42d9781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:10.865765 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c5bb3-f2a9-483f-b45b-e56bc42d9781 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:10.866056 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c5bb3-f2a9-483f-b45b-e56bc42d9781 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:10.866339 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c5bb3-f2a9-483f-b45b-e56bc42d9781 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:10.866980 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c5bb3-f2a9-483f-b45b-e56bc42d9781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:10.893329 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c5bb3-f2a9-483f-b45b-e56bc42d9781 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:10.981954 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 514/1027] 10.222.0.20 () {60 vars in 1154 bytes} [Mon Aug 23 01:26:10 2021] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:26:12.940825 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c59e6-f2b7-4944-8949-b83427b709ca None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:12.941391 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c59e6-f2b7-4944-8949-b83427b709ca None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:12.941391 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c59e6-f2b7-4944-8949-b83427b709ca None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:12.943111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 514/1028] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:12.948613 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bbe14-3596-4f06-9ff3-601257db28ee None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:12.949051 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bbe14-3596-4f06-9ff3-601257db28ee None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:12.949185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bbe14-3596-4f06-9ff3-601257db28ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:12.972863 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-5f3bbe14-3596-4f06-9ff3-601257db28ee None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:12.973981 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5f3bbe14-3596-4f06-9ff3-601257db28ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:12.980668 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 515/1029] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:12 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:26:13.002850 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c59e6-f2b7-4944-8949-b83427b709ca None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:13.014755 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c59e6-f2b7-4944-8949-b83427b709ca None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:13.018662 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec67da-d215-4a92-86c2-2039f363a1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:13.019417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec67da-d215-4a92-86c2-2039f363a1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:13.019699 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec67da-d215-4a92-86c2-2039f363a1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:13.019971 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec67da-d215-4a92-86c2-2039f363a1a1 admin admin] PATH_INFO: `/v3/roles/1d347df28134487288d9c4a0c6451cb3` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:13.021311 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec67da-d215-4a92-86c2-2039f363a1a1 admin admin] RBAC: Authorizing `identity:get_role(role_id=1d347df28134487288d9c4a0c6451cb3)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:13.046097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-7fec67da-d215-4a92-86c2-2039f363a1a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:26:13.046097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:26:13.046097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:26:13.046963 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec67da-d215-4a92-86c2-2039f363a1a1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:13.048162 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 515/1030] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:26:13 2021] GET /identity/v3/roles/1d347df28134487288d9c4a0c6451cb3 => generated 223 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:13.053364 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bbe14-3596-4f06-9ff3-601257db28ee None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:13.062117 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bbe14-3596-4f06-9ff3-601257db28ee None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:13.066127 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d61a04-2ced-4045-a1fc-0c14c0856091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:13.066892 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d61a04-2ced-4045-a1fc-0c14c0856091 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:13.067176 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d61a04-2ced-4045-a1fc-0c14c0856091 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:13.067454 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d61a04-2ced-4045-a1fc-0c14c0856091 admin admin] PATH_INFO: `/v3/users/6bda4131e0194708ad3ad9295abc4f92` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:13.085009 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d61a04-2ced-4045-a1fc-0c14c0856091 admin admin] RBAC: Authorizing `identity:get_user(user_id=6bda4131e0194708ad3ad9295abc4f92)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:13.111630 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d61a04-2ced-4045-a1fc-0c14c0856091 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:13.113091 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 516/1031] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:26:13 2021] GET /identity/v3/users/6bda4131e0194708ad3ad9295abc4f92 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:13.118516 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec67da-d215-4a92-86c2-2039f363a1a1 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:13.127544 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec67da-d215-4a92-86c2-2039f363a1a1 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:13.131624 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98a0de-15fe-478a-b377-eff40ec6267b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:13.132176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98a0de-15fe-478a-b377-eff40ec6267b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:13.132461 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98a0de-15fe-478a-b377-eff40ec6267b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:13.132779 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98a0de-15fe-478a-b377-eff40ec6267b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:13.140133 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98a0de-15fe-478a-b377-eff40ec6267b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:13.165493 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98a0de-15fe-478a-b377-eff40ec6267b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:13.174350 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 516/1032] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:26:13 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:26:13.179623 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d61a04-2ced-4045-a1fc-0c14c0856091 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:13.188404 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d61a04-2ced-4045-a1fc-0c14c0856091 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:13.192453 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2984d6-bd5a-4b25-8824-53bd62f8178d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:13.193185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2984d6-bd5a-4b25-8824-53bd62f8178d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:13.193467 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2984d6-bd5a-4b25-8824-53bd62f8178d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:13.193741 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2984d6-bd5a-4b25-8824-53bd62f8178d admin admin] PATH_INFO: `/v3/projects/0ea79b37877f4192a0638335e14355f9` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:13.194792 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2984d6-bd5a-4b25-8824-53bd62f8178d admin admin] RBAC: Authorizing `identity:get_project(project_id=0ea79b37877f4192a0638335e14355f9)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:13.220800 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2984d6-bd5a-4b25-8824-53bd62f8178d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:13.222249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 517/1033] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:26:13 2021] GET /identity/v3/projects/0ea79b37877f4192a0638335e14355f9 => generated 311 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:13.227541 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98a0de-15fe-478a-b377-eff40ec6267b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:13.235700 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98a0de-15fe-478a-b377-eff40ec6267b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:13.239705 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff99224-81de-4efe-882c-0cdc4f7525ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:13.240248 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff99224-81de-4efe-882c-0cdc4f7525ce admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:13.240535 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff99224-81de-4efe-882c-0cdc4f7525ce admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:13.240844 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff99224-81de-4efe-882c-0cdc4f7525ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:13.241627 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff99224-81de-4efe-882c-0cdc4f7525ce admin admin] RBAC: Adding query filter params (role.id=1d347df28134487288d9c4a0c6451cb3, scope.project.id=0ea79b37877f4192a0638335e14355f9, user.id=6bda4131e0194708ad3ad9295abc4f92) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:26:13.241926 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff99224-81de-4efe-882c-0cdc4f7525ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:13.267939 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff99224-81de-4efe-882c-0cdc4f7525ce admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:13.273131 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 517/1034] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:26:13 2021] GET /identity/v3/role_assignments?user.id=6bda4131e0194708ad3ad9295abc4f92&scope.project.id=0ea79b37877f4192a0638335e14355f9&role.id=1d347df28134487288d9c4a0c6451cb3 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:15.197061 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa4ced-3b85-4326-88cd-2b433837583b None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:15.197619 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa4ced-3b85-4326-88cd-2b433837583b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:15.197787 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa4ced-3b85-4326-88cd-2b433837583b None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:15.199504 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 518/1035] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:15.204758 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c394bb-9308-46da-94c2-42611668306c None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:15.205152 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c394bb-9308-46da-94c2-42611668306c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:15.205326 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c394bb-9308-46da-94c2-42611668306c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:15.227791 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-71c394bb-9308-46da-94c2-42611668306c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:15.229461 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-71c394bb-9308-46da-94c2-42611668306c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:15.236173 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 518/1036] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:15 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:26:15.258232 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa4ced-3b85-4326-88cd-2b433837583b None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:15.269647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa4ced-3b85-4326-88cd-2b433837583b None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:15.273644 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d79297-b3dd-4b1f-bc77-5a1a8f182af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:15.274400 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d79297-b3dd-4b1f-bc77-5a1a8f182af8 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:15.274703 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d79297-b3dd-4b1f-bc77-5a1a8f182af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:15.274962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d79297-b3dd-4b1f-bc77-5a1a8f182af8 admin admin] PATH_INFO: `/v3/roles/1d347df28134487288d9c4a0c6451cb3` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:15.276297 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d79297-b3dd-4b1f-bc77-5a1a8f182af8 admin admin] RBAC: Authorizing `identity:get_role(role_id=1d347df28134487288d9c4a0c6451cb3)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:15.301127 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-49d79297-b3dd-4b1f-bc77-5a1a8f182af8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:26:15.301127 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:26:15.301127 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:26:15.301994 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d79297-b3dd-4b1f-bc77-5a1a8f182af8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:15.303215 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 519/1037] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:26:15 2021] GET /identity/v3/roles/1d347df28134487288d9c4a0c6451cb3 => generated 223 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:15.309307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c394bb-9308-46da-94c2-42611668306c None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:15.317807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c394bb-9308-46da-94c2-42611668306c None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:15.321879 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7add6c-4332-42ad-9e3b-9803f3bce438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:15.322675 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7add6c-4332-42ad-9e3b-9803f3bce438 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:15.322943 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7add6c-4332-42ad-9e3b-9803f3bce438 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:15.323223 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7add6c-4332-42ad-9e3b-9803f3bce438 admin admin] PATH_INFO: `/v3/users/6bda4131e0194708ad3ad9295abc4f92` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:15.324304 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7add6c-4332-42ad-9e3b-9803f3bce438 admin admin] RBAC: Authorizing `identity:get_user(user_id=6bda4131e0194708ad3ad9295abc4f92)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:15.350476 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7add6c-4332-42ad-9e3b-9803f3bce438 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:15.351879 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 519/1038] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:26:15 2021] GET /identity/v3/users/6bda4131e0194708ad3ad9295abc4f92 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:15.357735 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d79297-b3dd-4b1f-bc77-5a1a8f182af8 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:15.366715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d79297-b3dd-4b1f-bc77-5a1a8f182af8 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:15.370770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b28940-e832-4acb-ab05-ed633f6d1df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:15.371525 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b28940-e832-4acb-ab05-ed633f6d1df7 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:15.371818 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b28940-e832-4acb-ab05-ed633f6d1df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:15.372099 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b28940-e832-4acb-ab05-ed633f6d1df7 admin admin] PATH_INFO: `/v3/projects/0ea79b37877f4192a0638335e14355f9` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:15.373178 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b28940-e832-4acb-ab05-ed633f6d1df7 admin admin] RBAC: Authorizing `identity:get_project(project_id=0ea79b37877f4192a0638335e14355f9)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:15.398277 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b28940-e832-4acb-ab05-ed633f6d1df7 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:15.399758 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 520/1039] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:26:15 2021] GET /identity/v3/projects/0ea79b37877f4192a0638335e14355f9 => generated 311 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:15.405586 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7add6c-4332-42ad-9e3b-9803f3bce438 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:15.414712 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7add6c-4332-42ad-9e3b-9803f3bce438 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:15.419400 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bf36a-a320-4a86-88ba-c33f0004c690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:15.420200 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bf36a-a320-4a86-88ba-c33f0004c690 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:15.420485 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bf36a-a320-4a86-88ba-c33f0004c690 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:15.420796 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bf36a-a320-4a86-88ba-c33f0004c690 admin admin] PATH_INFO: `/v3/projects/0ea79b37877f4192a0638335e14355f9/users/6bda4131e0194708ad3ad9295abc4f92/roles/1d347df28134487288d9c4a0c6451cb3` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:15.422760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bf36a-a320-4a86-88ba-c33f0004c690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea79b37877f4192a0638335e14355f9, user_id=6bda4131e0194708ad3ad9295abc4f92, role_id=1d347df28134487288d9c4a0c6451cb3)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:15.448906 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bf36a-a320-4a86-88ba-c33f0004c690 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:15.555573 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 520/1040] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:26:15 2021] PUT /identity/v3/projects/0ea79b37877f4192a0638335e14355f9/users/6bda4131e0194708ad3ad9295abc4f92/roles/1d347df28134487288d9c4a0c6451cb3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:26:17.474953 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5e7af-d357-4338-bd19-988d8f8281f6 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:17.475441 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5e7af-d357-4338-bd19-988d8f8281f6 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:17.475530 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5e7af-d357-4338-bd19-988d8f8281f6 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:17.477212 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 521/1041] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:17.482264 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ca83d-3636-4f18-893a-1d73f3fc2dae None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:17.482675 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ca83d-3636-4f18-893a-1d73f3fc2dae None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:17.482827 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ca83d-3636-4f18-893a-1d73f3fc2dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:17.505847 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-1c7ca83d-3636-4f18-893a-1d73f3fc2dae None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:17.506960 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1c7ca83d-3636-4f18-893a-1d73f3fc2dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:17.568289 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 521/1042] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:17 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:26:17.590925 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5e7af-d357-4338-bd19-988d8f8281f6 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:17.602620 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5e7af-d357-4338-bd19-988d8f8281f6 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:17.606479 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e155d3f-7094-47be-b3b3-6a6a9df1b57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:17.607231 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e155d3f-7094-47be-b3b3-6a6a9df1b57c admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:17.607511 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e155d3f-7094-47be-b3b3-6a6a9df1b57c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:17.607786 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e155d3f-7094-47be-b3b3-6a6a9df1b57c admin admin] PATH_INFO: `/v3/roles/1d347df28134487288d9c4a0c6451cb3` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:17.609098 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e155d3f-7094-47be-b3b3-6a6a9df1b57c admin admin] RBAC: Authorizing `identity:get_role(role_id=1d347df28134487288d9c4a0c6451cb3)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:17.634307 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e155d3f-7094-47be-b3b3-6a6a9df1b57c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:17.636072 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 522/1043] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:26:17 2021] GET /identity/v3/roles/1d347df28134487288d9c4a0c6451cb3 => generated 223 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:17.641457 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ca83d-3636-4f18-893a-1d73f3fc2dae None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:17.649760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ca83d-3636-4f18-893a-1d73f3fc2dae None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:17.653820 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4f3b8-d614-4efe-82c0-455bdcc7e2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:17.654589 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4f3b8-d614-4efe-82c0-455bdcc7e2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:17.654876 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4f3b8-d614-4efe-82c0-455bdcc7e2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:17.655153 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4f3b8-d614-4efe-82c0-455bdcc7e2d3 admin admin] PATH_INFO: `/v3/users/6bda4131e0194708ad3ad9295abc4f92` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:17.656214 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4f3b8-d614-4efe-82c0-455bdcc7e2d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=6bda4131e0194708ad3ad9295abc4f92)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:17.682361 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4f3b8-d614-4efe-82c0-455bdcc7e2d3 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:17.683707 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 522/1044] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:26:17 2021] GET /identity/v3/users/6bda4131e0194708ad3ad9295abc4f92 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:17.689017 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e155d3f-7094-47be-b3b3-6a6a9df1b57c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:17.698667 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e155d3f-7094-47be-b3b3-6a6a9df1b57c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:17.702805 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f968e59-5ae8-4167-9f6f-7170d4784b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:17.703356 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f968e59-5ae8-4167-9f6f-7170d4784b4e admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:17.703646 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f968e59-5ae8-4167-9f6f-7170d4784b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:17.703929 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f968e59-5ae8-4167-9f6f-7170d4784b4e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:17.711409 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f968e59-5ae8-4167-9f6f-7170d4784b4e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:17.736402 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f968e59-5ae8-4167-9f6f-7170d4784b4e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:17.745296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 523/1045] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:26:17 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:26:17.750371 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4f3b8-d614-4efe-82c0-455bdcc7e2d3 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:17.759141 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4f3b8-d614-4efe-82c0-455bdcc7e2d3 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:17.763724 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ff689-76ec-47ae-bc5a-d39224ead5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:17.764447 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ff689-76ec-47ae-bc5a-d39224ead5be admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:17.764761 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ff689-76ec-47ae-bc5a-d39224ead5be admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:17.765042 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ff689-76ec-47ae-bc5a-d39224ead5be admin admin] PATH_INFO: `/v3/projects/0ea79b37877f4192a0638335e14355f9` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:17.766102 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ff689-76ec-47ae-bc5a-d39224ead5be admin admin] RBAC: Authorizing `identity:get_project(project_id=0ea79b37877f4192a0638335e14355f9)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:17.791037 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ff689-76ec-47ae-bc5a-d39224ead5be admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:17.792478 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 523/1046] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:26:17 2021] GET /identity/v3/projects/0ea79b37877f4192a0638335e14355f9 => generated 311 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:17.797752 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f968e59-5ae8-4167-9f6f-7170d4784b4e admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:17.805836 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f968e59-5ae8-4167-9f6f-7170d4784b4e admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:17.810375 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c8bbc-f0cb-4612-837f-dac23a55436a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:17.810919 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c8bbc-f0cb-4612-837f-dac23a55436a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:17.811204 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c8bbc-f0cb-4612-837f-dac23a55436a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:17.811483 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c8bbc-f0cb-4612-837f-dac23a55436a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:17.812238 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c8bbc-f0cb-4612-837f-dac23a55436a admin admin] RBAC: Adding query filter params (role.id=1d347df28134487288d9c4a0c6451cb3, scope.project.id=0ea79b37877f4192a0638335e14355f9, user.id=6bda4131e0194708ad3ad9295abc4f92) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:26:17.812535 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c8bbc-f0cb-4612-837f-dac23a55436a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:17.838184 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c8bbc-f0cb-4612-837f-dac23a55436a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:17.843962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 524/1047] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:26:17 2021] GET /identity/v3/role_assignments?user.id=6bda4131e0194708ad3ad9295abc4f92&scope.project.id=0ea79b37877f4192a0638335e14355f9&role.id=1d347df28134487288d9c4a0c6451cb3 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:19.803308 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24637e9-6963-4c46-96a5-b48135a3dad8 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:19.803805 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24637e9-6963-4c46-96a5-b48135a3dad8 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:19.803805 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24637e9-6963-4c46-96a5-b48135a3dad8 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:19.805610 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 524/1048] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:19.811267 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6c358-9f0d-467b-aa85-763bff67f61d None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:19.811640 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6c358-9f0d-467b-aa85-763bff67f61d None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:19.811836 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6c358-9f0d-467b-aa85-763bff67f61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:19.834701 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-1ef6c358-9f0d-467b-aa85-763bff67f61d None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:19.835854 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1ef6c358-9f0d-467b-aa85-763bff67f61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:19.842562 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 525/1049] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:19 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:26:19.864782 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24637e9-6963-4c46-96a5-b48135a3dad8 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:19.876766 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24637e9-6963-4c46-96a5-b48135a3dad8 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:19.880730 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b1909-3151-492a-94fb-81f51ad3c30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:19.881424 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b1909-3151-492a-94fb-81f51ad3c30d admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:19.881712 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b1909-3151-492a-94fb-81f51ad3c30d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:19.881993 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b1909-3151-492a-94fb-81f51ad3c30d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:19.883049 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b1909-3151-492a-94fb-81f51ad3c30d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:19.908363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b1909-3151-492a-94fb-81f51ad3c30d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:19.909790 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 525/1050] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:26:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:19.915012 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6c358-9f0d-467b-aa85-763bff67f61d None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:19.923519 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6c358-9f0d-467b-aa85-763bff67f61d None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:19.927627 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68b4d6-fcdd-4798-a9b9-0142ca607c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:19.928192 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68b4d6-fcdd-4798-a9b9-0142ca607c72 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:19.928480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68b4d6-fcdd-4798-a9b9-0142ca607c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:19.928795 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68b4d6-fcdd-4798-a9b9-0142ca607c72 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:19.929444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68b4d6-fcdd-4798-a9b9-0142ca607c72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:19.955628 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68b4d6-fcdd-4798-a9b9-0142ca607c72 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:20.074687 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 526/1051] 10.222.0.20 () {60 vars in 1163 bytes} [Mon Aug 23 01:26:19 2021] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:26:22.067578 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2c064-ef3b-43ea-9cf4-849dd45c4502 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:22.068208 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2c064-ef3b-43ea-9cf4-849dd45c4502 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:22.068208 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2c064-ef3b-43ea-9cf4-849dd45c4502 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:22.069833 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 526/1052] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:22.075008 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2f1ab-bb68-4c4b-bed3-96bd9613264a None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:22.075435 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2f1ab-bb68-4c4b-bed3-96bd9613264a None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:22.075582 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2f1ab-bb68-4c4b-bed3-96bd9613264a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:22.097776 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-d7e2f1ab-bb68-4c4b-bed3-96bd9613264a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:22.098909 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d7e2f1ab-bb68-4c4b-bed3-96bd9613264a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:22.160735 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 527/1053] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:22 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:26:22.185218 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2c064-ef3b-43ea-9cf4-849dd45c4502 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:22.196634 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2c064-ef3b-43ea-9cf4-849dd45c4502 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:22.200536 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeadb45-2143-4a1f-b57c-bdaa0452bd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:22.201281 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeadb45-2143-4a1f-b57c-bdaa0452bd66 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:22.201571 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeadb45-2143-4a1f-b57c-bdaa0452bd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:22.201852 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeadb45-2143-4a1f-b57c-bdaa0452bd66 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:22.202905 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeadb45-2143-4a1f-b57c-bdaa0452bd66 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:22.229113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeadb45-2143-4a1f-b57c-bdaa0452bd66 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:22.230527 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 527/1054] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:26:22 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:22.235905 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2f1ab-bb68-4c4b-bed3-96bd9613264a None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:22.244326 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2f1ab-bb68-4c4b-bed3-96bd9613264a None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:22.248444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918dff1-2f02-4d90-b7df-89238f059338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:22.249055 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918dff1-2f02-4d90-b7df-89238f059338 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:22.249347 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918dff1-2f02-4d90-b7df-89238f059338 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:22.249634 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918dff1-2f02-4d90-b7df-89238f059338 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:22.250281 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918dff1-2f02-4d90-b7df-89238f059338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:22.275959 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918dff1-2f02-4d90-b7df-89238f059338 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:22.376533 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 528/1055] 10.222.0.20 () {60 vars in 1154 bytes} [Mon Aug 23 01:26:22 2021] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:26:24.354063 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbdf0e-0a1d-4d74-8efd-1bca58be9fb6 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:24.354622 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbdf0e-0a1d-4d74-8efd-1bca58be9fb6 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:24.354622 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbdf0e-0a1d-4d74-8efd-1bca58be9fb6 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:24.356291 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 528/1056] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:24.361395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dde30-ad83-4d56-ad10-f8a4176855ac None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:24.361825 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dde30-ad83-4d56-ad10-f8a4176855ac None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:24.361967 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dde30-ad83-4d56-ad10-f8a4176855ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:24.384241 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-1a5dde30-ad83-4d56-ad10-f8a4176855ac None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:24.385977 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1a5dde30-ad83-4d56-ad10-f8a4176855ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:24.392761 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 529/1057] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:24 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:26:24.415265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbdf0e-0a1d-4d74-8efd-1bca58be9fb6 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:24.426818 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbdf0e-0a1d-4d74-8efd-1bca58be9fb6 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:24.430771 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa4f64-3454-4cff-a3a7-ca22ff0f1517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:24.431959 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa4f64-3454-4cff-a3a7-ca22ff0f1517 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:24.432246 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa4f64-3454-4cff-a3a7-ca22ff0f1517 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:24.432528 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa4f64-3454-4cff-a3a7-ca22ff0f1517 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:24.444112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa4f64-3454-4cff-a3a7-ca22ff0f1517 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:26:24.450894 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-3ffa4f64-3454-4cff-a3a7-ca22ff0f1517 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:26:24.451952 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 529/1058] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:26:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:26:24.457433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5dde30-ad83-4d56-ad10-f8a4176855ac None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:24.466521 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5dde30-ad83-4d56-ad10-f8a4176855ac None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:24.470898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57458a4-b5a6-40b3-8b71-5ee2f1699678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:24.471478 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57458a4-b5a6-40b3-8b71-5ee2f1699678 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:24.471766 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57458a4-b5a6-40b3-8b71-5ee2f1699678 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:24.472045 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57458a4-b5a6-40b3-8b71-5ee2f1699678 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:24.472783 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57458a4-b5a6-40b3-8b71-5ee2f1699678 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:26:24.473080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57458a4-b5a6-40b3-8b71-5ee2f1699678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:24.498585 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57458a4-b5a6-40b3-8b71-5ee2f1699678 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:24.506824 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 530/1059] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:26:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:24.513046 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa4f64-3454-4cff-a3a7-ca22ff0f1517 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:24.522014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa4f64-3454-4cff-a3a7-ca22ff0f1517 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:24.526273 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b719f-28d2-41a6-af0c-f648f89b703c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:24.527040 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b719f-28d2-41a6-af0c-f648f89b703c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:24.527328 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b719f-28d2-41a6-af0c-f648f89b703c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:24.527610 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b719f-28d2-41a6-af0c-f648f89b703c admin admin] PATH_INFO: `/v3/users/c5d28bf301124e4ea80c3dad73835920` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:24.547230 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b719f-28d2-41a6-af0c-f648f89b703c admin admin] RBAC: Authorizing `identity:get_user(user_id=c5d28bf301124e4ea80c3dad73835920)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:24.573526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b719f-28d2-41a6-af0c-f648f89b703c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:24.574978 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 530/1060] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:26:24 2021] GET /identity/v3/users/c5d28bf301124e4ea80c3dad73835920 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:24.580539 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57458a4-b5a6-40b3-8b71-5ee2f1699678 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:24.589621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57458a4-b5a6-40b3-8b71-5ee2f1699678 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:24.593904 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a53353-2ddc-40b8-b214-21313b5c6b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:24.594462 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a53353-2ddc-40b8-b214-21313b5c6b55 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:24.594747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a53353-2ddc-40b8-b214-21313b5c6b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:24.595023 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a53353-2ddc-40b8-b214-21313b5c6b55 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:24.602392 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a53353-2ddc-40b8-b214-21313b5c6b55 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:24.627865 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a53353-2ddc-40b8-b214-21313b5c6b55 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:24.636502 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 531/1061] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:26:24 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:26:24.641933 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b719f-28d2-41a6-af0c-f648f89b703c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:24.650921 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b719f-28d2-41a6-af0c-f648f89b703c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:24.655014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada2a7b-d7d7-4ecb-89bf-c58674a22558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:24.655798 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada2a7b-d7d7-4ecb-89bf-c58674a22558 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:24.656087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada2a7b-d7d7-4ecb-89bf-c58674a22558 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:24.656369 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada2a7b-d7d7-4ecb-89bf-c58674a22558 admin admin] PATH_INFO: `/v3/projects/8b911a0aab104a27b5aba859cc3c0914` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:24.657479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada2a7b-d7d7-4ecb-89bf-c58674a22558 admin admin] RBAC: Authorizing `identity:get_project(project_id=8b911a0aab104a27b5aba859cc3c0914)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:24.683620 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada2a7b-d7d7-4ecb-89bf-c58674a22558 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:24.685107 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 531/1062] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:26:24 2021] GET /identity/v3/projects/8b911a0aab104a27b5aba859cc3c0914 => generated 311 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:24.690453 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a53353-2ddc-40b8-b214-21313b5c6b55 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:24.698578 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a53353-2ddc-40b8-b214-21313b5c6b55 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:24.702624 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d0fe1-0b0b-4990-8eda-dd2304cab55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:24.703163 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d0fe1-0b0b-4990-8eda-dd2304cab55b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:24.703445 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d0fe1-0b0b-4990-8eda-dd2304cab55b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:24.703721 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d0fe1-0b0b-4990-8eda-dd2304cab55b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:24.704471 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d0fe1-0b0b-4990-8eda-dd2304cab55b admin admin] RBAC: Adding query filter params (role.id=56d36413cf4047229b6f9d36a3990b0d, scope.project.id=8b911a0aab104a27b5aba859cc3c0914, user.id=c5d28bf301124e4ea80c3dad73835920) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:26:24.704800 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d0fe1-0b0b-4990-8eda-dd2304cab55b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:24.730611 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d0fe1-0b0b-4990-8eda-dd2304cab55b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:24.735758 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 532/1063] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:26:24 2021] GET /identity/v3/role_assignments?user.id=c5d28bf301124e4ea80c3dad73835920&scope.project.id=8b911a0aab104a27b5aba859cc3c0914&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:26.635688 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149ec4c-7991-4ded-87df-4490d657a0a9 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:26.636219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149ec4c-7991-4ded-87df-4490d657a0a9 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:26.636319 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149ec4c-7991-4ded-87df-4490d657a0a9 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:26.637952 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 532/1064] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:26.642889 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed7ad6-d257-4ffe-8376-64cfd44ba1fe None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:26.643278 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed7ad6-d257-4ffe-8376-64cfd44ba1fe None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:26.643454 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed7ad6-d257-4ffe-8376-64cfd44ba1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:26.665541 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-32ed7ad6-d257-4ffe-8376-64cfd44ba1fe None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:26.666652 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-32ed7ad6-d257-4ffe-8376-64cfd44ba1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:26.673760 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 533/1065] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:26 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:26:26.694905 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149ec4c-7991-4ded-87df-4490d657a0a9 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:26.706216 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149ec4c-7991-4ded-87df-4490d657a0a9 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:26.710161 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b96f57-36af-430b-b428-c4c239455327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:26.710847 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b96f57-36af-430b-b428-c4c239455327 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:26.711132 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b96f57-36af-430b-b428-c4c239455327 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:26.711412 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b96f57-36af-430b-b428-c4c239455327 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:26.722826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b96f57-36af-430b-b428-c4c239455327 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:26:26.729685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-d3b96f57-36af-430b-b428-c4c239455327 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:26:26.730722 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 533/1066] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:26:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:26:26.736015 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed7ad6-d257-4ffe-8376-64cfd44ba1fe None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:26.744245 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed7ad6-d257-4ffe-8376-64cfd44ba1fe None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:26.748213 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe628b-7784-4a61-96bb-f041482dadfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:26.748818 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe628b-7784-4a61-96bb-f041482dadfb admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:26.749104 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe628b-7784-4a61-96bb-f041482dadfb admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:26.749380 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe628b-7784-4a61-96bb-f041482dadfb admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:26.750078 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe628b-7784-4a61-96bb-f041482dadfb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:26:26.750373 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe628b-7784-4a61-96bb-f041482dadfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:26.775937 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe628b-7784-4a61-96bb-f041482dadfb admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:26.784095 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 534/1067] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:26:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:26.789398 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b96f57-36af-430b-b428-c4c239455327 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:26.799733 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b96f57-36af-430b-b428-c4c239455327 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:26.803792 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43b128-24a3-4441-bd4e-83a553a83709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:26.804541 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b128-24a3-4441-bd4e-83a553a83709 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:26.804856 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b128-24a3-4441-bd4e-83a553a83709 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:26.805136 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b128-24a3-4441-bd4e-83a553a83709 admin admin] PATH_INFO: `/v3/users/c5d28bf301124e4ea80c3dad73835920` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:26.806202 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43b128-24a3-4441-bd4e-83a553a83709 admin admin] RBAC: Authorizing `identity:get_user(user_id=c5d28bf301124e4ea80c3dad73835920)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:26.831254 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43b128-24a3-4441-bd4e-83a553a83709 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:26.832669 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 534/1068] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:26:26 2021] GET /identity/v3/users/c5d28bf301124e4ea80c3dad73835920 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:26.838181 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe628b-7784-4a61-96bb-f041482dadfb admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:26.847191 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe628b-7784-4a61-96bb-f041482dadfb admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:26.851188 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f156189-71a0-4b3e-9c60-5ff40b768e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:26.851938 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f156189-71a0-4b3e-9c60-5ff40b768e53 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:26.852221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f156189-71a0-4b3e-9c60-5ff40b768e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:26.852497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f156189-71a0-4b3e-9c60-5ff40b768e53 admin admin] PATH_INFO: `/v3/projects/8b911a0aab104a27b5aba859cc3c0914` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:26.854193 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f156189-71a0-4b3e-9c60-5ff40b768e53 admin admin] RBAC: Authorizing `identity:get_project(project_id=8b911a0aab104a27b5aba859cc3c0914)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:26.879434 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f156189-71a0-4b3e-9c60-5ff40b768e53 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:26.880898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 535/1069] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:26:26 2021] GET /identity/v3/projects/8b911a0aab104a27b5aba859cc3c0914 => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:26.886096 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43b128-24a3-4441-bd4e-83a553a83709 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:26.895076 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43b128-24a3-4441-bd4e-83a553a83709 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:26.899195 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea435b9-6ef0-4354-abd1-dddc2f27b11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:26.900001 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea435b9-6ef0-4354-abd1-dddc2f27b11c admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:26.913431 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea435b9-6ef0-4354-abd1-dddc2f27b11c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:26.913431 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea435b9-6ef0-4354-abd1-dddc2f27b11c admin admin] PATH_INFO: `/v3/projects/8b911a0aab104a27b5aba859cc3c0914/users/c5d28bf301124e4ea80c3dad73835920/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:26.913431 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea435b9-6ef0-4354-abd1-dddc2f27b11c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b911a0aab104a27b5aba859cc3c0914, user_id=c5d28bf301124e4ea80c3dad73835920, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:26.929455 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea435b9-6ef0-4354-abd1-dddc2f27b11c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:27.040709 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 535/1070] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:26:26 2021] PUT /identity/v3/projects/8b911a0aab104a27b5aba859cc3c0914/users/c5d28bf301124e4ea80c3dad73835920/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:26:28.951827 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df978ad5-a4d6-4b41-a449-b2aa795b57b4 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:28.952368 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df978ad5-a4d6-4b41-a449-b2aa795b57b4 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:28.952368 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df978ad5-a4d6-4b41-a449-b2aa795b57b4 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:28.954087 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 536/1071] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 01:26:28.959068 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ff0f8-34ed-4e46-96a5-7da8c0dfa1ae None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:28.959496 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ff0f8-34ed-4e46-96a5-7da8c0dfa1ae None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:28.959627 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ff0f8-34ed-4e46-96a5-7da8c0dfa1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:28.981349 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-c68ff0f8-34ed-4e46-96a5-7da8c0dfa1ae None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:28.982447 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c68ff0f8-34ed-4e46-96a5-7da8c0dfa1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:29.042345 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 536/1072] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:28 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:26:29.064760 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df978ad5-a4d6-4b41-a449-b2aa795b57b4 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:29.076826 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df978ad5-a4d6-4b41-a449-b2aa795b57b4 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:29.080693 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84905d15-71b0-4127-a45d-23c86d9d4116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:29.081385 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84905d15-71b0-4127-a45d-23c86d9d4116 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:29.081667 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84905d15-71b0-4127-a45d-23c86d9d4116 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:29.081940 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84905d15-71b0-4127-a45d-23c86d9d4116 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:29.093741 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84905d15-71b0-4127-a45d-23c86d9d4116 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:26:29.099890 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-84905d15-71b0-4127-a45d-23c86d9d4116 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:26:29.100961 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 537/1073] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:26:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:26:29.106614 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ff0f8-34ed-4e46-96a5-7da8c0dfa1ae None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:29.114867 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ff0f8-34ed-4e46-96a5-7da8c0dfa1ae None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:29.119360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26232955-ebcb-475a-9937-5afaf1a7ed31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:29.119936 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26232955-ebcb-475a-9937-5afaf1a7ed31 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:29.120219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26232955-ebcb-475a-9937-5afaf1a7ed31 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:29.120497 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26232955-ebcb-475a-9937-5afaf1a7ed31 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:29.121218 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26232955-ebcb-475a-9937-5afaf1a7ed31 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:26:29.121513 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26232955-ebcb-475a-9937-5afaf1a7ed31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:29.146302 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26232955-ebcb-475a-9937-5afaf1a7ed31 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:29.154937 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 537/1074] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:26:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:29.160262 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84905d15-71b0-4127-a45d-23c86d9d4116 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:29.169814 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84905d15-71b0-4127-a45d-23c86d9d4116 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:29.173867 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88d1ee-2447-4e91-b3b4-eafcaa566811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:29.174630 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88d1ee-2447-4e91-b3b4-eafcaa566811 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:29.174916 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88d1ee-2447-4e91-b3b4-eafcaa566811 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:29.175197 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88d1ee-2447-4e91-b3b4-eafcaa566811 admin admin] PATH_INFO: `/v3/users/c5d28bf301124e4ea80c3dad73835920` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:29.176278 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88d1ee-2447-4e91-b3b4-eafcaa566811 admin admin] RBAC: Authorizing `identity:get_user(user_id=c5d28bf301124e4ea80c3dad73835920)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:29.202296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88d1ee-2447-4e91-b3b4-eafcaa566811 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:29.203636 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 538/1075] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:26:29 2021] GET /identity/v3/users/c5d28bf301124e4ea80c3dad73835920 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:29.208840 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26232955-ebcb-475a-9937-5afaf1a7ed31 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:29.217873 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26232955-ebcb-475a-9937-5afaf1a7ed31 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:29.221880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a97314-95a8-4221-936f-4745a86b1201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:29.222422 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a97314-95a8-4221-936f-4745a86b1201 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:29.222705 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a97314-95a8-4221-936f-4745a86b1201 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:29.222983 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a97314-95a8-4221-936f-4745a86b1201 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:29.230792 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a97314-95a8-4221-936f-4745a86b1201 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:29.256141 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a97314-95a8-4221-936f-4745a86b1201 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:29.264274 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 538/1076] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:26:29 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:26:29.269523 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88d1ee-2447-4e91-b3b4-eafcaa566811 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:29.278381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88d1ee-2447-4e91-b3b4-eafcaa566811 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:29.282439 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c197e23-792a-46e3-b7be-4dd80e5b632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:29.283171 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c197e23-792a-46e3-b7be-4dd80e5b632b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:29.283458 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c197e23-792a-46e3-b7be-4dd80e5b632b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:29.283745 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c197e23-792a-46e3-b7be-4dd80e5b632b admin admin] PATH_INFO: `/v3/projects/8b911a0aab104a27b5aba859cc3c0914` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:29.284835 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c197e23-792a-46e3-b7be-4dd80e5b632b admin admin] RBAC: Authorizing `identity:get_project(project_id=8b911a0aab104a27b5aba859cc3c0914)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:29.311285 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c197e23-792a-46e3-b7be-4dd80e5b632b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:29.312760 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 539/1077] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:26:29 2021] GET /identity/v3/projects/8b911a0aab104a27b5aba859cc3c0914 => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:29.318091 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a97314-95a8-4221-936f-4745a86b1201 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:29.326172 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a97314-95a8-4221-936f-4745a86b1201 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:29.330212 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655c2a5-f3c9-4249-bc3b-f897cd104103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:29.330749 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655c2a5-f3c9-4249-bc3b-f897cd104103 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:29.331032 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655c2a5-f3c9-4249-bc3b-f897cd104103 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:29.331310 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655c2a5-f3c9-4249-bc3b-f897cd104103 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:29.332054 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655c2a5-f3c9-4249-bc3b-f897cd104103 admin admin] RBAC: Adding query filter params (role.id=56d36413cf4047229b6f9d36a3990b0d, scope.project.id=8b911a0aab104a27b5aba859cc3c0914, user.id=c5d28bf301124e4ea80c3dad73835920) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:26:29.332352 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655c2a5-f3c9-4249-bc3b-f897cd104103 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:29.358043 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655c2a5-f3c9-4249-bc3b-f897cd104103 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:29.363554 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 539/1078] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:26:29 2021] GET /identity/v3/role_assignments?user.id=c5d28bf301124e4ea80c3dad73835920&scope.project.id=8b911a0aab104a27b5aba859cc3c0914&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:31.324892 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c6dde-ae44-4ec3-bcab-e0d10808801a None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:31.331250 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c6dde-ae44-4ec3-bcab-e0d10808801a None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:31.331250 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c6dde-ae44-4ec3-bcab-e0d10808801a None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:31.331250 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 540/1079] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:31.332131 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37432504-7e1c-47b1-be0f-b64df74e23ef None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:31.332526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37432504-7e1c-47b1-be0f-b64df74e23ef None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:31.332721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37432504-7e1c-47b1-be0f-b64df74e23ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:31.355607 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-37432504-7e1c-47b1-be0f-b64df74e23ef None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:31.356741 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-37432504-7e1c-47b1-be0f-b64df74e23ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:31.363296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 540/1080] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:31 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:26:31.384537 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c6dde-ae44-4ec3-bcab-e0d10808801a None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:31.396001 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c6dde-ae44-4ec3-bcab-e0d10808801a None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:31.400415 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c00717-f3f0-4dcb-a75f-b6b46fa66ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:31.401045 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c00717-f3f0-4dcb-a75f-b6b46fa66ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:31.401331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c00717-f3f0-4dcb-a75f-b6b46fa66ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:31.401610 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c00717-f3f0-4dcb-a75f-b6b46fa66ce4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:31.408958 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c00717-f3f0-4dcb-a75f-b6b46fa66ce4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:31.434660 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c00717-f3f0-4dcb-a75f-b6b46fa66ce4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:31.442946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 541/1081] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:26:31 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:26:31.449135 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37432504-7e1c-47b1-be0f-b64df74e23ef None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:31.457556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37432504-7e1c-47b1-be0f-b64df74e23ef None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:31.461643 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b412a1f-69a2-4747-bc58-febba1087508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:31.462372 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b412a1f-69a2-4747-bc58-febba1087508 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:31.463265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b412a1f-69a2-4747-bc58-febba1087508 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:31.463545 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b412a1f-69a2-4747-bc58-febba1087508 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:31.471550 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b412a1f-69a2-4747-bc58-febba1087508 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:31.496649 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b412a1f-69a2-4747-bc58-febba1087508 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:31.511237 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-0b412a1f-69a2-4747-bc58-febba1087508 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 01:26:31.512273 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 541/1082] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Aug 23 01:26:31 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:26:31.517802 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c00717-f3f0-4dcb-a75f-b6b46fa66ce4 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:31.526580 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c00717-f3f0-4dcb-a75f-b6b46fa66ce4 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:31.530649 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77abf03-513c-4582-af2d-39155fc82e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:31.531211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77abf03-513c-4582-af2d-39155fc82e98 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:31.531494 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77abf03-513c-4582-af2d-39155fc82e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:31.531846 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77abf03-513c-4582-af2d-39155fc82e98 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:31.532526 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77abf03-513c-4582-af2d-39155fc82e98 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:26:31.532853 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77abf03-513c-4582-af2d-39155fc82e98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:31.557675 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77abf03-513c-4582-af2d-39155fc82e98 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:31.565284 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 542/1083] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Aug 23 01:26:31 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:33.477491 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a14c8e-0467-4625-9a1b-761a29635623 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:33.477932 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a14c8e-0467-4625-9a1b-761a29635623 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:33.478609 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a14c8e-0467-4625-9a1b-761a29635623 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:33.480272 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 542/1084] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:33.485247 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8a4e-1471-4f3f-b51b-76046f95a512 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:33.485688 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8a4e-1471-4f3f-b51b-76046f95a512 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:33.485794 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8a4e-1471-4f3f-b51b-76046f95a512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:33.507456 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-270c8a4e-1471-4f3f-b51b-76046f95a512 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:33.508582 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-270c8a4e-1471-4f3f-b51b-76046f95a512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:33.515194 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 543/1085] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:33 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:26:33.537345 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a14c8e-0467-4625-9a1b-761a29635623 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:33.549228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a14c8e-0467-4625-9a1b-761a29635623 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:33.553198 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c21f7-3707-4be7-a5bc-eaa2e3a840d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:33.553765 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c21f7-3707-4be7-a5bc-eaa2e3a840d1 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:33.554050 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c21f7-3707-4be7-a5bc-eaa2e3a840d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:33.554330 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c21f7-3707-4be7-a5bc-eaa2e3a840d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:33.555016 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c21f7-3707-4be7-a5bc-eaa2e3a840d1 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:33.579143 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-e81c21f7-3707-4be7-a5bc-eaa2e3a840d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:26:33.579143 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:26:33.579143 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:26:33.580004 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c21f7-3707-4be7-a5bc-eaa2e3a840d1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:33.657833 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 543/1086] 10.222.0.20 () {60 vars in 1160 bytes} [Mon Aug 23 01:26:33 2021] POST /identity/v3/domains => generated 267 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:26:35.609377 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9fdc2-97f1-478b-91c0-1a7dc2044902 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:35.609903 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9fdc2-97f1-478b-91c0-1a7dc2044902 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:35.609996 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9fdc2-97f1-478b-91c0-1a7dc2044902 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:35.611615 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 544/1087] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:35.616588 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee804fa-0b73-43ec-a41d-501d4751dd34 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:35.616951 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee804fa-0b73-43ec-a41d-501d4751dd34 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:35.617157 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee804fa-0b73-43ec-a41d-501d4751dd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:35.639969 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-eee804fa-0b73-43ec-a41d-501d4751dd34 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:35.641105 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-eee804fa-0b73-43ec-a41d-501d4751dd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:35.703205 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 544/1088] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:35 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:26:35.725579 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9fdc2-97f1-478b-91c0-1a7dc2044902 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:35.737112 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9fdc2-97f1-478b-91c0-1a7dc2044902 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:35.741161 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59314d7a-e51e-4db3-8a6a-ec6b8db433b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:35.741928 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59314d7a-e51e-4db3-8a6a-ec6b8db433b0 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:35.742215 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59314d7a-e51e-4db3-8a6a-ec6b8db433b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:35.742497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59314d7a-e51e-4db3-8a6a-ec6b8db433b0 admin admin] PATH_INFO: `/v3/domains/6e94171d2c4d4db0bd1507ec2bfb4612` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:35.754552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59314d7a-e51e-4db3-8a6a-ec6b8db433b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=6e94171d2c4d4db0bd1507ec2bfb4612)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:35.780742 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59314d7a-e51e-4db3-8a6a-ec6b8db433b0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:35.782170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 545/1089] 10.222.0.20 () {56 vars in 1205 bytes} [Mon Aug 23 01:26:35 2021] GET /identity/v3/domains/6e94171d2c4d4db0bd1507ec2bfb4612 => generated 267 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:35.787456 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee804fa-0b73-43ec-a41d-501d4751dd34 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:35.795734 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee804fa-0b73-43ec-a41d-501d4751dd34 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:35.799766 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5059b0-64db-492d-a7dc-98310f616c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:35.800333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5059b0-64db-492d-a7dc-98310f616c4f admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:35.800651 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5059b0-64db-492d-a7dc-98310f616c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:35.800928 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5059b0-64db-492d-a7dc-98310f616c4f admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:35.801575 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5059b0-64db-492d-a7dc-98310f616c4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:35.827521 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5059b0-64db-492d-a7dc-98310f616c4f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:35.916856 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 545/1090] 10.222.0.20 () {60 vars in 1163 bytes} [Mon Aug 23 01:26:35 2021] POST /identity/v3/projects => generated 361 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:26:37.878063 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcb206-8ba6-4041-bd1b-6beabe740e66 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:37.878607 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcb206-8ba6-4041-bd1b-6beabe740e66 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:37.878607 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcb206-8ba6-4041-bd1b-6beabe740e66 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:37.880194 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 546/1091] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:37.885309 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47858a9c-e6a2-47e1-8461-f1bef7d825aa None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:37.885700 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47858a9c-e6a2-47e1-8461-f1bef7d825aa None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:37.885875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47858a9c-e6a2-47e1-8461-f1bef7d825aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:37.907537 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-47858a9c-e6a2-47e1-8461-f1bef7d825aa None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:37.908681 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-47858a9c-e6a2-47e1-8461-f1bef7d825aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:37.970160 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 546/1092] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:37 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:26:37.994245 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcb206-8ba6-4041-bd1b-6beabe740e66 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:38.005656 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcb206-8ba6-4041-bd1b-6beabe740e66 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:38.009600 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48eec69-fa7c-493a-bb9d-e6abaa83810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:38.010366 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48eec69-fa7c-493a-bb9d-e6abaa83810c admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:38.010652 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48eec69-fa7c-493a-bb9d-e6abaa83810c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:38.010932 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48eec69-fa7c-493a-bb9d-e6abaa83810c admin admin] PATH_INFO: `/v3/domains/6e94171d2c4d4db0bd1507ec2bfb4612` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:38.011984 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48eec69-fa7c-493a-bb9d-e6abaa83810c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=6e94171d2c4d4db0bd1507ec2bfb4612)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:38.037798 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48eec69-fa7c-493a-bb9d-e6abaa83810c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:38.039203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 547/1093] 10.222.0.20 () {56 vars in 1205 bytes} [Mon Aug 23 01:26:37 2021] GET /identity/v3/domains/6e94171d2c4d4db0bd1507ec2bfb4612 => generated 267 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:38.045044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47858a9c-e6a2-47e1-8461-f1bef7d825aa None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:38.053705 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47858a9c-e6a2-47e1-8461-f1bef7d825aa None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:38.057901 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446023d-ec03-4f2a-9097-a1699200e2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:38.058498 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446023d-ec03-4f2a-9097-a1699200e2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:38.058788 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446023d-ec03-4f2a-9097-a1699200e2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:38.059071 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446023d-ec03-4f2a-9097-a1699200e2d1 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:38.059737 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446023d-ec03-4f2a-9097-a1699200e2d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:38.084940 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446023d-ec03-4f2a-9097-a1699200e2d1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:38.183816 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 547/1094] 10.222.0.20 () {60 vars in 1154 bytes} [Mon Aug 23 01:26:38 2021] POST /identity/v3/users => generated 311 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:26:40.170102 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc096a-9450-487a-911f-887ea800d208 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:40.170642 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc096a-9450-487a-911f-887ea800d208 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:40.170642 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc096a-9450-487a-911f-887ea800d208 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:40.172315 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 548/1095] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:40.177315 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba784b-4a09-4bc3-9b6b-9125c0c190fd None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:40.177732 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba784b-4a09-4bc3-9b6b-9125c0c190fd None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:40.177894 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba784b-4a09-4bc3-9b6b-9125c0c190fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:40.200786 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-b5ba784b-4a09-4bc3-9b6b-9125c0c190fd None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:40.201914 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-b5ba784b-4a09-4bc3-9b6b-9125c0c190fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:40.208688 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 548/1096] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:40 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:26:40.230934 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc096a-9450-487a-911f-887ea800d208 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:40.242430 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc096a-9450-487a-911f-887ea800d208 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:40.246883 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956b557-6382-4aa7-8fb0-b90aa2b59c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:40.247577 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956b557-6382-4aa7-8fb0-b90aa2b59c9a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:40.247862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956b557-6382-4aa7-8fb0-b90aa2b59c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:40.248140 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956b557-6382-4aa7-8fb0-b90aa2b59c9a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:40.258907 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956b557-6382-4aa7-8fb0-b90aa2b59c9a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:26:40.265701 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-0956b557-6382-4aa7-8fb0-b90aa2b59c9a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:26:40.266751 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 549/1097] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:26:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:26:40.272334 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba784b-4a09-4bc3-9b6b-9125c0c190fd None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:40.280747 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba784b-4a09-4bc3-9b6b-9125c0c190fd None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:40.284820 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87d0f2-f6da-4968-a753-5734c6e2f253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:40.285400 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87d0f2-f6da-4968-a753-5734c6e2f253 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:40.285689 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87d0f2-f6da-4968-a753-5734c6e2f253 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:40.285970 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87d0f2-f6da-4968-a753-5734c6e2f253 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:40.286675 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87d0f2-f6da-4968-a753-5734c6e2f253 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:26:40.286977 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87d0f2-f6da-4968-a753-5734c6e2f253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:40.312279 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87d0f2-f6da-4968-a753-5734c6e2f253 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:40.320474 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 549/1098] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:26:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:40.325773 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956b557-6382-4aa7-8fb0-b90aa2b59c9a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:40.337612 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956b557-6382-4aa7-8fb0-b90aa2b59c9a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:40.341683 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2df4a-1836-457a-937c-12e9d4557939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:40.342697 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2df4a-1836-457a-937c-12e9d4557939 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:40.342978 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2df4a-1836-457a-937c-12e9d4557939 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:40.343255 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2df4a-1836-457a-937c-12e9d4557939 admin admin] PATH_INFO: `/v3/users/bbb915efcc624ad8b8254076e316966a` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:40.361139 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2df4a-1836-457a-937c-12e9d4557939 admin admin] RBAC: Authorizing `identity:get_user(user_id=bbb915efcc624ad8b8254076e316966a)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:40.386329 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2df4a-1836-457a-937c-12e9d4557939 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:40.387803 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 550/1099] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:26:40 2021] GET /identity/v3/users/bbb915efcc624ad8b8254076e316966a => generated 311 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:40.393463 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87d0f2-f6da-4968-a753-5734c6e2f253 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:40.403383 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87d0f2-f6da-4968-a753-5734c6e2f253 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:40.408032 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8d18a-0c52-46bb-a171-6093931cb9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:40.408719 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8d18a-0c52-46bb-a171-6093931cb9eb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:40.409080 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8d18a-0c52-46bb-a171-6093931cb9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:40.409432 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8d18a-0c52-46bb-a171-6093931cb9eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:40.418001 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8d18a-0c52-46bb-a171-6093931cb9eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:40.443006 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8d18a-0c52-46bb-a171-6093931cb9eb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:40.451817 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 550/1100] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:26:40 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:26:40.457737 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2df4a-1836-457a-937c-12e9d4557939 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:40.467830 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2df4a-1836-457a-937c-12e9d4557939 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:40.471889 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e347b2d-999b-4da4-84cb-771ee1a22eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:40.472695 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e347b2d-999b-4da4-84cb-771ee1a22eaf admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:40.472988 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e347b2d-999b-4da4-84cb-771ee1a22eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:40.473266 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e347b2d-999b-4da4-84cb-771ee1a22eaf admin admin] PATH_INFO: `/v3/projects/656f45800fdc48a9bcd3a4f71423c1fd` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:40.474339 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e347b2d-999b-4da4-84cb-771ee1a22eaf admin admin] RBAC: Authorizing `identity:get_project(project_id=656f45800fdc48a9bcd3a4f71423c1fd)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:40.499517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e347b2d-999b-4da4-84cb-771ee1a22eaf admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:40.501052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 551/1101] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:26:40 2021] GET /identity/v3/projects/656f45800fdc48a9bcd3a4f71423c1fd => generated 361 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:40.506593 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8d18a-0c52-46bb-a171-6093931cb9eb admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:40.515303 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8d18a-0c52-46bb-a171-6093931cb9eb admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:40.519382 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ba915-ca8f-4d28-9644-8dc81d0e5aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:40.519943 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ba915-ca8f-4d28-9644-8dc81d0e5aab admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:40.520228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ba915-ca8f-4d28-9644-8dc81d0e5aab admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:40.520508 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ba915-ca8f-4d28-9644-8dc81d0e5aab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:40.521397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ba915-ca8f-4d28-9644-8dc81d0e5aab admin admin] RBAC: Adding query filter params (role.id=56d36413cf4047229b6f9d36a3990b0d, scope.project.id=656f45800fdc48a9bcd3a4f71423c1fd, user.id=bbb915efcc624ad8b8254076e316966a) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:26:40.521702 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ba915-ca8f-4d28-9644-8dc81d0e5aab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:40.547322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ba915-ca8f-4d28-9644-8dc81d0e5aab admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:40.552380 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 551/1102] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:26:40 2021] GET /identity/v3/role_assignments?user.id=bbb915efcc624ad8b8254076e316966a&scope.project.id=656f45800fdc48a9bcd3a4f71423c1fd&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:42.437967 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d491555-a043-433c-9309-60241ef22256 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:42.438386 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d491555-a043-433c-9309-60241ef22256 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:42.438526 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d491555-a043-433c-9309-60241ef22256 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:42.440186 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 552/1103] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:42.445261 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68ef82-7e6d-44a9-9c9e-73fe7d4a77ad None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:42.445678 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68ef82-7e6d-44a9-9c9e-73fe7d4a77ad None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:42.445821 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68ef82-7e6d-44a9-9c9e-73fe7d4a77ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:42.468383 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-8a68ef82-7e6d-44a9-9c9e-73fe7d4a77ad None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:42.469548 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-8a68ef82-7e6d-44a9-9c9e-73fe7d4a77ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:42.476163 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 552/1104] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:42 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:26:42.498245 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d491555-a043-433c-9309-60241ef22256 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:42.510191 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d491555-a043-433c-9309-60241ef22256 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:42.514119 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebdc51-4f6b-44e9-86db-190f9d534edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:42.514809 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebdc51-4f6b-44e9-86db-190f9d534edf admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:42.515092 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebdc51-4f6b-44e9-86db-190f9d534edf admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:42.515365 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebdc51-4f6b-44e9-86db-190f9d534edf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:42.526068 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebdc51-4f6b-44e9-86db-190f9d534edf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:26:42.532143 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-4aebdc51-4f6b-44e9-86db-190f9d534edf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:26:42.533226 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 553/1105] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:26:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:26:42.538629 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68ef82-7e6d-44a9-9c9e-73fe7d4a77ad None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:42.546952 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68ef82-7e6d-44a9-9c9e-73fe7d4a77ad None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:42.550929 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b5b19-3ca9-4875-bb78-e5291d945f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:42.551502 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b5b19-3ca9-4875-bb78-e5291d945f53 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:42.551783 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b5b19-3ca9-4875-bb78-e5291d945f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:42.552056 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b5b19-3ca9-4875-bb78-e5291d945f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:42.552779 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b5b19-3ca9-4875-bb78-e5291d945f53 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:26:42.553073 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b5b19-3ca9-4875-bb78-e5291d945f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:42.578982 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b5b19-3ca9-4875-bb78-e5291d945f53 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:42.587147 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 553/1106] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:26:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:42.592815 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebdc51-4f6b-44e9-86db-190f9d534edf admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:42.602567 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebdc51-4f6b-44e9-86db-190f9d534edf admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:42.607546 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812d361-8159-4e54-8ee3-97577226e7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:42.608297 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812d361-8159-4e54-8ee3-97577226e7ce admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:42.608593 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812d361-8159-4e54-8ee3-97577226e7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:42.608873 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812d361-8159-4e54-8ee3-97577226e7ce admin admin] PATH_INFO: `/v3/users/bbb915efcc624ad8b8254076e316966a` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:42.609931 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812d361-8159-4e54-8ee3-97577226e7ce admin admin] RBAC: Authorizing `identity:get_user(user_id=bbb915efcc624ad8b8254076e316966a)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:42.636199 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812d361-8159-4e54-8ee3-97577226e7ce admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:42.637650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 554/1107] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:26:42 2021] GET /identity/v3/users/bbb915efcc624ad8b8254076e316966a => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:42.642792 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b5b19-3ca9-4875-bb78-e5291d945f53 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:42.651667 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b5b19-3ca9-4875-bb78-e5291d945f53 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:42.655672 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cc78a-5acf-4a13-b6e6-f664b8a78285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:42.656431 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cc78a-5acf-4a13-b6e6-f664b8a78285 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:42.656757 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cc78a-5acf-4a13-b6e6-f664b8a78285 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:42.657042 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cc78a-5acf-4a13-b6e6-f664b8a78285 admin admin] PATH_INFO: `/v3/projects/656f45800fdc48a9bcd3a4f71423c1fd` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:42.658099 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cc78a-5acf-4a13-b6e6-f664b8a78285 admin admin] RBAC: Authorizing `identity:get_project(project_id=656f45800fdc48a9bcd3a4f71423c1fd)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:42.684457 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cc78a-5acf-4a13-b6e6-f664b8a78285 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:42.685998 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 554/1108] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:26:42 2021] GET /identity/v3/projects/656f45800fdc48a9bcd3a4f71423c1fd => generated 361 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:42.690906 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812d361-8159-4e54-8ee3-97577226e7ce admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:42.699649 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812d361-8159-4e54-8ee3-97577226e7ce admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:42.703624 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26feb0-1e46-471c-a59f-b2f4cc039fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:42.704390 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26feb0-1e46-471c-a59f-b2f4cc039fed admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:42.704707 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26feb0-1e46-471c-a59f-b2f4cc039fed admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:42.704980 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26feb0-1e46-471c-a59f-b2f4cc039fed admin admin] PATH_INFO: `/v3/projects/656f45800fdc48a9bcd3a4f71423c1fd/users/bbb915efcc624ad8b8254076e316966a/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:42.706671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26feb0-1e46-471c-a59f-b2f4cc039fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=656f45800fdc48a9bcd3a4f71423c1fd, user_id=bbb915efcc624ad8b8254076e316966a, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:42.733146 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26feb0-1e46-471c-a59f-b2f4cc039fed admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:42.803617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 555/1109] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:26:42 2021] PUT /identity/v3/projects/656f45800fdc48a9bcd3a4f71423c1fd/users/bbb915efcc624ad8b8254076e316966a/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:26:44.694550 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05348aa5-9e2b-470f-812f-53aee31d56aa None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:44.695066 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05348aa5-9e2b-470f-812f-53aee31d56aa None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:44.695066 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05348aa5-9e2b-470f-812f-53aee31d56aa None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:44.696744 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 555/1110] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:26:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:26:44.701760 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e2de9-69ec-41c5-bdea-094314f3416a None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:44.702192 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e2de9-69ec-41c5-bdea-094314f3416a None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:44.702335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e2de9-69ec-41c5-bdea-094314f3416a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:44.724903 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-863e2de9-69ec-41c5-bdea-094314f3416a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:26:44.726036 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-863e2de9-69ec-41c5-bdea-094314f3416a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:26:44.787083 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 556/1111] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:26:44 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:26:44.809879 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05348aa5-9e2b-470f-812f-53aee31d56aa None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:44.821292 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05348aa5-9e2b-470f-812f-53aee31d56aa None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:44.825193 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa863283-effd-44d4-bae1-df1116cfca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:44.825919 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa863283-effd-44d4-bae1-df1116cfca47 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:44.826211 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa863283-effd-44d4-bae1-df1116cfca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:44.826491 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa863283-effd-44d4-bae1-df1116cfca47 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:44.838519 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa863283-effd-44d4-bae1-df1116cfca47 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:26:44.845088 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-fa863283-effd-44d4-bae1-df1116cfca47 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:26:44.846150 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 556/1112] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:26:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:26:44.851958 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e2de9-69ec-41c5-bdea-094314f3416a None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:44.861011 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e2de9-69ec-41c5-bdea-094314f3416a None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:44.865111 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb858c4-9b55-45ff-89d6-f2480af62a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:44.865713 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb858c4-9b55-45ff-89d6-f2480af62a7a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:44.865999 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb858c4-9b55-45ff-89d6-f2480af62a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:44.866280 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb858c4-9b55-45ff-89d6-f2480af62a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:44.866990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb858c4-9b55-45ff-89d6-f2480af62a7a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:26:44.867290 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb858c4-9b55-45ff-89d6-f2480af62a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:44.892317 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb858c4-9b55-45ff-89d6-f2480af62a7a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:44.901126 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 557/1113] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:26:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:44.906453 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa863283-effd-44d4-bae1-df1116cfca47 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:44.915400 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa863283-effd-44d4-bae1-df1116cfca47 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:44.919453 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb579dd2-e0b7-44e6-b721-554e1a6dfe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:44.920242 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb579dd2-e0b7-44e6-b721-554e1a6dfe21 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:44.920527 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb579dd2-e0b7-44e6-b721-554e1a6dfe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:44.920834 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb579dd2-e0b7-44e6-b721-554e1a6dfe21 admin admin] PATH_INFO: `/v3/users/bbb915efcc624ad8b8254076e316966a` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:44.921897 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb579dd2-e0b7-44e6-b721-554e1a6dfe21 admin admin] RBAC: Authorizing `identity:get_user(user_id=bbb915efcc624ad8b8254076e316966a)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:44.947841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb579dd2-e0b7-44e6-b721-554e1a6dfe21 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:44.949205 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 557/1114] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:26:44 2021] GET /identity/v3/users/bbb915efcc624ad8b8254076e316966a => generated 311 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:44.954497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb858c4-9b55-45ff-89d6-f2480af62a7a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:44.963417 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb858c4-9b55-45ff-89d6-f2480af62a7a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:44.967732 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87db9d1-d665-4610-b4f2-fe87b7e7ed5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:44.968276 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87db9d1-d665-4610-b4f2-fe87b7e7ed5b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:44.968580 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87db9d1-d665-4610-b4f2-fe87b7e7ed5b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:44.968869 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87db9d1-d665-4610-b4f2-fe87b7e7ed5b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:44.976280 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87db9d1-d665-4610-b4f2-fe87b7e7ed5b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:45.002320 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87db9d1-d665-4610-b4f2-fe87b7e7ed5b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:45.010583 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 558/1115] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:26:44 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:26:45.015847 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb579dd2-e0b7-44e6-b721-554e1a6dfe21 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:45.024661 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb579dd2-e0b7-44e6-b721-554e1a6dfe21 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:45.028675 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f91de-b3f7-42b4-b81a-6e1ee91bc049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:45.029410 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f91de-b3f7-42b4-b81a-6e1ee91bc049 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:45.029695 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f91de-b3f7-42b4-b81a-6e1ee91bc049 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:45.029977 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f91de-b3f7-42b4-b81a-6e1ee91bc049 admin admin] PATH_INFO: `/v3/projects/656f45800fdc48a9bcd3a4f71423c1fd` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:45.031015 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f91de-b3f7-42b4-b81a-6e1ee91bc049 admin admin] RBAC: Authorizing `identity:get_project(project_id=656f45800fdc48a9bcd3a4f71423c1fd)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:45.057374 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f91de-b3f7-42b4-b81a-6e1ee91bc049 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:45.058811 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 558/1116] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:26:45 2021] GET /identity/v3/projects/656f45800fdc48a9bcd3a4f71423c1fd => generated 361 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:26:45.064154 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87db9d1-d665-4610-b4f2-fe87b7e7ed5b admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:26:45.072227 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87db9d1-d665-4610-b4f2-fe87b7e7ed5b admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:26:45.076308 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3a38f-b816-4644-a191-fd9d1ce0659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:26:45.076888 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3a38f-b816-4644-a191-fd9d1ce0659a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:26:45.077179 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3a38f-b816-4644-a191-fd9d1ce0659a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:26:45.077462 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3a38f-b816-4644-a191-fd9d1ce0659a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:26:45.078213 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3a38f-b816-4644-a191-fd9d1ce0659a admin admin] RBAC: Adding query filter params (role.id=56d36413cf4047229b6f9d36a3990b0d, scope.project.id=656f45800fdc48a9bcd3a4f71423c1fd, user.id=bbb915efcc624ad8b8254076e316966a) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:26:45.078516 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3a38f-b816-4644-a191-fd9d1ce0659a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:26:45.104384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3a38f-b816-4644-a191-fd9d1ce0659a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:26:45.109886 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 559/1117] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:26:45 2021] GET /identity/v3/role_assignments?user.id=bbb915efcc624ad8b8254076e316966a&scope.project.id=656f45800fdc48a9bcd3a4f71423c1fd&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:33:59.547365 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cf2d0-155c-4563-aaa9-4ce77d2cdec7 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:33:59.547922 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cf2d0-155c-4563-aaa9-4ce77d2cdec7 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:33:59.547922 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cf2d0-155c-4563-aaa9-4ce77d2cdec7 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:33:59.549615 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 559/1118] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:33:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:33:59.555240 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db365f-6b36-4d0d-bd76-d008cc143bfa None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:33:59.555634 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db365f-6b36-4d0d-bd76-d008cc143bfa None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:33:59.555809 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db365f-6b36-4d0d-bd76-d008cc143bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:33:59.639968 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-97db365f-6b36-4d0d-bd76-d008cc143bfa None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:33:59.641123 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-97db365f-6b36-4d0d-bd76-d008cc143bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:33:59.681411 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 560/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:33:59 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:33:59.704879 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cf2d0-155c-4563-aaa9-4ce77d2cdec7 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:33:59.716580 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cf2d0-155c-4563-aaa9-4ce77d2cdec7 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:33:59.720492 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb671a1-bb4d-4f57-b83a-20594b3495a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:33:59.721220 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb671a1-bb4d-4f57-b83a-20594b3495a5 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:33:59.721504 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb671a1-bb4d-4f57-b83a-20594b3495a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:33:59.721781 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb671a1-bb4d-4f57-b83a-20594b3495a5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:33:59.733984 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb671a1-bb4d-4f57-b83a-20594b3495a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:33:59.759651 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb671a1-bb4d-4f57-b83a-20594b3495a5 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:33:59.775719 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-1eb671a1-bb4d-4f57-b83a-20594b3495a5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:33:59.776783 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 560/1120] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:33:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:33:59.782384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db365f-6b36-4d0d-bd76-d008cc143bfa None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:33:59.791243 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db365f-6b36-4d0d-bd76-d008cc143bfa None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:33:59.795364 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080e989-15e6-43e5-a5fa-de938f986a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:33:59.795936 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080e989-15e6-43e5-a5fa-de938f986a54 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:33:59.796224 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080e989-15e6-43e5-a5fa-de938f986a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:33:59.796503 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080e989-15e6-43e5-a5fa-de938f986a54 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:33:59.797215 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080e989-15e6-43e5-a5fa-de938f986a54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:33:59.797514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080e989-15e6-43e5-a5fa-de938f986a54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:33:59.823116 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080e989-15e6-43e5-a5fa-de938f986a54 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:33:59.837436 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 561/1121] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:33:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:33:59.843193 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb671a1-bb4d-4f57-b83a-20594b3495a5 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:33:59.852911 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb671a1-bb4d-4f57-b83a-20594b3495a5 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:33:59.856992 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37490bc1-5256-40b5-8982-be711f3450ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:33:59.857575 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37490bc1-5256-40b5-8982-be711f3450ab admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:33:59.857863 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37490bc1-5256-40b5-8982-be711f3450ab admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:33:59.858145 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37490bc1-5256-40b5-8982-be711f3450ab admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:33:59.858779 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37490bc1-5256-40b5-8982-be711f3450ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:33:59.885067 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37490bc1-5256-40b5-8982-be711f3450ab admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:33:59.975167 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 561/1122] 10.222.0.20 () {60 vars in 1154 bytes} [Mon Aug 23 01:33:59 2021] POST /identity/v3/users => generated 251 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:34:01.991916 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e329b25-78df-4f94-bc33-c126326336bd None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:01.992480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e329b25-78df-4f94-bc33-c126326336bd None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:01.992701 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e329b25-78df-4f94-bc33-c126326336bd None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:01.994222 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 562/1123] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:34:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:34:01.999497 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f2427-d1e6-4136-b72d-14b74c4bce6c None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:01.999929 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f2427-d1e6-4136-b72d-14b74c4bce6c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:02.000138 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f2427-d1e6-4136-b72d-14b74c4bce6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:02.022440 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-268f2427-d1e6-4136-b72d-14b74c4bce6c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:34:02.023553 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-268f2427-d1e6-4136-b72d-14b74c4bce6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:34:02.030262 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 562/1124] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:34:01 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:34:02.052586 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e329b25-78df-4f94-bc33-c126326336bd None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:02.064123 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e329b25-78df-4f94-bc33-c126326336bd None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:02.068629 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ed564-be7e-4ce0-a094-560cf340a27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:02.069331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ed564-be7e-4ce0-a094-560cf340a27c admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:02.069616 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ed564-be7e-4ce0-a094-560cf340a27c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:02.069891 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ed564-be7e-4ce0-a094-560cf340a27c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:02.080924 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ed564-be7e-4ce0-a094-560cf340a27c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:34:02.088005 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-8a8ed564-be7e-4ce0-a094-560cf340a27c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:34:02.089101 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 563/1125] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:34:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:02.094851 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f2427-d1e6-4136-b72d-14b74c4bce6c None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:02.103422 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f2427-d1e6-4136-b72d-14b74c4bce6c None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:02.107563 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcfd62-635b-4cc3-8511-f8e8a9157be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:02.108139 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcfd62-635b-4cc3-8511-f8e8a9157be5 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:02.108426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcfd62-635b-4cc3-8511-f8e8a9157be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:02.108744 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcfd62-635b-4cc3-8511-f8e8a9157be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:02.109444 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcfd62-635b-4cc3-8511-f8e8a9157be5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:02.109745 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcfd62-635b-4cc3-8511-f8e8a9157be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:02.135246 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcfd62-635b-4cc3-8511-f8e8a9157be5 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:02.143439 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 563/1126] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:34:02 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:02.149479 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ed564-be7e-4ce0-a094-560cf340a27c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:02.159348 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ed564-be7e-4ce0-a094-560cf340a27c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:02.164008 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdbdaa-838c-4f97-94f0-83b740e351e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:02.165240 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdbdaa-838c-4f97-94f0-83b740e351e3 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:02.165240 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdbdaa-838c-4f97-94f0-83b740e351e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:02.165445 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdbdaa-838c-4f97-94f0-83b740e351e3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:02.176210 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdbdaa-838c-4f97-94f0-83b740e351e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:02.201637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdbdaa-838c-4f97-94f0-83b740e351e3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:02.219246 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-5efdbdaa-838c-4f97-94f0-83b740e351e3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:34:02.220298 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 564/1127] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:34:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:34:02.226431 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcfd62-635b-4cc3-8511-f8e8a9157be5 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:02.235462 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcfd62-635b-4cc3-8511-f8e8a9157be5 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:02.239560 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbad0ac-a889-48f6-8f95-0d18c51679bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:02.240130 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbad0ac-a889-48f6-8f95-0d18c51679bc admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:02.240416 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbad0ac-a889-48f6-8f95-0d18c51679bc admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:02.240738 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbad0ac-a889-48f6-8f95-0d18c51679bc admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:02.241415 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbad0ac-a889-48f6-8f95-0d18c51679bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:02.241712 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbad0ac-a889-48f6-8f95-0d18c51679bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:02.266538 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbad0ac-a889-48f6-8f95-0d18c51679bc admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:02.280644 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 564/1128] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:34:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:02.286542 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdbdaa-838c-4f97-94f0-83b740e351e3 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:02.295586 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdbdaa-838c-4f97-94f0-83b740e351e3 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:02.299650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7953d9-ff06-47d8-973b-5c6b43573540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:02.300344 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7953d9-ff06-47d8-973b-5c6b43573540 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:02.300667 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7953d9-ff06-47d8-973b-5c6b43573540 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:02.300967 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7953d9-ff06-47d8-973b-5c6b43573540 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:02.313079 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7953d9-ff06-47d8-973b-5c6b43573540 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:02.338904 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7953d9-ff06-47d8-973b-5c6b43573540 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:02.356457 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-3a7953d9-ff06-47d8-973b-5c6b43573540 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 01:34:02.357517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 565/1129] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:34:02 2021] GET /identity/v3/users/placement => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:02.362984 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbad0ac-a889-48f6-8f95-0d18c51679bc admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:02.372117 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbad0ac-a889-48f6-8f95-0d18c51679bc admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:02.376201 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a30753-695a-4206-a40e-8312f27b3b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:02.376824 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a30753-695a-4206-a40e-8312f27b3b50 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:02.377114 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a30753-695a-4206-a40e-8312f27b3b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:02.377394 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a30753-695a-4206-a40e-8312f27b3b50 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:02.378174 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a30753-695a-4206-a40e-8312f27b3b50 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:02.378472 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a30753-695a-4206-a40e-8312f27b3b50 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:02.404067 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a30753-695a-4206-a40e-8312f27b3b50 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:02.432799 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 565/1130] 10.222.0.20 () {56 vars in 1165 bytes} [Mon Aug 23 01:34:02 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:02.438564 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7953d9-ff06-47d8-973b-5c6b43573540 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:02.447697 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7953d9-ff06-47d8-973b-5c6b43573540 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:02.451722 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d20493-a5c5-4a1c-85c6-9ec93c5d576b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:02.452279 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d20493-a5c5-4a1c-85c6-9ec93c5d576b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:02.452583 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d20493-a5c5-4a1c-85c6-9ec93c5d576b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:02.452879 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d20493-a5c5-4a1c-85c6-9ec93c5d576b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:02.461010 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d20493-a5c5-4a1c-85c6-9ec93c5d576b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:02.486465 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d20493-a5c5-4a1c-85c6-9ec93c5d576b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:02.495594 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 566/1131] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:34:02 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:34:02.501014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a30753-695a-4206-a40e-8312f27b3b50 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:02.510405 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a30753-695a-4206-a40e-8312f27b3b50 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:02.514496 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1bef0-7127-4065-ab61-eb859d93855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:02.515190 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1bef0-7127-4065-ab61-eb859d93855c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:02.515474 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1bef0-7127-4065-ab61-eb859d93855c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:02.515752 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1bef0-7127-4065-ab61-eb859d93855c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:02.527483 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1bef0-7127-4065-ab61-eb859d93855c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:02.552442 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1bef0-7127-4065-ab61-eb859d93855c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:02.569066 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-c4c1bef0-7127-4065-ab61-eb859d93855c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:34:02.570098 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 566/1132] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:34:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:34:02.575437 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d20493-a5c5-4a1c-85c6-9ec93c5d576b admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:02.584601 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d20493-a5c5-4a1c-85c6-9ec93c5d576b admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:02.588667 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b097e1-105c-4fb9-a009-519717f758d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:02.589233 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b097e1-105c-4fb9-a009-519717f758d0 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:02.589517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b097e1-105c-4fb9-a009-519717f758d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:02.589794 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b097e1-105c-4fb9-a009-519717f758d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:02.590465 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b097e1-105c-4fb9-a009-519717f758d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:02.590768 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b097e1-105c-4fb9-a009-519717f758d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:02.615519 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b097e1-105c-4fb9-a009-519717f758d0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:02.627568 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 567/1133] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:34:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:02.633133 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1bef0-7127-4065-ab61-eb859d93855c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:02.642016 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1bef0-7127-4065-ab61-eb859d93855c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:02.646642 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dfdd2-7acc-4871-a7a0-94b6bd2d0758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:02.647316 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dfdd2-7acc-4871-a7a0-94b6bd2d0758 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:02.647600 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dfdd2-7acc-4871-a7a0-94b6bd2d0758 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:02.647873 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dfdd2-7acc-4871-a7a0-94b6bd2d0758 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:02.656426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51dfdd2-7acc-4871-a7a0-94b6bd2d0758 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:02.681643 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51dfdd2-7acc-4871-a7a0-94b6bd2d0758 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:02.695350 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-c51dfdd2-7acc-4871-a7a0-94b6bd2d0758 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:34:02.696419 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 567/1134] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:34:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:34:02.702384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b097e1-105c-4fb9-a009-519717f758d0 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:02.713591 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b097e1-105c-4fb9-a009-519717f758d0 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:02.717706 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32194bb7-2011-48ea-99d9-2439e0aa80a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:02.718286 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32194bb7-2011-48ea-99d9-2439e0aa80a3 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:02.718572 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32194bb7-2011-48ea-99d9-2439e0aa80a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:02.718852 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32194bb7-2011-48ea-99d9-2439e0aa80a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:02.719587 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32194bb7-2011-48ea-99d9-2439e0aa80a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:02.719889 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32194bb7-2011-48ea-99d9-2439e0aa80a3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:02.745497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32194bb7-2011-48ea-99d9-2439e0aa80a3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:02.760359 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 568/1135] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:34:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:02.766421 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dfdd2-7acc-4871-a7a0-94b6bd2d0758 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:02.776196 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dfdd2-7acc-4871-a7a0-94b6bd2d0758 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:02.780298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4eb6a-1eb6-49e9-bbf0-32dc668955c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:02.780848 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4eb6a-1eb6-49e9-bbf0-32dc668955c2 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:02.781137 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4eb6a-1eb6-49e9-bbf0-32dc668955c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:02.781417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4eb6a-1eb6-49e9-bbf0-32dc668955c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:02.782192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4eb6a-1eb6-49e9-bbf0-32dc668955c2 admin admin] RBAC: Adding query filter params (role.id=aa34949eb3ac4431991f6c257fca79a9, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=c4a6c587fd604395908134c50ce7618d) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:02.782494 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4eb6a-1eb6-49e9-bbf0-32dc668955c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:02.807580 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4eb6a-1eb6-49e9-bbf0-32dc668955c2 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:02.812725 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 568/1136] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:34:02 2021] GET /identity/v3/role_assignments?user.id=c4a6c587fd604395908134c50ce7618d&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=aa34949eb3ac4431991f6c257fca79a9 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:04.758847 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323964ce-0dcc-4bd8-a9db-b6aef4ba9fb9 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:04.759338 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323964ce-0dcc-4bd8-a9db-b6aef4ba9fb9 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:04.759338 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323964ce-0dcc-4bd8-a9db-b6aef4ba9fb9 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:04.761036 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 569/1137] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:34:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:34:04.766244 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb15725-e3e0-4ec8-ba95-699f7831643d None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:04.766609 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb15725-e3e0-4ec8-ba95-699f7831643d None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:04.766805 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb15725-e3e0-4ec8-ba95-699f7831643d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:04.789436 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-ceb15725-e3e0-4ec8-ba95-699f7831643d None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:34:04.790544 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ceb15725-e3e0-4ec8-ba95-699f7831643d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:34:04.797311 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 569/1138] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:34:04 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:34:04.819164 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323964ce-0dcc-4bd8-a9db-b6aef4ba9fb9 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:04.830584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323964ce-0dcc-4bd8-a9db-b6aef4ba9fb9 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:04.835401 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3cbd8-ea6c-4791-8a56-50d67f774148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:04.836101 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3cbd8-ea6c-4791-8a56-50d67f774148 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:04.836390 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3cbd8-ea6c-4791-8a56-50d67f774148 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:04.836708 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3cbd8-ea6c-4791-8a56-50d67f774148 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:04.847454 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3cbd8-ea6c-4791-8a56-50d67f774148 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:34:04.853764 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-deb3cbd8-ea6c-4791-8a56-50d67f774148 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:34:04.854812 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 570/1139] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:34:04 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:04.860343 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb15725-e3e0-4ec8-ba95-699f7831643d None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:04.868664 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb15725-e3e0-4ec8-ba95-699f7831643d None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:04.872650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7c6ef-b13c-4e52-9c85-3cf86c5aa6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:04.873222 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7c6ef-b13c-4e52-9c85-3cf86c5aa6ff admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:04.873504 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7c6ef-b13c-4e52-9c85-3cf86c5aa6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:04.873777 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7c6ef-b13c-4e52-9c85-3cf86c5aa6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:04.874461 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7c6ef-b13c-4e52-9c85-3cf86c5aa6ff admin admin] RBAC: Adding query filter params (name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:04.874751 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7c6ef-b13c-4e52-9c85-3cf86c5aa6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:04.900166 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7c6ef-b13c-4e52-9c85-3cf86c5aa6ff admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:04.908128 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 570/1140] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:34:04 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:04.913965 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3cbd8-ea6c-4791-8a56-50d67f774148 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:04.923257 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3cbd8-ea6c-4791-8a56-50d67f774148 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:04.927394 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78037bcd-573d-4e94-8f51-ca8e45743956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:04.928068 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78037bcd-573d-4e94-8f51-ca8e45743956 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:04.928352 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78037bcd-573d-4e94-8f51-ca8e45743956 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:04.928659 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78037bcd-573d-4e94-8f51-ca8e45743956 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:04.939412 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78037bcd-573d-4e94-8f51-ca8e45743956 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:04.965836 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78037bcd-573d-4e94-8f51-ca8e45743956 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:04.982572 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-78037bcd-573d-4e94-8f51-ca8e45743956 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:34:04.983585 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 571/1141] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:34:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:04.989893 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7c6ef-b13c-4e52-9c85-3cf86c5aa6ff admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:04.998707 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7c6ef-b13c-4e52-9c85-3cf86c5aa6ff admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:05.002775 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cb55f-7878-4418-b83d-1f64b3336955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:05.003333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cb55f-7878-4418-b83d-1f64b3336955 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:05.003617 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cb55f-7878-4418-b83d-1f64b3336955 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:05.003896 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cb55f-7878-4418-b83d-1f64b3336955 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:05.005069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5cb55f-7878-4418-b83d-1f64b3336955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:05.005363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5cb55f-7878-4418-b83d-1f64b3336955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:05.030660 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5cb55f-7878-4418-b83d-1f64b3336955 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:05.042737 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 571/1142] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:34:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:05.047927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78037bcd-573d-4e94-8f51-ca8e45743956 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:05.056750 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78037bcd-573d-4e94-8f51-ca8e45743956 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:05.060801 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01348062-42b5-4dcf-9442-30957411370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:05.061484 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01348062-42b5-4dcf-9442-30957411370f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:05.061771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01348062-42b5-4dcf-9442-30957411370f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:05.062050 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01348062-42b5-4dcf-9442-30957411370f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:05.074703 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01348062-42b5-4dcf-9442-30957411370f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:05.100824 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01348062-42b5-4dcf-9442-30957411370f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:05.118495 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-01348062-42b5-4dcf-9442-30957411370f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 01:34:05.119511 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 572/1143] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:34:05 2021] GET /identity/v3/users/placement => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:05.124771 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cb55f-7878-4418-b83d-1f64b3336955 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:05.133547 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cb55f-7878-4418-b83d-1f64b3336955 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:05.137560 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe12016-fea7-4b05-b7fc-775c353170b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:05.138126 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe12016-fea7-4b05-b7fc-775c353170b0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:05.138409 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe12016-fea7-4b05-b7fc-775c353170b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:05.138683 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe12016-fea7-4b05-b7fc-775c353170b0 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:05.139447 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe12016-fea7-4b05-b7fc-775c353170b0 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:05.139742 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe12016-fea7-4b05-b7fc-775c353170b0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:05.165886 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe12016-fea7-4b05-b7fc-775c353170b0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:05.193388 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 572/1144] 10.222.0.20 () {56 vars in 1165 bytes} [Mon Aug 23 01:34:05 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:05.198769 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01348062-42b5-4dcf-9442-30957411370f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:05.208612 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01348062-42b5-4dcf-9442-30957411370f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:05.212684 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df669531-36bc-4bb8-9b80-0f70efe95953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:05.213376 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df669531-36bc-4bb8-9b80-0f70efe95953 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:05.213660 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df669531-36bc-4bb8-9b80-0f70efe95953 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:05.213935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df669531-36bc-4bb8-9b80-0f70efe95953 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:05.225866 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df669531-36bc-4bb8-9b80-0f70efe95953 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:05.251362 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df669531-36bc-4bb8-9b80-0f70efe95953 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:05.268222 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-df669531-36bc-4bb8-9b80-0f70efe95953 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:34:05.269285 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 573/1145] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:34:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:05.274917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe12016-fea7-4b05-b7fc-775c353170b0 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:05.285041 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe12016-fea7-4b05-b7fc-775c353170b0 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:05.288837 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30048456-4a88-4f5a-bd20-eaf64fe0cc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:05.289462 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30048456-4a88-4f5a-bd20-eaf64fe0cc92 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:05.289746 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30048456-4a88-4f5a-bd20-eaf64fe0cc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:05.290020 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30048456-4a88-4f5a-bd20-eaf64fe0cc92 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:05.290687 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30048456-4a88-4f5a-bd20-eaf64fe0cc92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:05.290980 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30048456-4a88-4f5a-bd20-eaf64fe0cc92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:05.317133 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30048456-4a88-4f5a-bd20-eaf64fe0cc92 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:05.329380 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 573/1146] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:34:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:05.335033 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df669531-36bc-4bb8-9b80-0f70efe95953 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:05.344043 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df669531-36bc-4bb8-9b80-0f70efe95953 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:05.348038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565183a5-5526-410d-a8ff-6c0e1a7892b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:05.348758 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565183a5-5526-410d-a8ff-6c0e1a7892b9 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:05.349046 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565183a5-5526-410d-a8ff-6c0e1a7892b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:05.349326 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565183a5-5526-410d-a8ff-6c0e1a7892b9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:05.357987 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565183a5-5526-410d-a8ff-6c0e1a7892b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:05.384372 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565183a5-5526-410d-a8ff-6c0e1a7892b9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:05.397705 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-565183a5-5526-410d-a8ff-6c0e1a7892b9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:34:05.398761 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 574/1147] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:34:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:05.404365 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30048456-4a88-4f5a-bd20-eaf64fe0cc92 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:05.413411 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30048456-4a88-4f5a-bd20-eaf64fe0cc92 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:05.417435 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38593c-ad73-435d-a742-5d126f08ab9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:05.418008 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38593c-ad73-435d-a742-5d126f08ab9c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:05.418293 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38593c-ad73-435d-a742-5d126f08ab9c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:05.418628 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38593c-ad73-435d-a742-5d126f08ab9c admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:05.419359 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38593c-ad73-435d-a742-5d126f08ab9c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:05.419655 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38593c-ad73-435d-a742-5d126f08ab9c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:05.445942 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38593c-ad73-435d-a742-5d126f08ab9c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:05.458795 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 574/1148] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:34:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:34:05.464509 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565183a5-5526-410d-a8ff-6c0e1a7892b9 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:05.474335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565183a5-5526-410d-a8ff-6c0e1a7892b9 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:05.478405 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19184ce2-353a-4aab-9189-a13f8af26912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:05.479193 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19184ce2-353a-4aab-9189-a13f8af26912 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:05.479477 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19184ce2-353a-4aab-9189-a13f8af26912 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:05.479753 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19184ce2-353a-4aab-9189-a13f8af26912 admin admin] PATH_INFO: `/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/c4a6c587fd604395908134c50ce7618d/roles/aa34949eb3ac4431991f6c257fca79a9` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:05.517199 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19184ce2-353a-4aab-9189-a13f8af26912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2728fddda1c4691b33daad4fa4ef3d2, user_id=c4a6c587fd604395908134c50ce7618d, role_id=aa34949eb3ac4431991f6c257fca79a9)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:05.543732 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19184ce2-353a-4aab-9189-a13f8af26912 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:05.659979 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 575/1149] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:34:05 2021] PUT /identity/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/c4a6c587fd604395908134c50ce7618d/roles/aa34949eb3ac4431991f6c257fca79a9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:34:07.596350 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbc87a-0d3f-49eb-aa29-7c43bad1c247 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:07.596914 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbc87a-0d3f-49eb-aa29-7c43bad1c247 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:07.596999 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbc87a-0d3f-49eb-aa29-7c43bad1c247 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:07.598751 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 575/1150] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:34:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:34:07.603637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d650c-feb6-47a3-acfb-49ed90cb368a None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:07.604029 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d650c-feb6-47a3-acfb-49ed90cb368a None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:07.604195 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d650c-feb6-47a3-acfb-49ed90cb368a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:07.626572 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-839d650c-feb6-47a3-acfb-49ed90cb368a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:34:07.627693 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-839d650c-feb6-47a3-acfb-49ed90cb368a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:34:07.689917 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 576/1151] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:34:07 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:34:07.713109 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbc87a-0d3f-49eb-aa29-7c43bad1c247 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:07.725096 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbc87a-0d3f-49eb-aa29-7c43bad1c247 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:07.729031 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5e0cf-d1d0-4e5d-87ac-a964a5612154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:07.729735 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e0cf-d1d0-4e5d-87ac-a964a5612154 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:07.730021 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e0cf-d1d0-4e5d-87ac-a964a5612154 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:07.730298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e0cf-d1d0-4e5d-87ac-a964a5612154 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:07.741016 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5e0cf-d1d0-4e5d-87ac-a964a5612154 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:34:07.747262 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-bab5e0cf-d1d0-4e5d-87ac-a964a5612154 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 01:34:07.748314 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 576/1152] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 23 01:34:07 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:34:07.754468 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d650c-feb6-47a3-acfb-49ed90cb368a None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:07.762764 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d650c-feb6-47a3-acfb-49ed90cb368a None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:07.766791 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb249bf-7d26-4002-8f98-40417abf8e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:07.767364 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb249bf-7d26-4002-8f98-40417abf8e48 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:07.767650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb249bf-7d26-4002-8f98-40417abf8e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:07.767930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb249bf-7d26-4002-8f98-40417abf8e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:07.768665 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb249bf-7d26-4002-8f98-40417abf8e48 admin admin] RBAC: Adding query filter params (name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:07.768961 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb249bf-7d26-4002-8f98-40417abf8e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:07.795031 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb249bf-7d26-4002-8f98-40417abf8e48 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:07.803757 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 577/1153] 10.222.0.20 () {56 vars in 1125 bytes} [Mon Aug 23 01:34:07 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:07.809183 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5e0cf-d1d0-4e5d-87ac-a964a5612154 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:07.818634 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5e0cf-d1d0-4e5d-87ac-a964a5612154 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:07.822709 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8bb00-668a-4b05-9689-12714892977e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:07.823397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8bb00-668a-4b05-9689-12714892977e admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:07.823685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8bb00-668a-4b05-9689-12714892977e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:07.823964 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8bb00-668a-4b05-9689-12714892977e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:07.834972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8bb00-668a-4b05-9689-12714892977e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:07.860421 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8bb00-668a-4b05-9689-12714892977e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:07.878977 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-e6d8bb00-668a-4b05-9689-12714892977e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:34:07.880258 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 577/1154] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:34:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:34:07.885582 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb249bf-7d26-4002-8f98-40417abf8e48 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:07.894641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb249bf-7d26-4002-8f98-40417abf8e48 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:07.898656 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79d8e5-6c72-40b3-91be-82195bad4d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:07.899222 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79d8e5-6c72-40b3-91be-82195bad4d03 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:07.899507 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79d8e5-6c72-40b3-91be-82195bad4d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:07.899790 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79d8e5-6c72-40b3-91be-82195bad4d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:07.900461 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79d8e5-6c72-40b3-91be-82195bad4d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:07.900785 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79d8e5-6c72-40b3-91be-82195bad4d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:07.926678 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79d8e5-6c72-40b3-91be-82195bad4d03 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:07.938829 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 578/1155] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:34:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:34:07.944503 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8bb00-668a-4b05-9689-12714892977e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:07.953299 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8bb00-668a-4b05-9689-12714892977e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:07.957386 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2b856-e6af-4e94-80dd-072b4278bc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:07.958330 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2b856-e6af-4e94-80dd-072b4278bc52 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:07.958612 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2b856-e6af-4e94-80dd-072b4278bc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:07.958889 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2b856-e6af-4e94-80dd-072b4278bc52 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:07.970985 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2b856-e6af-4e94-80dd-072b4278bc52 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:07.997117 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2b856-e6af-4e94-80dd-072b4278bc52 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:08.014051 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-fcf2b856-e6af-4e94-80dd-072b4278bc52 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 01:34:08.015063 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 578/1156] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:34:07 2021] GET /identity/v3/users/placement => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:08.020277 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79d8e5-6c72-40b3-91be-82195bad4d03 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:08.029152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79d8e5-6c72-40b3-91be-82195bad4d03 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:08.033105 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f9774-fc22-484c-b4a4-2f3f5b1d7ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:08.033671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f9774-fc22-484c-b4a4-2f3f5b1d7ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:08.033954 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f9774-fc22-484c-b4a4-2f3f5b1d7ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:08.034229 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f9774-fc22-484c-b4a4-2f3f5b1d7ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:08.034996 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f9774-fc22-484c-b4a4-2f3f5b1d7ce9 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:08.035808 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f9774-fc22-484c-b4a4-2f3f5b1d7ce9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:08.061413 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f9774-fc22-484c-b4a4-2f3f5b1d7ce9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:08.089017 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 579/1157] 10.222.0.20 () {56 vars in 1165 bytes} [Mon Aug 23 01:34:08 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:08.094198 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2b856-e6af-4e94-80dd-072b4278bc52 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:08.103532 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2b856-e6af-4e94-80dd-072b4278bc52 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:08.107556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a7e8d-2c5d-48e7-9ac1-02651223c7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:08.108103 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a7e8d-2c5d-48e7-9ac1-02651223c7bb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:08.108387 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a7e8d-2c5d-48e7-9ac1-02651223c7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:08.108691 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a7e8d-2c5d-48e7-9ac1-02651223c7bb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:08.116659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a7e8d-2c5d-48e7-9ac1-02651223c7bb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:08.142021 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a7e8d-2c5d-48e7-9ac1-02651223c7bb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:08.152016 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 579/1158] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:34:08 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:34:08.157429 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f9774-fc22-484c-b4a4-2f3f5b1d7ce9 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:08.167001 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f9774-fc22-484c-b4a4-2f3f5b1d7ce9 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:08.171059 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd664b-e71f-465d-9526-07ab40474926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:08.171755 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd664b-e71f-465d-9526-07ab40474926 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:08.172043 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd664b-e71f-465d-9526-07ab40474926 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:08.172321 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd664b-e71f-465d-9526-07ab40474926 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:08.183439 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd664b-e71f-465d-9526-07ab40474926 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:08.209268 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd664b-e71f-465d-9526-07ab40474926 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:08.225833 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-11cd664b-e71f-465d-9526-07ab40474926 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:34:08.226856 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 580/1159] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:34:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:34:08.232143 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a7e8d-2c5d-48e7-9ac1-02651223c7bb admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:08.240367 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a7e8d-2c5d-48e7-9ac1-02651223c7bb admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:08.244464 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3496eb-a331-4a15-9ff7-675bb05e5175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:08.245068 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3496eb-a331-4a15-9ff7-675bb05e5175 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:08.245357 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3496eb-a331-4a15-9ff7-675bb05e5175 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:08.245638 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3496eb-a331-4a15-9ff7-675bb05e5175 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:08.246306 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3496eb-a331-4a15-9ff7-675bb05e5175 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:08.246609 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3496eb-a331-4a15-9ff7-675bb05e5175 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:08.271732 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3496eb-a331-4a15-9ff7-675bb05e5175 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:08.283807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 580/1160] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:34:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:08.289548 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd664b-e71f-465d-9526-07ab40474926 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:08.298405 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd664b-e71f-465d-9526-07ab40474926 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:08.302493 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911fe35-1f87-4ca3-884a-5c43f30feaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:08.303185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911fe35-1f87-4ca3-884a-5c43f30feaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:08.303469 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911fe35-1f87-4ca3-884a-5c43f30feaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:08.303749 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911fe35-1f87-4ca3-884a-5c43f30feaf8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:08.312344 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911fe35-1f87-4ca3-884a-5c43f30feaf8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:08.338355 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911fe35-1f87-4ca3-884a-5c43f30feaf8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:08.351962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-9911fe35-1f87-4ca3-884a-5c43f30feaf8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:34:08.353008 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 581/1161] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:34:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:08.358245 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3496eb-a331-4a15-9ff7-675bb05e5175 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:08.367241 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3496eb-a331-4a15-9ff7-675bb05e5175 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:08.371343 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd49f2-aab7-499c-9f45-dbd98c231c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:08.371916 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd49f2-aab7-499c-9f45-dbd98c231c47 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:08.372202 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd49f2-aab7-499c-9f45-dbd98c231c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:08.372486 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd49f2-aab7-499c-9f45-dbd98c231c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:08.373258 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd49f2-aab7-499c-9f45-dbd98c231c47 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:08.373561 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd49f2-aab7-499c-9f45-dbd98c231c47 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:08.399165 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd49f2-aab7-499c-9f45-dbd98c231c47 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:08.412507 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 581/1162] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:34:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:08.418201 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911fe35-1f87-4ca3-884a-5c43f30feaf8 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:08.427273 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911fe35-1f87-4ca3-884a-5c43f30feaf8 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:08.431308 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63295e00-0744-4339-9202-59e8ac2e2874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:08.431883 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63295e00-0744-4339-9202-59e8ac2e2874 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:08.432155 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63295e00-0744-4339-9202-59e8ac2e2874 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:08.432434 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63295e00-0744-4339-9202-59e8ac2e2874 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:08.433229 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63295e00-0744-4339-9202-59e8ac2e2874 admin admin] RBAC: Adding query filter params (role.id=aa34949eb3ac4431991f6c257fca79a9, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=c4a6c587fd604395908134c50ce7618d) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:08.433533 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63295e00-0744-4339-9202-59e8ac2e2874 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:08.459599 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63295e00-0744-4339-9202-59e8ac2e2874 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:08.465049 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 582/1163] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:34:08 2021] GET /identity/v3/role_assignments?user.id=c4a6c587fd604395908134c50ce7618d&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=aa34949eb3ac4431991f6c257fca79a9 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:10.484697 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c09d2-42bc-4010-90a1-e4d2ce67d55f None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:10.485217 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c09d2-42bc-4010-90a1-e4d2ce67d55f None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:10.485308 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c09d2-42bc-4010-90a1-e4d2ce67d55f None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:10.486920 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 582/1164] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:34:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:34:10.491892 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ca3d0-1603-4d24-b651-9e95e947b424 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:10.492270 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ca3d0-1603-4d24-b651-9e95e947b424 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:10.492458 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ca3d0-1603-4d24-b651-9e95e947b424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:10.514540 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-800ca3d0-1603-4d24-b651-9e95e947b424 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:34:10.515673 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-800ca3d0-1603-4d24-b651-9e95e947b424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:34:10.523014 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 583/1165] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:34:10 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:34:10.546258 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c09d2-42bc-4010-90a1-e4d2ce67d55f None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:10.557858 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c09d2-42bc-4010-90a1-e4d2ce67d55f None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:10.561913 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f298f1-7f86-43f3-8da9-83af16d2f920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:10.562609 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f298f1-7f86-43f3-8da9-83af16d2f920 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:10.562919 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f298f1-7f86-43f3-8da9-83af16d2f920 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:10.563205 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f298f1-7f86-43f3-8da9-83af16d2f920 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:10.574181 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f298f1-7f86-43f3-8da9-83af16d2f920 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:34:10.580527 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-b0f298f1-7f86-43f3-8da9-83af16d2f920 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:34:10.581607 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 583/1166] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:34:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:10.587907 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ca3d0-1603-4d24-b651-9e95e947b424 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:10.596311 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ca3d0-1603-4d24-b651-9e95e947b424 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:10.601092 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff8045-7ccf-45a2-9190-f8c4ca316501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:10.601698 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff8045-7ccf-45a2-9190-f8c4ca316501 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:10.601988 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff8045-7ccf-45a2-9190-f8c4ca316501 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:10.602285 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff8045-7ccf-45a2-9190-f8c4ca316501 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:10.602992 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff8045-7ccf-45a2-9190-f8c4ca316501 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:10.603292 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff8045-7ccf-45a2-9190-f8c4ca316501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:10.628896 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff8045-7ccf-45a2-9190-f8c4ca316501 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:10.637405 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 584/1167] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:34:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:10.642687 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f298f1-7f86-43f3-8da9-83af16d2f920 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:10.652640 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f298f1-7f86-43f3-8da9-83af16d2f920 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:10.656870 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fea737-b9d5-4c93-aba5-4f5803ff4b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:10.657556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fea737-b9d5-4c93-aba5-4f5803ff4b34 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:10.657841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fea737-b9d5-4c93-aba5-4f5803ff4b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:10.658116 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fea737-b9d5-4c93-aba5-4f5803ff4b34 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:10.669650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fea737-b9d5-4c93-aba5-4f5803ff4b34 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:10.695920 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fea737-b9d5-4c93-aba5-4f5803ff4b34 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:10.713653 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-d1fea737-b9d5-4c93-aba5-4f5803ff4b34 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:34:10.714707 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 584/1168] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:34:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:10.720185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff8045-7ccf-45a2-9190-f8c4ca316501 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:10.729975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff8045-7ccf-45a2-9190-f8c4ca316501 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:10.734182 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de9890-ae79-4751-bee1-cc117e994a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:10.734756 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de9890-ae79-4751-bee1-cc117e994a81 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:10.735044 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de9890-ae79-4751-bee1-cc117e994a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:10.735322 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de9890-ae79-4751-bee1-cc117e994a81 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:10.735994 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de9890-ae79-4751-bee1-cc117e994a81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:10.736290 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de9890-ae79-4751-bee1-cc117e994a81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:10.761981 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de9890-ae79-4751-bee1-cc117e994a81 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:10.774883 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 585/1169] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:34:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:10.780271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fea737-b9d5-4c93-aba5-4f5803ff4b34 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:10.789397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fea737-b9d5-4c93-aba5-4f5803ff4b34 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:10.793468 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d7c5d-2ec9-4695-a710-145af525c9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:10.794171 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d7c5d-2ec9-4695-a710-145af525c9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:10.794466 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d7c5d-2ec9-4695-a710-145af525c9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:10.794743 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d7c5d-2ec9-4695-a710-145af525c9c5 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:10.807048 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d7c5d-2ec9-4695-a710-145af525c9c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:10.833923 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d7c5d-2ec9-4695-a710-145af525c9c5 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:10.851055 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-0c6d7c5d-2ec9-4695-a710-145af525c9c5 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 01:34:10.856588 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 585/1170] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:34:10 2021] GET /identity/v3/users/placement => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:10.857773 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de9890-ae79-4751-bee1-cc117e994a81 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:10.867041 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de9890-ae79-4751-bee1-cc117e994a81 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:10.871365 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42b568-4860-4277-bd68-76fd0327b303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:10.871954 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42b568-4860-4277-bd68-76fd0327b303 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:10.872248 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42b568-4860-4277-bd68-76fd0327b303 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:10.872535 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42b568-4860-4277-bd68-76fd0327b303 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:10.873354 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42b568-4860-4277-bd68-76fd0327b303 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:10.873658 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42b568-4860-4277-bd68-76fd0327b303 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:10.900744 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42b568-4860-4277-bd68-76fd0327b303 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:10.930886 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 586/1171] 10.222.0.20 () {56 vars in 1165 bytes} [Mon Aug 23 01:34:10 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:34:10.936455 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d7c5d-2ec9-4695-a710-145af525c9c5 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:10.946114 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d7c5d-2ec9-4695-a710-145af525c9c5 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:10.950180 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca755d2d-557f-4d89-b109-bbae5919bc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:10.950741 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca755d2d-557f-4d89-b109-bbae5919bc91 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:10.951026 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca755d2d-557f-4d89-b109-bbae5919bc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:10.951305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca755d2d-557f-4d89-b109-bbae5919bc91 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:10.959521 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca755d2d-557f-4d89-b109-bbae5919bc91 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:10.984552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca755d2d-557f-4d89-b109-bbae5919bc91 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:10.993719 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 586/1172] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:34:10 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:34:10.999218 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42b568-4860-4277-bd68-76fd0327b303 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:11.009043 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42b568-4860-4277-bd68-76fd0327b303 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:11.013336 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6660a2-300b-4c9f-805b-5eddf0d60f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:11.014059 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6660a2-300b-4c9f-805b-5eddf0d60f91 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:11.014346 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6660a2-300b-4c9f-805b-5eddf0d60f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:11.014626 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6660a2-300b-4c9f-805b-5eddf0d60f91 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:11.026840 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6660a2-300b-4c9f-805b-5eddf0d60f91 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:11.052041 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6660a2-300b-4c9f-805b-5eddf0d60f91 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:11.068989 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-2a6660a2-300b-4c9f-805b-5eddf0d60f91 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:34:11.070034 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 587/1173] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:34:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:34:11.075442 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca755d2d-557f-4d89-b109-bbae5919bc91 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:11.084576 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca755d2d-557f-4d89-b109-bbae5919bc91 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:11.089001 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23ce42-3512-4f5a-9c35-22bc6ce93357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:11.089579 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23ce42-3512-4f5a-9c35-22bc6ce93357 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:11.089866 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23ce42-3512-4f5a-9c35-22bc6ce93357 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:11.090144 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23ce42-3512-4f5a-9c35-22bc6ce93357 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:11.090818 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23ce42-3512-4f5a-9c35-22bc6ce93357 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:11.091115 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23ce42-3512-4f5a-9c35-22bc6ce93357 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:11.116490 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23ce42-3512-4f5a-9c35-22bc6ce93357 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:11.129529 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 587/1174] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:34:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:11.134832 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6660a2-300b-4c9f-805b-5eddf0d60f91 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:11.143799 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6660a2-300b-4c9f-805b-5eddf0d60f91 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:11.147830 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa97de5-6eec-4f48-9ed7-e775b787aa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:11.148514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa97de5-6eec-4f48-9ed7-e775b787aa93 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:11.148826 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa97de5-6eec-4f48-9ed7-e775b787aa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:11.149101 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa97de5-6eec-4f48-9ed7-e775b787aa93 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:11.157632 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa97de5-6eec-4f48-9ed7-e775b787aa93 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:11.183393 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa97de5-6eec-4f48-9ed7-e775b787aa93 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:11.196976 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-caa97de5-6eec-4f48-9ed7-e775b787aa93 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:34:11.200809 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 588/1175] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:34:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:34:11.203387 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23ce42-3512-4f5a-9c35-22bc6ce93357 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:11.212729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23ce42-3512-4f5a-9c35-22bc6ce93357 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:11.216766 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6925a84-6452-4b6d-a5b4-3ae444d07034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:11.217336 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6925a84-6452-4b6d-a5b4-3ae444d07034 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:11.217624 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6925a84-6452-4b6d-a5b4-3ae444d07034 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:11.217903 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6925a84-6452-4b6d-a5b4-3ae444d07034 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:11.218645 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6925a84-6452-4b6d-a5b4-3ae444d07034 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:11.218980 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6925a84-6452-4b6d-a5b4-3ae444d07034 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:11.244719 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6925a84-6452-4b6d-a5b4-3ae444d07034 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:11.257983 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 588/1176] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:34:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:34:11.263505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa97de5-6eec-4f48-9ed7-e775b787aa93 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:11.272461 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa97de5-6eec-4f48-9ed7-e775b787aa93 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:11.276445 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce842f5b-53cf-4ef9-9015-01d378b9dca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:11.277027 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce842f5b-53cf-4ef9-9015-01d378b9dca2 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:11.277307 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce842f5b-53cf-4ef9-9015-01d378b9dca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:11.277584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce842f5b-53cf-4ef9-9015-01d378b9dca2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:11.278346 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce842f5b-53cf-4ef9-9015-01d378b9dca2 admin admin] RBAC: Adding query filter params (role.id=56d36413cf4047229b6f9d36a3990b0d, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=c4a6c587fd604395908134c50ce7618d) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:11.278644 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce842f5b-53cf-4ef9-9015-01d378b9dca2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:11.304203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce842f5b-53cf-4ef9-9015-01d378b9dca2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:11.309341 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 589/1177] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:34:11 2021] GET /identity/v3/role_assignments?user.id=c4a6c587fd604395908134c50ce7618d&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:13.228544 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb782a5-55c9-4744-9b1a-949fa6aa95ce None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:13.229086 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb782a5-55c9-4744-9b1a-949fa6aa95ce None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:13.229248 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb782a5-55c9-4744-9b1a-949fa6aa95ce None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:13.230909 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 589/1178] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:34:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:34:13.235941 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851459d-e1bb-4ad8-91ab-3f7977d3749f None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:13.236333 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851459d-e1bb-4ad8-91ab-3f7977d3749f None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:13.236511 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851459d-e1bb-4ad8-91ab-3f7977d3749f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:13.258983 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-d851459d-e1bb-4ad8-91ab-3f7977d3749f None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:34:13.260105 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d851459d-e1bb-4ad8-91ab-3f7977d3749f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:34:13.266910 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 590/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:34:13 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:34:13.288795 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb782a5-55c9-4744-9b1a-949fa6aa95ce None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:13.300435 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb782a5-55c9-4744-9b1a-949fa6aa95ce None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:13.304414 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439ec69-0aa8-40b9-bc4b-a87c131bb204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:13.305143 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439ec69-0aa8-40b9-bc4b-a87c131bb204 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:13.305428 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439ec69-0aa8-40b9-bc4b-a87c131bb204 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:13.305703 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439ec69-0aa8-40b9-bc4b-a87c131bb204 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:13.316965 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439ec69-0aa8-40b9-bc4b-a87c131bb204 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:34:13.323083 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-6439ec69-0aa8-40b9-bc4b-a87c131bb204 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:34:13.324120 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 590/1180] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:34:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:13.329566 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851459d-e1bb-4ad8-91ab-3f7977d3749f None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:13.338145 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851459d-e1bb-4ad8-91ab-3f7977d3749f None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:13.342384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deb7a6-aaf3-4d81-b202-5a78407ecc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:13.342972 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deb7a6-aaf3-4d81-b202-5a78407ecc3c admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:13.343261 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deb7a6-aaf3-4d81-b202-5a78407ecc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:13.343542 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deb7a6-aaf3-4d81-b202-5a78407ecc3c admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:13.344254 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99deb7a6-aaf3-4d81-b202-5a78407ecc3c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:13.344555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99deb7a6-aaf3-4d81-b202-5a78407ecc3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:13.370705 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99deb7a6-aaf3-4d81-b202-5a78407ecc3c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:13.379313 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 591/1181] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:34:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:13.384845 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439ec69-0aa8-40b9-bc4b-a87c131bb204 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:13.394677 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439ec69-0aa8-40b9-bc4b-a87c131bb204 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:13.398763 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bc82c-0822-425e-9fd0-45c10b60ff9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:13.399449 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bc82c-0822-425e-9fd0-45c10b60ff9c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:13.399732 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bc82c-0822-425e-9fd0-45c10b60ff9c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:13.400008 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bc82c-0822-425e-9fd0-45c10b60ff9c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:13.411209 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bc82c-0822-425e-9fd0-45c10b60ff9c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:13.436202 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bc82c-0822-425e-9fd0-45c10b60ff9c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:13.453903 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-d76bc82c-0822-425e-9fd0-45c10b60ff9c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:34:13.454947 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 591/1182] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:34:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:34:13.461346 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deb7a6-aaf3-4d81-b202-5a78407ecc3c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:13.470409 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deb7a6-aaf3-4d81-b202-5a78407ecc3c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:13.475107 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e15cc-77c1-4bee-a3fa-8a5aa19a9915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:13.475681 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e15cc-77c1-4bee-a3fa-8a5aa19a9915 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:13.475971 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e15cc-77c1-4bee-a3fa-8a5aa19a9915 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:13.476252 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e15cc-77c1-4bee-a3fa-8a5aa19a9915 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:13.476973 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e15cc-77c1-4bee-a3fa-8a5aa19a9915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:13.477273 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e15cc-77c1-4bee-a3fa-8a5aa19a9915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:13.502346 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e15cc-77c1-4bee-a3fa-8a5aa19a9915 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:13.514725 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 592/1183] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:34:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:13.520597 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bc82c-0822-425e-9fd0-45c10b60ff9c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:13.531714 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bc82c-0822-425e-9fd0-45c10b60ff9c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:13.540719 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07770266-98b1-410b-91a8-6e2f3df6c5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:13.541424 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07770266-98b1-410b-91a8-6e2f3df6c5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:13.541711 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07770266-98b1-410b-91a8-6e2f3df6c5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:13.541986 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07770266-98b1-410b-91a8-6e2f3df6c5d4 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:13.564265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07770266-98b1-410b-91a8-6e2f3df6c5d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:13.590101 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07770266-98b1-410b-91a8-6e2f3df6c5d4 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:13.607824 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-07770266-98b1-410b-91a8-6e2f3df6c5d4 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 01:34:13.608886 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 592/1184] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:34:13 2021] GET /identity/v3/users/placement => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:34:13.614525 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e15cc-77c1-4bee-a3fa-8a5aa19a9915 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:13.623641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e15cc-77c1-4bee-a3fa-8a5aa19a9915 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:13.627720 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990e907-0b6f-47f3-8b61-aeddb2b92cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:13.628302 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990e907-0b6f-47f3-8b61-aeddb2b92cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:13.628619 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990e907-0b6f-47f3-8b61-aeddb2b92cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:13.628905 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990e907-0b6f-47f3-8b61-aeddb2b92cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:13.629688 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990e907-0b6f-47f3-8b61-aeddb2b92cd9 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:13.630080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990e907-0b6f-47f3-8b61-aeddb2b92cd9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:13.655771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990e907-0b6f-47f3-8b61-aeddb2b92cd9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:13.684202 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 593/1185] 10.222.0.20 () {56 vars in 1165 bytes} [Mon Aug 23 01:34:13 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:13.689436 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07770266-98b1-410b-91a8-6e2f3df6c5d4 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:13.698293 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07770266-98b1-410b-91a8-6e2f3df6c5d4 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:13.702275 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86462d17-7581-4cf7-a2ab-25b6a4947d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:13.702958 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86462d17-7581-4cf7-a2ab-25b6a4947d94 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:13.703240 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86462d17-7581-4cf7-a2ab-25b6a4947d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:13.703512 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86462d17-7581-4cf7-a2ab-25b6a4947d94 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:13.715902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86462d17-7581-4cf7-a2ab-25b6a4947d94 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:13.741286 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86462d17-7581-4cf7-a2ab-25b6a4947d94 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:13.757577 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-86462d17-7581-4cf7-a2ab-25b6a4947d94 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:34:13.758529 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 593/1186] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:34:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:13.763761 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990e907-0b6f-47f3-8b61-aeddb2b92cd9 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:13.773499 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990e907-0b6f-47f3-8b61-aeddb2b92cd9 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:13.777601 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287a639-9d50-486e-b8af-4893eaa80595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:13.778171 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287a639-9d50-486e-b8af-4893eaa80595 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:13.778460 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287a639-9d50-486e-b8af-4893eaa80595 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:13.778744 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287a639-9d50-486e-b8af-4893eaa80595 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:13.779423 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287a639-9d50-486e-b8af-4893eaa80595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:13.779724 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287a639-9d50-486e-b8af-4893eaa80595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:13.804682 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287a639-9d50-486e-b8af-4893eaa80595 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:13.817381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 594/1187] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:34:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:13.823832 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86462d17-7581-4cf7-a2ab-25b6a4947d94 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:13.833760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86462d17-7581-4cf7-a2ab-25b6a4947d94 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:13.837838 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a37ba0-3865-4a10-b165-74279913f9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:13.838533 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a37ba0-3865-4a10-b165-74279913f9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:13.838816 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a37ba0-3865-4a10-b165-74279913f9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:13.839091 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a37ba0-3865-4a10-b165-74279913f9e5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:13.848056 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a37ba0-3865-4a10-b165-74279913f9e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:13.873629 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a37ba0-3865-4a10-b165-74279913f9e5 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:13.887847 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-a4a37ba0-3865-4a10-b165-74279913f9e5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:34:13.888953 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 594/1188] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:34:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:34:13.895389 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287a639-9d50-486e-b8af-4893eaa80595 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:13.904624 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287a639-9d50-486e-b8af-4893eaa80595 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:13.908836 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaeb96-d96d-415f-a849-f9c917a2e266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:13.909412 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaeb96-d96d-415f-a849-f9c917a2e266 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:13.909704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaeb96-d96d-415f-a849-f9c917a2e266 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:13.910019 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaeb96-d96d-415f-a849-f9c917a2e266 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:13.910786 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaeb96-d96d-415f-a849-f9c917a2e266 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:13.911093 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaeb96-d96d-415f-a849-f9c917a2e266 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:13.936298 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaeb96-d96d-415f-a849-f9c917a2e266 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:13.949474 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 595/1189] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:34:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:13.954904 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a37ba0-3865-4a10-b165-74279913f9e5 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:13.964577 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a37ba0-3865-4a10-b165-74279913f9e5 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:13.968554 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f28ac4-d822-4b50-83a0-f9976c2f0e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:13.969355 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f28ac4-d822-4b50-83a0-f9976c2f0e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:13.969638 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f28ac4-d822-4b50-83a0-f9976c2f0e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:13.969912 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f28ac4-d822-4b50-83a0-f9976c2f0e46 admin admin] PATH_INFO: `/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/c4a6c587fd604395908134c50ce7618d/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:13.971605 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f28ac4-d822-4b50-83a0-f9976c2f0e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2728fddda1c4691b33daad4fa4ef3d2, user_id=c4a6c587fd604395908134c50ce7618d, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:13.997832 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f28ac4-d822-4b50-83a0-f9976c2f0e46 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:14.117188 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 595/1190] 10.222.0.20 () {58 vars in 1461 bytes} [Mon Aug 23 01:34:13 2021] PUT /identity/v3/projects/f2728fddda1c4691b33daad4fa4ef3d2/users/c4a6c587fd604395908134c50ce7618d/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:34:16.064025 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca52c4b-1ca0-4138-82fe-06aca902dfa1 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:16.064589 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca52c4b-1ca0-4138-82fe-06aca902dfa1 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:16.064589 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca52c4b-1ca0-4138-82fe-06aca902dfa1 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:16.066754 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 596/1191] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:34:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:34:16.071903 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab328f41-8973-470a-a7ce-5de70fbf57a2 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:16.072323 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab328f41-8973-470a-a7ce-5de70fbf57a2 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:16.072463 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab328f41-8973-470a-a7ce-5de70fbf57a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:16.095341 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-ab328f41-8973-470a-a7ce-5de70fbf57a2 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:34:16.096441 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ab328f41-8973-470a-a7ce-5de70fbf57a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:34:16.174841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 596/1192] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:34:16 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:34:16.198206 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca52c4b-1ca0-4138-82fe-06aca902dfa1 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:16.210825 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca52c4b-1ca0-4138-82fe-06aca902dfa1 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:16.214838 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e0c84-25c2-41f7-be15-8d7c30587d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:16.215543 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e0c84-25c2-41f7-be15-8d7c30587d6e admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:16.215829 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e0c84-25c2-41f7-be15-8d7c30587d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:16.216110 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e0c84-25c2-41f7-be15-8d7c30587d6e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:16.226946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e0c84-25c2-41f7-be15-8d7c30587d6e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 23 01:34:16.233191 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-148e0c84-25c2-41f7-be15-8d7c30587d6e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 01:34:16.234299 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 597/1193] 10.222.0.20 () {56 vars in 1118 bytes} [Mon Aug 23 01:34:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:16.240038 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab328f41-8973-470a-a7ce-5de70fbf57a2 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:16.248277 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab328f41-8973-470a-a7ce-5de70fbf57a2 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:16.252335 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062adc9-2e7c-4c79-af84-1e7e849af214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:16.252945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062adc9-2e7c-4c79-af84-1e7e849af214 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:16.253229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062adc9-2e7c-4c79-af84-1e7e849af214 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:16.254028 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062adc9-2e7c-4c79-af84-1e7e849af214 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:16.254721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062adc9-2e7c-4c79-af84-1e7e849af214 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:16.255016 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062adc9-2e7c-4c79-af84-1e7e849af214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:16.280406 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062adc9-2e7c-4c79-af84-1e7e849af214 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:16.288544 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 597/1194] 10.222.0.20 () {56 vars in 1121 bytes} [Mon Aug 23 01:34:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:16.293985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e0c84-25c2-41f7-be15-8d7c30587d6e admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:16.303440 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e0c84-25c2-41f7-be15-8d7c30587d6e admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:16.307430 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f313e-fbc4-4603-af87-0a2971dee01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:16.308110 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f313e-fbc4-4603-af87-0a2971dee01f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:16.308399 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f313e-fbc4-4603-af87-0a2971dee01f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:16.308767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f313e-fbc4-4603-af87-0a2971dee01f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:16.320092 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f313e-fbc4-4603-af87-0a2971dee01f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:16.346028 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f313e-fbc4-4603-af87-0a2971dee01f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:16.362789 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-b14f313e-fbc4-4603-af87-0a2971dee01f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:34:16.364337 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 598/1195] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:34:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:34:16.369801 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062adc9-2e7c-4c79-af84-1e7e849af214 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:16.379425 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062adc9-2e7c-4c79-af84-1e7e849af214 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:16.383515 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319dcbd-1504-473d-81dd-673aa49a269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:16.384089 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319dcbd-1504-473d-81dd-673aa49a269a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:16.384380 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319dcbd-1504-473d-81dd-673aa49a269a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:16.384704 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319dcbd-1504-473d-81dd-673aa49a269a admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:16.385382 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319dcbd-1504-473d-81dd-673aa49a269a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:16.385685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319dcbd-1504-473d-81dd-673aa49a269a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:16.410493 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319dcbd-1504-473d-81dd-673aa49a269a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:16.423035 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 598/1196] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:34:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:16.431393 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f313e-fbc4-4603-af87-0a2971dee01f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:16.440774 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f313e-fbc4-4603-af87-0a2971dee01f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:16.445640 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b1c17-4676-44fc-b2dc-20252af4e8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:16.446358 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b1c17-4676-44fc-b2dc-20252af4e8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:16.446650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b1c17-4676-44fc-b2dc-20252af4e8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:16.446934 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b1c17-4676-44fc-b2dc-20252af4e8f1 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:16.461277 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b1c17-4676-44fc-b2dc-20252af4e8f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:16.486730 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b1c17-4676-44fc-b2dc-20252af4e8f1 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:16.505185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-bb6b1c17-4676-44fc-b2dc-20252af4e8f1 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 01:34:16.506241 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 599/1197] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:34:16 2021] GET /identity/v3/users/placement => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:16.512155 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319dcbd-1504-473d-81dd-673aa49a269a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:16.521355 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319dcbd-1504-473d-81dd-673aa49a269a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:16.525453 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388eab3-edad-4372-8199-b9a664dd28b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:16.526042 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388eab3-edad-4372-8199-b9a664dd28b9 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:16.526333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388eab3-edad-4372-8199-b9a664dd28b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:16.526619 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388eab3-edad-4372-8199-b9a664dd28b9 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:16.527398 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388eab3-edad-4372-8199-b9a664dd28b9 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:16.527702 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388eab3-edad-4372-8199-b9a664dd28b9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:16.553470 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388eab3-edad-4372-8199-b9a664dd28b9 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:16.582553 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 599/1198] 10.222.0.20 () {56 vars in 1165 bytes} [Mon Aug 23 01:34:16 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:16.587868 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b1c17-4676-44fc-b2dc-20252af4e8f1 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:16.596947 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b1c17-4676-44fc-b2dc-20252af4e8f1 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:16.601609 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02827ca7-da8f-498c-ac2f-6f2e076bd545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:16.602186 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02827ca7-da8f-498c-ac2f-6f2e076bd545 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:16.602474 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02827ca7-da8f-498c-ac2f-6f2e076bd545 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:16.602756 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02827ca7-da8f-498c-ac2f-6f2e076bd545 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:16.610474 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02827ca7-da8f-498c-ac2f-6f2e076bd545 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:16.635738 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02827ca7-da8f-498c-ac2f-6f2e076bd545 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:16.645429 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 600/1199] 10.222.0.20 () {58 vars in 1325 bytes} [Mon Aug 23 01:34:16 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:34:16.650784 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388eab3-edad-4372-8199-b9a664dd28b9 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:16.660373 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388eab3-edad-4372-8199-b9a664dd28b9 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:16.664441 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d62e1-2afb-4e71-9875-b84eafee23b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:16.665179 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d62e1-2afb-4e71-9875-b84eafee23b6 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:16.665468 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d62e1-2afb-4e71-9875-b84eafee23b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:16.665753 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d62e1-2afb-4e71-9875-b84eafee23b6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:16.677011 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d62e1-2afb-4e71-9875-b84eafee23b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:16.702072 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d62e1-2afb-4e71-9875-b84eafee23b6 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:16.719069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-dc5d62e1-2afb-4e71-9875-b84eafee23b6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 01:34:16.720158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 600/1200] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Aug 23 01:34:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 01:34:16.726353 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02827ca7-da8f-498c-ac2f-6f2e076bd545 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:16.734808 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02827ca7-da8f-498c-ac2f-6f2e076bd545 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:16.738980 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759ffd5-d375-4516-a2a9-b740e7d1e39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:16.739555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759ffd5-d375-4516-a2a9-b740e7d1e39f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:16.739844 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759ffd5-d375-4516-a2a9-b740e7d1e39f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:16.740126 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759ffd5-d375-4516-a2a9-b740e7d1e39f admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:16.740839 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759ffd5-d375-4516-a2a9-b740e7d1e39f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:16.741138 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759ffd5-d375-4516-a2a9-b740e7d1e39f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:16.766555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759ffd5-d375-4516-a2a9-b740e7d1e39f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:16.779526 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 601/1201] 10.222.0.20 () {56 vars in 1131 bytes} [Mon Aug 23 01:34:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:16.784857 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d62e1-2afb-4e71-9875-b84eafee23b6 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:16.793832 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d62e1-2afb-4e71-9875-b84eafee23b6 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:16.797866 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9ede6-cc08-48a7-bdf5-1b497584204d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:16.798550 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9ede6-cc08-48a7-bdf5-1b497584204d admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:16.798843 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9ede6-cc08-48a7-bdf5-1b497584204d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:16.799122 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9ede6-cc08-48a7-bdf5-1b497584204d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:16.807754 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9ede6-cc08-48a7-bdf5-1b497584204d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:16.834239 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9ede6-cc08-48a7-bdf5-1b497584204d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:16.847381 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING keystone.server.flask.application [None req-c7d9ede6-cc08-48a7-bdf5-1b497584204d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 01:34:16.848402 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 601/1202] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 23 01:34:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:16.853809 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759ffd5-d375-4516-a2a9-b740e7d1e39f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:16.862782 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759ffd5-d375-4516-a2a9-b740e7d1e39f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:16.866889 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89a296-5141-4019-be01-6043770085b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:16.867456 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89a296-5141-4019-be01-6043770085b7 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:16.867744 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89a296-5141-4019-be01-6043770085b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:16.868022 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89a296-5141-4019-be01-6043770085b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:16.868782 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89a296-5141-4019-be01-6043770085b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:16.869085 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89a296-5141-4019-be01-6043770085b7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:16.894770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89a296-5141-4019-be01-6043770085b7 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:16.907415 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 602/1203] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Aug 23 01:34:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:16.913200 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9ede6-cc08-48a7-bdf5-1b497584204d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:16.922120 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9ede6-cc08-48a7-bdf5-1b497584204d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:16.926784 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778dc45-63ad-4538-84b7-d90c3d0f893f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:16.927340 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778dc45-63ad-4538-84b7-d90c3d0f893f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:16.927627 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778dc45-63ad-4538-84b7-d90c3d0f893f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:16.927909 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778dc45-63ad-4538-84b7-d90c3d0f893f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:16.928697 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778dc45-63ad-4538-84b7-d90c3d0f893f admin admin] RBAC: Adding query filter params (role.id=56d36413cf4047229b6f9d36a3990b0d, scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2, user.id=c4a6c587fd604395908134c50ce7618d) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:16.929003 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778dc45-63ad-4538-84b7-d90c3d0f893f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:16.954213 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778dc45-63ad-4538-84b7-d90c3d0f893f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:16.960010 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 602/1204] 10.222.0.20 () {56 vars in 1396 bytes} [Mon Aug 23 01:34:16 2021] GET /identity/v3/role_assignments?user.id=c4a6c587fd604395908134c50ce7618d&scope.project.id=f2728fddda1c4691b33daad4fa4ef3d2&role.id=56d36413cf4047229b6f9d36a3990b0d => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:18.921103 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf7eba-eb91-460d-994c-1bccd191dfad None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:18.921653 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf7eba-eb91-460d-994c-1bccd191dfad None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:18.921653 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf7eba-eb91-460d-994c-1bccd191dfad None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:18.923308 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 603/1205] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:34:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:34:18.928795 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a184-fdd6-42a3-b9ee-6c972534d387 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:18.929217 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a184-fdd6-42a3-b9ee-6c972534d387 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:18.929353 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a184-fdd6-42a3-b9ee-6c972534d387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:18.955363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-72f9a184-fdd6-42a3-b9ee-6c972534d387 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:34:18.956499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-72f9a184-fdd6-42a3-b9ee-6c972534d387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:34:18.963398 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 603/1206] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:34:18 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:34:18.985619 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf7eba-eb91-460d-994c-1bccd191dfad None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:18.997555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf7eba-eb91-460d-994c-1bccd191dfad None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:19.001481 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60e26f-e867-4e34-9b18-5fc6e47c4bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:19.002183 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60e26f-e867-4e34-9b18-5fc6e47c4bea admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:19.002470 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60e26f-e867-4e34-9b18-5fc6e47c4bea admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:19.002747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60e26f-e867-4e34-9b18-5fc6e47c4bea admin admin] PATH_INFO: `/v3/services/placement` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:19.003358 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60e26f-e867-4e34-9b18-5fc6e47c4bea admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:19.028077 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60e26f-e867-4e34-9b18-5fc6e47c4bea admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:19.041058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-cb60e26f-e867-4e34-9b18-5fc6e47c4bea admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 01:34:19.042159 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 604/1207] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Aug 23 01:34:18 2021] GET /identity/v3/services/placement => generated 90 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:19.048327 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9a184-fdd6-42a3-b9ee-6c972534d387 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:19.057555 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9a184-fdd6-42a3-b9ee-6c972534d387 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:19.061728 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e5019-9c6a-4f8f-8db4-dd52de2ea10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:19.062312 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e5019-9c6a-4f8f-8db4-dd52de2ea10b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:19.062599 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e5019-9c6a-4f8f-8db4-dd52de2ea10b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:19.062880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e5019-9c6a-4f8f-8db4-dd52de2ea10b admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:19.063686 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e5019-9c6a-4f8f-8db4-dd52de2ea10b admin admin] RBAC: Adding query filter params (name=placement) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:19.063986 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e5019-9c6a-4f8f-8db4-dd52de2ea10b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:19.089321 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e5019-9c6a-4f8f-8db4-dd52de2ea10b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:19.094207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 604/1208] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Aug 23 01:34:19 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:19.100324 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60e26f-e867-4e34-9b18-5fc6e47c4bea admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:19.109628 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60e26f-e867-4e34-9b18-5fc6e47c4bea admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:19.114379 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a068b-1cf4-4384-8baf-35063b5ddf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:19.114965 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a068b-1cf4-4384-8baf-35063b5ddf3f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:19.115284 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a068b-1cf4-4384-8baf-35063b5ddf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:19.115595 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a068b-1cf4-4384-8baf-35063b5ddf3f admin admin] PATH_INFO: `/v3/services` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:19.116256 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a068b-1cf4-4384-8baf-35063b5ddf3f admin admin] RBAC: Adding query filter params (type=placement) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:19.116552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a068b-1cf4-4384-8baf-35063b5ddf3f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:19.141410 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a068b-1cf4-4384-8baf-35063b5ddf3f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:19.145800 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 605/1209] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Aug 23 01:34:19 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:21.074132 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b66a9-b658-4f39-bc3f-f481c5f0f84f None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:21.074682 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b66a9-b658-4f39-bc3f-f481c5f0f84f None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:21.074682 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b66a9-b658-4f39-bc3f-f481c5f0f84f None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:21.076333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 605/1210] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:34:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:34:21.081309 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5269d0-5aa9-4ab4-ab4e-88c9febfd309 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:21.082489 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5269d0-5aa9-4ab4-ab4e-88c9febfd309 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:21.082615 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5269d0-5aa9-4ab4-ab4e-88c9febfd309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:21.105130 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-6e5269d0-5aa9-4ab4-ab4e-88c9febfd309 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:34:21.106251 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-6e5269d0-5aa9-4ab4-ab4e-88c9febfd309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:34:21.113011 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 606/1211] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:34:21 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:34:21.134751 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b66a9-b658-4f39-bc3f-f481c5f0f84f None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:21.146582 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b66a9-b658-4f39-bc3f-f481c5f0f84f None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:21.150477 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc99c6-6802-4c45-badb-1dc12a87f7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:21.151044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc99c6-6802-4c45-badb-1dc12a87f7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:21.151330 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc99c6-6802-4c45-badb-1dc12a87f7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:21.151606 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc99c6-6802-4c45-badb-1dc12a87f7e9 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:21.152275 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc99c6-6802-4c45-badb-1dc12a87f7e9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:21.178078 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc99c6-6802-4c45-badb-1dc12a87f7e9 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:21.276197 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 606/1212] 10.222.0.20 () {60 vars in 1163 bytes} [Mon Aug 23 01:34:21 2021] POST /identity/v3/services => generated 246 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:34:23.231171 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee02150-c134-429c-8560-84660cbb3422 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:23.231726 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee02150-c134-429c-8560-84660cbb3422 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:23.231726 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee02150-c134-429c-8560-84660cbb3422 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:23.233405 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 607/1213] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:34:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:34:23.238481 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e973725-5d02-46ca-96e6-ce1e9851f63d None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:23.238865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e973725-5d02-46ca-96e6-ce1e9851f63d None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:23.239054 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e973725-5d02-46ca-96e6-ce1e9851f63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:23.260766 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-4e973725-5d02-46ca-96e6-ce1e9851f63d None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:34:23.261887 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-4e973725-5d02-46ca-96e6-ce1e9851f63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:34:23.279244 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 607/1214] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:34:23 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:34:23.301335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee02150-c134-429c-8560-84660cbb3422 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:23.313114 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee02150-c134-429c-8560-84660cbb3422 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:23.317040 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c147b-40e0-485f-b625-491e243d27fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:23.317757 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c147b-40e0-485f-b625-491e243d27fa admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:23.318097 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c147b-40e0-485f-b625-491e243d27fa admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:23.318378 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c147b-40e0-485f-b625-491e243d27fa admin admin] PATH_INFO: `/v3/services/placement` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:23.318985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c147b-40e0-485f-b625-491e243d27fa admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:23.344492 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c147b-40e0-485f-b625-491e243d27fa admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:23.355026 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-ad0c147b-40e0-485f-b625-491e243d27fa admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 01:34:23.356043 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 608/1215] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Aug 23 01:34:23 2021] GET /identity/v3/services/placement => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:23.361587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e973725-5d02-46ca-96e6-ce1e9851f63d None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:23.369913 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e973725-5d02-46ca-96e6-ce1e9851f63d None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:23.373995 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3548d-6407-4bfd-9963-ca2d7e45eda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:23.374576 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3548d-6407-4bfd-9963-ca2d7e45eda8 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:23.374865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3548d-6407-4bfd-9963-ca2d7e45eda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:23.375144 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3548d-6407-4bfd-9963-ca2d7e45eda8 admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:23.375810 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3548d-6407-4bfd-9963-ca2d7e45eda8 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:23.376110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3548d-6407-4bfd-9963-ca2d7e45eda8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:23.401464 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3548d-6407-4bfd-9963-ca2d7e45eda8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:23.406593 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 608/1216] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Aug 23 01:34:23 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:34:23.412747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c147b-40e0-485f-b625-491e243d27fa admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:23.421769 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c147b-40e0-485f-b625-491e243d27fa admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:23.425858 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0ebff-3d11-4102-8d96-e3beb808f192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:23.426414 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0ebff-3d11-4102-8d96-e3beb808f192 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:23.426697 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0ebff-3d11-4102-8d96-e3beb808f192 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:23.426973 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0ebff-3d11-4102-8d96-e3beb808f192 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:23.427704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0ebff-3d11-4102-8d96-e3beb808f192 admin admin] RBAC: Adding query filter params (interface=public, service_id=10ff5f5b59a24075bcbf834af6ca6689, region_id=RegionOne) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:23.428003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0ebff-3d11-4102-8d96-e3beb808f192 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:23.452773 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0ebff-3d11-4102-8d96-e3beb808f192 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:23.458494 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 609/1217] 10.222.0.20 () {56 vars in 1273 bytes} [Mon Aug 23 01:34:23 2021] GET /identity/v3/endpoints?service_id=10ff5f5b59a24075bcbf834af6ca6689&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:34:23.463796 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3548d-6407-4bfd-9963-ca2d7e45eda8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:23.473353 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3548d-6407-4bfd-9963-ca2d7e45eda8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:23.477424 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2290da5-2984-4aad-a146-7670b7a78bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:23.477999 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2290da5-2984-4aad-a146-7670b7a78bba admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:23.478286 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2290da5-2984-4aad-a146-7670b7a78bba admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:23.478565 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2290da5-2984-4aad-a146-7670b7a78bba admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:23.479197 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2290da5-2984-4aad-a146-7670b7a78bba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:23.504400 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2290da5-2984-4aad-a146-7670b7a78bba admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:23.511199 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 609/1218] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 23 01:34:23 2021] GET /identity/v3/services => generated 2430 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:34:25.434825 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c3722-1f51-4eb8-90ea-f6841c380830 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:25.435237 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c3722-1f51-4eb8-90ea-f6841c380830 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:25.435376 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c3722-1f51-4eb8-90ea-f6841c380830 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:25.437075 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 610/1219] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:34:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:34:25.443083 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af3754-e5f9-4a3c-9c39-5b143c66b866 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:25.443506 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af3754-e5f9-4a3c-9c39-5b143c66b866 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:25.443644 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af3754-e5f9-4a3c-9c39-5b143c66b866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:25.468575 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-01af3754-e5f9-4a3c-9c39-5b143c66b866 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:34:25.469715 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-01af3754-e5f9-4a3c-9c39-5b143c66b866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:34:25.481341 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 610/1220] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:34:25 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:34:25.511854 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c3722-1f51-4eb8-90ea-f6841c380830 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:25.526548 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c3722-1f51-4eb8-90ea-f6841c380830 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:25.530485 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21d236-7859-46be-b567-886b8ed323e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:25.531190 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21d236-7859-46be-b567-886b8ed323e2 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:25.531473 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21d236-7859-46be-b567-886b8ed323e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:25.531747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21d236-7859-46be-b567-886b8ed323e2 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:25.532360 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21d236-7859-46be-b567-886b8ed323e2 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:25.558298 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21d236-7859-46be-b567-886b8ed323e2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:25.568998 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING keystone.server.flask.application [None req-0a21d236-7859-46be-b567-886b8ed323e2 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 01:34:25.570039 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 611/1221] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Aug 23 01:34:25 2021] GET /identity/v3/services/placement => generated 90 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 01:34:25.575861 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af3754-e5f9-4a3c-9c39-5b143c66b866 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:25.584719 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af3754-e5f9-4a3c-9c39-5b143c66b866 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:25.588939 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782897f-b044-48b5-9d9a-fa74dc3042cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:25.589522 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782897f-b044-48b5-9d9a-fa74dc3042cf admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:25.589814 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782897f-b044-48b5-9d9a-fa74dc3042cf admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:25.590097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782897f-b044-48b5-9d9a-fa74dc3042cf admin admin] PATH_INFO: `/v3/services` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:25.590762 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782897f-b044-48b5-9d9a-fa74dc3042cf admin admin] RBAC: Adding query filter params (name=placement) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:34:25.591061 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782897f-b044-48b5-9d9a-fa74dc3042cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:25.616465 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782897f-b044-48b5-9d9a-fa74dc3042cf admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:25.621620 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 611/1222] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Aug 23 01:34:25 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:34:25.626623 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21d236-7859-46be-b567-886b8ed323e2 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:34:25.637025 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21d236-7859-46be-b567-886b8ed323e2 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:34:25.641065 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f93c2-666e-48dc-8a5e-8a405af7528e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:34:25.641609 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f93c2-666e-48dc-8a5e-8a405af7528e admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:34:25.641893 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f93c2-666e-48dc-8a5e-8a405af7528e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:34:25.642170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f93c2-666e-48dc-8a5e-8a405af7528e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:34:25.642847 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f93c2-666e-48dc-8a5e-8a405af7528e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:34:25.667387 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f93c2-666e-48dc-8a5e-8a405af7528e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:34:25.774268 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 612/1223] 10.222.0.20 () {60 vars in 1166 bytes} [Mon Aug 23 01:34:25 2021] POST /identity/v3/endpoints => generated 331 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:44:01.280396 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be0689-7685-4a18-95a8-d7b6f4a8ae52 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:01.281031 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be0689-7685-4a18-95a8-d7b6f4a8ae52 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:01.281031 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be0689-7685-4a18-95a8-d7b6f4a8ae52 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:01.283263 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 612/1224] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:44:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:01.287775 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0600602-623f-4f39-82ef-6ba734a97ec3 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:01.288196 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0600602-623f-4f39-82ef-6ba734a97ec3 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:01.288334 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0600602-623f-4f39-82ef-6ba734a97ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:01.375594 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-e0600602-623f-4f39-82ef-6ba734a97ec3 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:01.377061 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-e0600602-623f-4f39-82ef-6ba734a97ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:01.488856 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 613/1225] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:44:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:44:01.511501 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be0689-7685-4a18-95a8-d7b6f4a8ae52 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:44:01.513168 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-95be0689-7685-4a18-95a8-d7b6f4a8ae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:01.663232 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be0689-7685-4a18-95a8-d7b6f4a8ae52 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:44:01.775647 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611228d2-564d-444b-b35a-7216607d6904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:44:01.776252 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611228d2-564d-444b-b35a-7216607d6904 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:01.776544 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611228d2-564d-444b-b35a-7216607d6904 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:01.776856 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611228d2-564d-444b-b35a-7216607d6904 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:01.777543 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611228d2-564d-444b-b35a-7216607d6904 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:44:01.804984 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611228d2-564d-444b-b35a-7216607d6904 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:44:01.820473 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 613/1226] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 23 01:44:01 2021] GET /identity/v3/projects => generated 2553 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:44:03.849069 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677610a9-0ac5-4ae4-929d-ccfa6a617c89 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:03.850087 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677610a9-0ac5-4ae4-929d-ccfa6a617c89 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:03.850598 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677610a9-0ac5-4ae4-929d-ccfa6a617c89 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:03.852350 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 614/1227] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:44:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:03.857520 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5bad7-070b-46d6-bfca-867da219a6c4 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:03.857935 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5bad7-070b-46d6-bfca-867da219a6c4 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:03.858093 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5bad7-070b-46d6-bfca-867da219a6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:03.948773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-b6a5bad7-070b-46d6-bfca-867da219a6c4 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:03.950208 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-b6a5bad7-070b-46d6-bfca-867da219a6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:04.055455 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 614/1228] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:44:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:44:04.102514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469b3b-c276-4533-829d-1fc5e34612c4 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:04.102739 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469b3b-c276-4533-829d-1fc5e34612c4 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:04.103022 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469b3b-c276-4533-829d-1fc5e34612c4 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:04.104698 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 615/1229] 10.222.0.20 () {54 vars in 962 bytes} [Mon Aug 23 01:44:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:04.110294 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06997ec-3564-4520-8222-47acd49d02cf None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:04.110590 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06997ec-3564-4520-8222-47acd49d02cf None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:04.110873 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06997ec-3564-4520-8222-47acd49d02cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:04.215218 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-e06997ec-3564-4520-8222-47acd49d02cf None None] MFA Rules not processed for user `eedaf4b880f24ac48ee6e04b75059ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:04.216366 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e06997ec-3564-4520-8222-47acd49d02cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:04.305761 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 615/1230] 10.222.0.20 () {58 vars in 1060 bytes} [Mon Aug 23 01:44:04 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:44:04.314670 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a469b3b-c276-4533-829d-1fc5e34612c4 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:44:04.316735 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-7a469b3b-c276-4533-829d-1fc5e34612c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:04.432350 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a469b3b-c276-4533-829d-1fc5e34612c4 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:44:04.514759 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f88146-403e-4da8-b048-a6340da3e39c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:44:04.515345 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f88146-403e-4da8-b048-a6340da3e39c service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:04.515634 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f88146-403e-4da8-b048-a6340da3e39c service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:04.515915 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f88146-403e-4da8-b048-a6340da3e39c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:04.517485 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-b3f88146-403e-4da8-b048-a6340da3e39c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:04.638527 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f88146-403e-4da8-b048-a6340da3e39c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:44:04.663577 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f88146-403e-4da8-b048-a6340da3e39c service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:44:04.682471 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 616/1231] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:44:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:44:06.873950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e217952-dff3-49e3-bea3-c4ba33ee1d31 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:06.874480 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e217952-dff3-49e3-bea3-c4ba33ee1d31 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:06.874574 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e217952-dff3-49e3-bea3-c4ba33ee1d31 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:06.876154 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 616/1232] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:44:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:06.881708 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbde06-471f-4c3a-b211-1316f3ecde4d None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:06.882154 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbde06-471f-4c3a-b211-1316f3ecde4d None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:06.882277 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbde06-471f-4c3a-b211-1316f3ecde4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:06.966254 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-89cbde06-471f-4c3a-b211-1316f3ecde4d None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:06.967380 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-89cbde06-471f-4c3a-b211-1316f3ecde4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:07.068399 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 617/1233] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:44:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:44:07.105804 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e217952-dff3-49e3-bea3-c4ba33ee1d31 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:44:07.107228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-2e217952-dff3-49e3-bea3-c4ba33ee1d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:07.222847 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e217952-dff3-49e3-bea3-c4ba33ee1d31 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:44:07.303477 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eae73-4d39-4aa7-bdeb-4ea6449645e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:44:07.304046 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eae73-4d39-4aa7-bdeb-4ea6449645e2 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:07.304328 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eae73-4d39-4aa7-bdeb-4ea6449645e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:07.304625 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eae73-4d39-4aa7-bdeb-4ea6449645e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:07.306085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ce5eae73-4d39-4aa7-bdeb-4ea6449645e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:07.426192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5eae73-4d39-4aa7-bdeb-4ea6449645e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:44:07.451082 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5eae73-4d39-4aa7-bdeb-4ea6449645e2 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:44:07.470491 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 617/1234] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:44:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:44:09.800840 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32d4ca-ad2c-4358-b87e-e90fe285838f None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:09.801358 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32d4ca-ad2c-4358-b87e-e90fe285838f None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:09.801358 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32d4ca-ad2c-4358-b87e-e90fe285838f None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:09.802982 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 618/1235] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:44:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:09.808150 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac8dab-b2ed-4ddf-8b00-514c8ad8270b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:09.808576 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac8dab-b2ed-4ddf-8b00-514c8ad8270b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:09.808768 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac8dab-b2ed-4ddf-8b00-514c8ad8270b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:09.891989 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-1fac8dab-b2ed-4ddf-8b00-514c8ad8270b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:09.893157 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1fac8dab-b2ed-4ddf-8b00-514c8ad8270b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:09.994658 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 618/1236] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:44:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:44:10.028381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32d4ca-ad2c-4358-b87e-e90fe285838f None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:44:10.029819 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4f32d4ca-ad2c-4358-b87e-e90fe285838f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:10.164183 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32d4ca-ad2c-4358-b87e-e90fe285838f None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:44:10.262132 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2c4c2-4be4-43a9-97f6-aa2cef5c371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:44:10.262901 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c4c2-4be4-43a9-97f6-aa2cef5c371b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:10.263182 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c4c2-4be4-43a9-97f6-aa2cef5c371b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:10.263455 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c4c2-4be4-43a9-97f6-aa2cef5c371b admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:10.279993 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2c4c2-4be4-43a9-97f6-aa2cef5c371b admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:44:10.309271 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2c4c2-4be4-43a9-97f6-aa2cef5c371b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:44:10.310880 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 619/1237] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:44:10 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:44:10.323221 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac8dab-b2ed-4ddf-8b00-514c8ad8270b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:44:10.324338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1fac8dab-b2ed-4ddf-8b00-514c8ad8270b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:10.427129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac8dab-b2ed-4ddf-8b00-514c8ad8270b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:44:10.507087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd889286-817f-47d0-b540-1d1d79d325f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:44:10.507688 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd889286-817f-47d0-b540-1d1d79d325f4 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:10.507972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd889286-817f-47d0-b540-1d1d79d325f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:10.508249 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd889286-817f-47d0-b540-1d1d79d325f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:10.509750 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-bd889286-817f-47d0-b540-1d1d79d325f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:10.627927 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd889286-817f-47d0-b540-1d1d79d325f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:44:10.653274 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd889286-817f-47d0-b540-1d1d79d325f4 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:44:10.672288 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 619/1238] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:44:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:44:13.463263 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13479f83-fc6d-4f30-ac35-70cccb900e16 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:13.463711 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13479f83-fc6d-4f30-ac35-70cccb900e16 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:13.463835 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13479f83-fc6d-4f30-ac35-70cccb900e16 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:13.465517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 620/1239] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:44:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:13.470743 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a312a98-1e75-478f-a095-15b759a90dfe None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:13.471188 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a312a98-1e75-478f-a095-15b759a90dfe None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:13.471316 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a312a98-1e75-478f-a095-15b759a90dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:13.557371 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-0a312a98-1e75-478f-a095-15b759a90dfe None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:13.558507 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0a312a98-1e75-478f-a095-15b759a90dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:13.660735 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 620/1240] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:44:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:44:13.692722 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13479f83-fc6d-4f30-ac35-70cccb900e16 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:44:13.694058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-13479f83-fc6d-4f30-ac35-70cccb900e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:13.829543 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13479f83-fc6d-4f30-ac35-70cccb900e16 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:44:13.930674 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd44ca-e9e0-4f62-9d80-db7998b92cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:44:13.931450 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd44ca-e9e0-4f62-9d80-db7998b92cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:13.931732 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd44ca-e9e0-4f62-9d80-db7998b92cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:13.932008 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd44ca-e9e0-4f62-9d80-db7998b92cb4 admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:13.942310 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd44ca-e9e0-4f62-9d80-db7998b92cb4 admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:44:13.968590 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd44ca-e9e0-4f62-9d80-db7998b92cb4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:44:13.970145 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 621/1241] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:44:13 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:44:13.982645 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a312a98-1e75-478f-a095-15b759a90dfe None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:44:13.983913 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0a312a98-1e75-478f-a095-15b759a90dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:14.084524 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a312a98-1e75-478f-a095-15b759a90dfe None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:44:14.166120 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e36abe-062b-4ddb-acdc-2098d50a0965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:44:14.166705 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e36abe-062b-4ddb-acdc-2098d50a0965 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:14.166994 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e36abe-062b-4ddb-acdc-2098d50a0965 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:14.167274 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e36abe-062b-4ddb-acdc-2098d50a0965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:14.168801 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-21e36abe-062b-4ddb-acdc-2098d50a0965 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:14.292319 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e36abe-062b-4ddb-acdc-2098d50a0965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:44:14.317480 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e36abe-062b-4ddb-acdc-2098d50a0965 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:44:14.337583 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 621/1242] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:44:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:44:17.288584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051efadc-4b2f-408c-96a9-c9eb2c05f4bc None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:17.289112 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051efadc-4b2f-408c-96a9-c9eb2c05f4bc None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:17.289222 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051efadc-4b2f-408c-96a9-c9eb2c05f4bc None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:17.290851 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 622/1243] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:44:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:17.296048 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbef93f-f31a-4705-a07c-31d1e58118b1 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:17.296471 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbef93f-f31a-4705-a07c-31d1e58118b1 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:17.296643 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbef93f-f31a-4705-a07c-31d1e58118b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:17.382946 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-7bbef93f-f31a-4705-a07c-31d1e58118b1 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:17.384080 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-7bbef93f-f31a-4705-a07c-31d1e58118b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:17.493556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 622/1244] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:44:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:44:17.528190 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051efadc-4b2f-408c-96a9-c9eb2c05f4bc None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:44:17.529734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-051efadc-4b2f-408c-96a9-c9eb2c05f4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:17.655420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051efadc-4b2f-408c-96a9-c9eb2c05f4bc None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:44:17.740333 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca9df8-367d-445a-a366-8399a859a1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:44:17.740949 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca9df8-367d-445a-a366-8399a859a1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:17.741241 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca9df8-367d-445a-a366-8399a859a1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:17.741522 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca9df8-367d-445a-a366-8399a859a1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:17.743072 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-7bca9df8-367d-445a-a366-8399a859a1b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:17.867961 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca9df8-367d-445a-a366-8399a859a1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:44:17.893444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca9df8-367d-445a-a366-8399a859a1b0 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:44:17.914456 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 623/1245] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:44:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:44:20.037878 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ed4bd-cafe-49c9-a774-7fae80f63cc2 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:20.038398 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ed4bd-cafe-49c9-a774-7fae80f63cc2 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:20.038489 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ed4bd-cafe-49c9-a774-7fae80f63cc2 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:20.040111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 623/1246] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:44:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:20.045340 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26731271-b936-47b3-bd22-e8736ac65a32 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:20.045791 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26731271-b936-47b3-bd22-e8736ac65a32 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:20.045927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26731271-b936-47b3-bd22-e8736ac65a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:20.131533 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-26731271-b936-47b3-bd22-e8736ac65a32 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:20.132734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-26731271-b936-47b3-bd22-e8736ac65a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:20.238541 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 624/1247] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:44:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:44:20.273557 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ed4bd-cafe-49c9-a774-7fae80f63cc2 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:44:20.275057 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-068ed4bd-cafe-49c9-a774-7fae80f63cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:20.402437 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ed4bd-cafe-49c9-a774-7fae80f63cc2 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:44:20.491087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9dd31-615a-442b-ae67-9ce07e219c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:44:20.491682 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9dd31-615a-442b-ae67-9ce07e219c19 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:20.491966 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9dd31-615a-442b-ae67-9ce07e219c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:20.492244 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9dd31-615a-442b-ae67-9ce07e219c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:20.493873 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-52f9dd31-615a-442b-ae67-9ce07e219c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:20.626769 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9dd31-615a-442b-ae67-9ce07e219c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:44:20.652324 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9dd31-615a-442b-ae67-9ce07e219c19 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:44:20.673059 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 624/1248] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:44:20 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:44:22.776767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d482e1-2dce-4fa0-8787-a650839db5af None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:22.777322 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d482e1-2dce-4fa0-8787-a650839db5af None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:22.777322 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d482e1-2dce-4fa0-8787-a650839db5af None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:22.778977 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 625/1249] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:44:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:22.784058 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ba63c-71a6-43ef-8291-1d751e61bfdf None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:22.784461 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ba63c-71a6-43ef-8291-1d751e61bfdf None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:22.784662 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ba63c-71a6-43ef-8291-1d751e61bfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:22.871047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-8e6ba63c-71a6-43ef-8291-1d751e61bfdf None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:22.872184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-8e6ba63c-71a6-43ef-8291-1d751e61bfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:22.974658 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 625/1250] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:44:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:44:23.005100 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d482e1-2dce-4fa0-8787-a650839db5af None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:44:23.006524 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d1d482e1-2dce-4fa0-8787-a650839db5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:23.145905 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d482e1-2dce-4fa0-8787-a650839db5af None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:44:23.245066 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30902dc8-dfa5-4ab6-9dc0-d6990e7e44ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:44:23.245847 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30902dc8-dfa5-4ab6-9dc0-d6990e7e44ad admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:23.246133 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30902dc8-dfa5-4ab6-9dc0-d6990e7e44ad admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:23.246408 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30902dc8-dfa5-4ab6-9dc0-d6990e7e44ad admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:23.257506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30902dc8-dfa5-4ab6-9dc0-d6990e7e44ad admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:44:23.283739 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30902dc8-dfa5-4ab6-9dc0-d6990e7e44ad admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:44:23.285389 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 626/1251] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:44:23 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:44:23.297310 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ba63c-71a6-43ef-8291-1d751e61bfdf None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:44:23.298430 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-8e6ba63c-71a6-43ef-8291-1d751e61bfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:23.401182 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ba63c-71a6-43ef-8291-1d751e61bfdf None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:44:23.561301 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb177b1-59da-412b-b9dd-5f94a680639c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:44:23.561866 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb177b1-59da-412b-b9dd-5f94a680639c service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:23.562147 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb177b1-59da-412b-b9dd-5f94a680639c service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:23.562423 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb177b1-59da-412b-b9dd-5f94a680639c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:23.563910 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1bb177b1-59da-412b-b9dd-5f94a680639c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:23.680920 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb177b1-59da-412b-b9dd-5f94a680639c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:44:23.706379 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb177b1-59da-412b-b9dd-5f94a680639c service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:44:23.725587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 626/1252] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:44:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:44:26.078810 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d8664-71c5-42a7-82f2-b0acefc42908 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:26.079375 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d8664-71c5-42a7-82f2-b0acefc42908 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:26.079375 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d8664-71c5-42a7-82f2-b0acefc42908 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:26.081571 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 627/1253] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:44:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:26.086684 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d2bb4-b106-4660-ab14-fd43da688b9b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:26.087082 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d2bb4-b106-4660-ab14-fd43da688b9b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:26.087284 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d2bb4-b106-4660-ab14-fd43da688b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:26.170161 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-e80d2bb4-b106-4660-ab14-fd43da688b9b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:26.171283 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e80d2bb4-b106-4660-ab14-fd43da688b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:26.274457 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 627/1254] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:44:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:44:26.309469 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d8664-71c5-42a7-82f2-b0acefc42908 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:44:26.310923 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-421d8664-71c5-42a7-82f2-b0acefc42908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:26.428286 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d8664-71c5-42a7-82f2-b0acefc42908 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:44:26.510440 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b11fc7-4108-464b-abf3-e9a732e8e419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:44:26.511013 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b11fc7-4108-464b-abf3-e9a732e8e419 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:26.511298 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b11fc7-4108-464b-abf3-e9a732e8e419 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:26.511575 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b11fc7-4108-464b-abf3-e9a732e8e419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:26.513103 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-18b11fc7-4108-464b-abf3-e9a732e8e419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:26.634784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b11fc7-4108-464b-abf3-e9a732e8e419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:44:26.663641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b11fc7-4108-464b-abf3-e9a732e8e419 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:44:26.684639 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 628/1255] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:44:26 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:44:28.701875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236791f-bc8d-44c8-8181-4dc97812e251 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:28.702373 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236791f-bc8d-44c8-8181-4dc97812e251 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:28.702373 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236791f-bc8d-44c8-8181-4dc97812e251 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:28.704069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 628/1256] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:44:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:28.709296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f10f85-c356-4871-81ff-dfd924e77381 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:28.709700 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f10f85-c356-4871-81ff-dfd924e77381 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:28.709868 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f10f85-c356-4871-81ff-dfd924e77381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:28.793392 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-45f10f85-c356-4871-81ff-dfd924e77381 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:28.794537 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-45f10f85-c356-4871-81ff-dfd924e77381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:28.978032 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 629/1257] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:44:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:44:29.016173 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236791f-bc8d-44c8-8181-4dc97812e251 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:44:29.018108 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0236791f-bc8d-44c8-8181-4dc97812e251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:29.132663 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236791f-bc8d-44c8-8181-4dc97812e251 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:44:29.213534 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a5bbb-69de-488f-a61c-6dad7d6226d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:44:29.214112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a5bbb-69de-488f-a61c-6dad7d6226d5 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:29.214399 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a5bbb-69de-488f-a61c-6dad7d6226d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:29.214678 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a5bbb-69de-488f-a61c-6dad7d6226d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:29.216175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-720a5bbb-69de-488f-a61c-6dad7d6226d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:29.336208 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a5bbb-69de-488f-a61c-6dad7d6226d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:44:29.360600 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a5bbb-69de-488f-a61c-6dad7d6226d5 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:44:29.380317 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 629/1258] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:44:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:44:31.977470 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057c602-504c-4a04-8f0b-20d877f57067 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:31.978018 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057c602-504c-4a04-8f0b-20d877f57067 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:31.978115 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057c602-504c-4a04-8f0b-20d877f57067 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:31.979704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 630/1259] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:44:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:31.985236 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c6ced-4962-4259-bd27-fde2dc5f476d None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:31.985659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c6ced-4962-4259-bd27-fde2dc5f476d None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:31.985812 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c6ced-4962-4259-bd27-fde2dc5f476d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:32.074657 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-f90c6ced-4962-4259-bd27-fde2dc5f476d None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:32.075793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f90c6ced-4962-4259-bd27-fde2dc5f476d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:32.184816 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 630/1260] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:44:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:44:32.220489 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057c602-504c-4a04-8f0b-20d877f57067 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:44:32.222603 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5057c602-504c-4a04-8f0b-20d877f57067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:32.330905 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057c602-504c-4a04-8f0b-20d877f57067 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:44:32.334223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5ce07-774d-4825-bd66-dc1b1e1505bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:44:32.334793 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5ce07-774d-4825-bd66-dc1b1e1505bc service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:32.335078 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5ce07-774d-4825-bd66-dc1b1e1505bc service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:32.335353 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5ce07-774d-4825-bd66-dc1b1e1505bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:32.344053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5ce07-774d-4825-bd66-dc1b1e1505bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:44:32.370012 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5ce07-774d-4825-bd66-dc1b1e1505bc service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:44:32.379331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 631/1261] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:44:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:44:36.885295 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbe0da-44b4-458b-aae1-6690d09f5f44 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:36.885855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbe0da-44b4-458b-aae1-6690d09f5f44 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:36.885855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbe0da-44b4-458b-aae1-6690d09f5f44 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:36.887729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 631/1262] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:44:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:36.893078 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885c2a0-6423-4df0-a680-edfe06c4978e None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:36.896081 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885c2a0-6423-4df0-a680-edfe06c4978e None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:36.896081 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885c2a0-6423-4df0-a680-edfe06c4978e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:36.916049 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-f885c2a0-6423-4df0-a680-edfe06c4978e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:36.917211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-f885c2a0-6423-4df0-a680-edfe06c4978e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:36.924795 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 632/1263] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:44:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:44:36.962118 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbe0da-44b4-458b-aae1-6690d09f5f44 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:44:36.973265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbe0da-44b4-458b-aae1-6690d09f5f44 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:44:36.976471 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a35220-e291-4f9e-8872-015662acd34c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:44:36.977074 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a35220-e291-4f9e-8872-015662acd34c service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:36.977356 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a35220-e291-4f9e-8872-015662acd34c service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:36.977637 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a35220-e291-4f9e-8872-015662acd34c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:36.987226 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a35220-e291-4f9e-8872-015662acd34c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:44:37.011909 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a35220-e291-4f9e-8872-015662acd34c service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:44:37.021231 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 632/1264] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:44:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:44:40.196300 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335557f6-7aff-4450-8e68-c221fc931f3e None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:40.196872 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335557f6-7aff-4450-8e68-c221fc931f3e None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:40.196872 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335557f6-7aff-4450-8e68-c221fc931f3e None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:40.198548 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 633/1265] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:44:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:40.203757 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b791-6d91-43ff-8782-6b039ff3a6c6 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:40.204203 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b791-6d91-43ff-8782-6b039ff3a6c6 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:40.204324 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b791-6d91-43ff-8782-6b039ff3a6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:40.226848 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-c1a9b791-6d91-43ff-8782-6b039ff3a6c6 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:40.228008 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c1a9b791-6d91-43ff-8782-6b039ff3a6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:40.235073 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 633/1266] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:44:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:44:40.272820 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335557f6-7aff-4450-8e68-c221fc931f3e None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:44:40.283061 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335557f6-7aff-4450-8e68-c221fc931f3e None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:44:40.286254 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129c101-8bba-4d96-8093-576dbe081115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:44:40.286813 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129c101-8bba-4d96-8093-576dbe081115 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:40.287096 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129c101-8bba-4d96-8093-576dbe081115 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:40.287372 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129c101-8bba-4d96-8093-576dbe081115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:40.295726 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129c101-8bba-4d96-8093-576dbe081115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:44:40.321774 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129c101-8bba-4d96-8093-576dbe081115 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:44:40.332596 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 634/1267] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:44:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:44:44.787498 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12a966-ebc4-4b8b-9ece-2a6f0bfaa109 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:44.788368 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12a966-ebc4-4b8b-9ece-2a6f0bfaa109 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:44.788695 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12a966-ebc4-4b8b-9ece-2a6f0bfaa109 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:44.790386 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 634/1268] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:44:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:44.795980 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935b977-f448-43e5-8be5-71e973e544de None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:44.796464 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935b977-f448-43e5-8be5-71e973e544de None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:44.796596 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935b977-f448-43e5-8be5-71e973e544de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:44.827041 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-2935b977-f448-43e5-8be5-71e973e544de None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:44.828777 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2935b977-f448-43e5-8be5-71e973e544de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:44.838016 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 635/1269] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:44:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:44:44.875746 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12a966-ebc4-4b8b-9ece-2a6f0bfaa109 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:44:44.886396 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12a966-ebc4-4b8b-9ece-2a6f0bfaa109 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:44:44.890047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c9ec5-e8dd-4b5c-a6b3-7af1db6fefbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:44:44.890656 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c9ec5-e8dd-4b5c-a6b3-7af1db6fefbe service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:44.891175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c9ec5-e8dd-4b5c-a6b3-7af1db6fefbe service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:44.891278 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c9ec5-e8dd-4b5c-a6b3-7af1db6fefbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:44.901168 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c9ec5-e8dd-4b5c-a6b3-7af1db6fefbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:44:44.927353 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c9ec5-e8dd-4b5c-a6b3-7af1db6fefbe service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:44:44.937426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 635/1270] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:44:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:44:49.470632 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d9e3b-f5ed-4e0a-b666-1c4530aefe1c None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:49.471592 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d9e3b-f5ed-4e0a-b666-1c4530aefe1c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:49.473873 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d9e3b-f5ed-4e0a-b666-1c4530aefe1c None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:49.475073 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 636/1271] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 23 01:44:49 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:49.480668 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a99419-74b2-4295-9109-43b14d660853 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:49.481438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a99419-74b2-4295-9109-43b14d660853 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:49.481884 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a99419-74b2-4295-9109-43b14d660853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:49.591994 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-59a99419-74b2-4295-9109-43b14d660853 None None] MFA Rules not processed for user `c4a6c587fd604395908134c50ce7618d`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:49.593163 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-59a99419-74b2-4295-9109-43b14d660853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:49.690166 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 636/1272] 10.222.0.20 () {58 vars in 1019 bytes} [Mon Aug 23 01:44:49 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:44:50.036092 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a03adc-86ec-4dcc-8540-ed7c845aab99 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:50.036451 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a03adc-86ec-4dcc-8540-ed7c845aab99 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:50.036857 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a03adc-86ec-4dcc-8540-ed7c845aab99 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:50.038609 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 637/1273] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 23 01:44:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:50.062598 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01d863-89ad-40df-94fb-1056aa1b6539 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:50.062817 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01d863-89ad-40df-94fb-1056aa1b6539 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:50.063096 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01d863-89ad-40df-94fb-1056aa1b6539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:50.112409 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-7a01d863-89ad-40df-94fb-1056aa1b6539 None None] MFA Rules not processed for user `c4a6c587fd604395908134c50ce7618d`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:50.114000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-7a01d863-89ad-40df-94fb-1056aa1b6539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:50.125488 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 637/1274] 10.222.0.20 () {58 vars in 1019 bytes} [Mon Aug 23 01:44:50 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:44:53.974890 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a2248-1e9c-4af3-bbfa-afb9c7f1f78e None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:53.975428 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a2248-1e9c-4af3-bbfa-afb9c7f1f78e None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:53.975684 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a2248-1e9c-4af3-bbfa-afb9c7f1f78e None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:53.977691 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 638/1275] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 23 01:44:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:53.982518 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c2ee9-0dd8-425a-b034-05e1aea24360 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:53.982974 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c2ee9-0dd8-425a-b034-05e1aea24360 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:53.983081 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c2ee9-0dd8-425a-b034-05e1aea24360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:54.007526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-e04c2ee9-0dd8-425a-b034-05e1aea24360 None None] MFA Rules not processed for user `c4a6c587fd604395908134c50ce7618d`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:54.009004 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e04c2ee9-0dd8-425a-b034-05e1aea24360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:54.017003 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 638/1276] 10.222.0.20 () {58 vars in 1019 bytes} [Mon Aug 23 01:44:53 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:44:55.526003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f89cd2-7b4c-4f5f-9f46-5101a6d43935 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:55.526512 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f89cd2-7b4c-4f5f-9f46-5101a6d43935 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:55.526603 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f89cd2-7b4c-4f5f-9f46-5101a6d43935 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:55.528202 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 639/1277] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 23 01:44:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:55.533564 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04b021-7d4d-4938-92b5-58f141476087 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:55.533988 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04b021-7d4d-4938-92b5-58f141476087 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:55.534134 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04b021-7d4d-4938-92b5-58f141476087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:55.557245 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-ef04b021-7d4d-4938-92b5-58f141476087 None None] MFA Rules not processed for user `c4a6c587fd604395908134c50ce7618d`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:55.558510 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ef04b021-7d4d-4938-92b5-58f141476087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:55.566588 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 639/1278] 10.222.0.20 () {58 vars in 1019 bytes} [Mon Aug 23 01:44:55 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:44:58.777304 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d37c1-934e-410e-970f-d673016803bb None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:58.777828 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d37c1-934e-410e-970f-d673016803bb None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:58.777828 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d37c1-934e-410e-970f-d673016803bb None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:58.779480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 640/1279] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:44:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:58.785238 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef257c7-528b-45b4-8175-a424515f8427 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:58.785631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef257c7-528b-45b4-8175-a424515f8427 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:58.785807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef257c7-528b-45b4-8175-a424515f8427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:58.808336 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-4ef257c7-528b-45b4-8175-a424515f8427 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:58.809490 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-4ef257c7-528b-45b4-8175-a424515f8427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:58.816286 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 640/1280] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:44:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:44:58.908528 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e40eb-a388-4c95-89bc-5a763a8aa8b8 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:58.908854 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e40eb-a388-4c95-89bc-5a763a8aa8b8 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:58.909138 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e40eb-a388-4c95-89bc-5a763a8aa8b8 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:58.910801 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 641/1281] 10.222.0.20 () {54 vars in 959 bytes} [Mon Aug 23 01:44:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:44:58.915654 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b794e-a2b3-4958-b177-6a553f34906c None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:58.915953 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b794e-a2b3-4958-b177-6a553f34906c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:58.916241 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b794e-a2b3-4958-b177-6a553f34906c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:58.983599 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-7e3b794e-a2b3-4958-b177-6a553f34906c None None] MFA Rules not processed for user `094c5e571da7480584098ba6ebcb70ed`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:44:58.984765 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-7e3b794e-a2b3-4958-b177-6a553f34906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:44:59.071453 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 641/1282] 10.222.0.20 () {58 vars in 1057 bytes} [Mon Aug 23 01:44:58 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:44:59.079718 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e40eb-a388-4c95-89bc-5a763a8aa8b8 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:44:59.092503 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e40eb-a388-4c95-89bc-5a763a8aa8b8 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:44:59.097964 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b1267-3792-43c6-92bc-1c5ef551e030 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:44:59.098522 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b1267-3792-43c6-92bc-1c5ef551e030 service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:44:59.098807 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b1267-3792-43c6-92bc-1c5ef551e030 service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:44:59.099084 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b1267-3792-43c6-92bc-1c5ef551e030 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:44:59.106723 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b1267-3792-43c6-92bc-1c5ef551e030 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:44:59.131464 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b1267-3792-43c6-92bc-1c5ef551e030 service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:44:59.140799 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 642/1283] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:44:59 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:45:01.313914 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd610061-1110-464a-8f83-852bd629f55a None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:01.314452 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd610061-1110-464a-8f83-852bd629f55a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:01.314569 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd610061-1110-464a-8f83-852bd629f55a None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:01.316149 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 642/1284] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:45:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:45:01.321565 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536161c-2280-453a-98bb-728ed1653fed None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:01.321962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536161c-2280-453a-98bb-728ed1653fed None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:01.322181 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536161c-2280-453a-98bb-728ed1653fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:01.345848 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-a536161c-2280-453a-98bb-728ed1653fed None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:45:01.350949 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a536161c-2280-453a-98bb-728ed1653fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:45:01.357845 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 643/1285] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:45:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:45:01.449501 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ea3b8-d12d-4bd9-adc9-1c48729c86dd None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:01.449799 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ea3b8-d12d-4bd9-adc9-1c48729c86dd None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:01.450083 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ea3b8-d12d-4bd9-adc9-1c48729c86dd None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:01.451730 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 643/1286] 10.222.0.20 () {54 vars in 959 bytes} [Mon Aug 23 01:45:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:45:01.457278 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3efb1-3401-4ac8-aef1-95cbfc87e9ce None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:01.457574 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3efb1-3401-4ac8-aef1-95cbfc87e9ce None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:01.457858 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3efb1-3401-4ac8-aef1-95cbfc87e9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:01.479937 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-39d3efb1-3401-4ac8-aef1-95cbfc87e9ce None None] MFA Rules not processed for user `094c5e571da7480584098ba6ebcb70ed`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:45:01.481101 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-39d3efb1-3401-4ac8-aef1-95cbfc87e9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:45:01.489531 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 644/1287] 10.222.0.20 () {58 vars in 1057 bytes} [Mon Aug 23 01:45:01 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:45:01.497012 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ea3b8-d12d-4bd9-adc9-1c48729c86dd None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:45:01.510738 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ea3b8-d12d-4bd9-adc9-1c48729c86dd None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:45:01.515610 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0380e0-d9fd-4d61-a138-a8207a9925db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:45:01.516163 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0380e0-d9fd-4d61-a138-a8207a9925db service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:01.516449 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0380e0-d9fd-4d61-a138-a8207a9925db service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:01.516768 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0380e0-d9fd-4d61-a138-a8207a9925db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:01.524387 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0380e0-d9fd-4d61-a138-a8207a9925db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:45:01.550338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0380e0-d9fd-4d61-a138-a8207a9925db service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:45:01.559034 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 644/1288] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:45:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:45:04.021692 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a50ce-b8f2-4f33-9dc6-c912ca4477f3 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:04.022289 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a50ce-b8f2-4f33-9dc6-c912ca4477f3 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:04.022289 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a50ce-b8f2-4f33-9dc6-c912ca4477f3 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:04.023963 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 645/1289] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:45:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:45:04.029040 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015d20f-cb3a-4a36-af5d-af33e2373610 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:04.029469 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015d20f-cb3a-4a36-af5d-af33e2373610 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:04.029609 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015d20f-cb3a-4a36-af5d-af33e2373610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:04.053137 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-e015d20f-cb3a-4a36-af5d-af33e2373610 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:45:04.054287 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e015d20f-cb3a-4a36-af5d-af33e2373610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:45:04.061398 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 645/1290] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:45:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:45:04.149575 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a50ce-b8f2-4f33-9dc6-c912ca4477f3 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:45:04.163107 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a50ce-b8f2-4f33-9dc6-c912ca4477f3 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:45:04.168463 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8105944-1c5b-4d73-90f5-11a9de0f7166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:45:04.169076 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8105944-1c5b-4d73-90f5-11a9de0f7166 service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:04.169365 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8105944-1c5b-4d73-90f5-11a9de0f7166 service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:04.169645 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8105944-1c5b-4d73-90f5-11a9de0f7166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:04.178751 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8105944-1c5b-4d73-90f5-11a9de0f7166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:45:04.204815 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8105944-1c5b-4d73-90f5-11a9de0f7166 service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:45:04.214263 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 646/1291] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:45:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:45:06.494434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334997d-e26c-474c-92c2-a5844564f8ce None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:06.494948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334997d-e26c-474c-92c2-a5844564f8ce None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:06.495053 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334997d-e26c-474c-92c2-a5844564f8ce None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:06.496673 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 646/1292] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:45:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:45:06.501740 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e73eb-db83-4c18-89c0-1c5038834351 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:06.502145 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e73eb-db83-4c18-89c0-1c5038834351 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:06.502297 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e73eb-db83-4c18-89c0-1c5038834351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:06.524424 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-7e1e73eb-db83-4c18-89c0-1c5038834351 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:45:06.525566 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-7e1e73eb-db83-4c18-89c0-1c5038834351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:45:06.533018 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 647/1293] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:45:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:45:06.618637 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334997d-e26c-474c-92c2-a5844564f8ce None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:45:06.631938 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334997d-e26c-474c-92c2-a5844564f8ce None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:45:06.637089 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d6f3f-229f-4a9f-89c4-b70e23d4882c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:45:06.637671 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d6f3f-229f-4a9f-89c4-b70e23d4882c service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:06.637959 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d6f3f-229f-4a9f-89c4-b70e23d4882c service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:06.638240 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d6f3f-229f-4a9f-89c4-b70e23d4882c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:06.647148 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d6f3f-229f-4a9f-89c4-b70e23d4882c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:45:06.672632 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d6f3f-229f-4a9f-89c4-b70e23d4882c service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:45:06.681587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 647/1294] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:45:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:45:09.073708 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47436a-edfa-4df8-9631-ca51e350bb67 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:09.074265 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47436a-edfa-4df8-9631-ca51e350bb67 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:09.074265 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47436a-edfa-4df8-9631-ca51e350bb67 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:09.075937 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 648/1295] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:45:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:45:09.081074 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3ab77-f3fa-4ab3-901f-ddec90f0cce4 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:09.081498 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3ab77-f3fa-4ab3-901f-ddec90f0cce4 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:09.081634 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3ab77-f3fa-4ab3-901f-ddec90f0cce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:09.103886 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-fce3ab77-f3fa-4ab3-901f-ddec90f0cce4 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:45:09.105033 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-fce3ab77-f3fa-4ab3-901f-ddec90f0cce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:45:09.112368 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 648/1296] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:45:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:45:09.198166 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47436a-edfa-4df8-9631-ca51e350bb67 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:45:09.211420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47436a-edfa-4df8-9631-ca51e350bb67 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:45:09.216190 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae88202-d72f-4242-b238-3f34b7572ac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:45:09.216770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae88202-d72f-4242-b238-3f34b7572ac6 service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:09.217052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae88202-d72f-4242-b238-3f34b7572ac6 service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:09.217323 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae88202-d72f-4242-b238-3f34b7572ac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:09.225435 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae88202-d72f-4242-b238-3f34b7572ac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:45:09.250698 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae88202-d72f-4242-b238-3f34b7572ac6 service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:45:09.259702 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 649/1297] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:45:09 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:45:11.407517 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b575ac-44ea-425c-b16a-404959650b6d None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:11.408078 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b575ac-44ea-425c-b16a-404959650b6d None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:11.408078 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b575ac-44ea-425c-b16a-404959650b6d None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:11.409830 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 649/1298] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:45:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:45:11.415263 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730281b-96b5-475f-84de-40f101746ec7 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:11.415669 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730281b-96b5-475f-84de-40f101746ec7 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:11.415851 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730281b-96b5-475f-84de-40f101746ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:11.438476 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-7730281b-96b5-475f-84de-40f101746ec7 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:45:11.439601 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-7730281b-96b5-475f-84de-40f101746ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:45:11.446678 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 650/1299] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:45:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:45:11.533661 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b575ac-44ea-425c-b16a-404959650b6d None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:45:11.546698 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b575ac-44ea-425c-b16a-404959650b6d None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:45:11.551452 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8b92e-b941-4ebb-a9c5-7fafc64cb6df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:45:11.552013 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8b92e-b941-4ebb-a9c5-7fafc64cb6df service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:11.552299 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8b92e-b941-4ebb-a9c5-7fafc64cb6df service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:11.552591 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8b92e-b941-4ebb-a9c5-7fafc64cb6df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:11.560171 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8b92e-b941-4ebb-a9c5-7fafc64cb6df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:45:11.586366 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8b92e-b941-4ebb-a9c5-7fafc64cb6df service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:45:11.595048 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 650/1300] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:45:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:45:13.770152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67956982-49cb-44b2-a8b4-1b4d5857dbaa None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:13.770673 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67956982-49cb-44b2-a8b4-1b4d5857dbaa None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:13.770673 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67956982-49cb-44b2-a8b4-1b4d5857dbaa None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:13.772275 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 651/1301] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:45:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:45:13.777326 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e12860-6d50-4182-a63f-5e91201d11b0 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:13.777765 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e12860-6d50-4182-a63f-5e91201d11b0 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:13.777896 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e12860-6d50-4182-a63f-5e91201d11b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:13.801011 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-79e12860-6d50-4182-a63f-5e91201d11b0 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:45:13.802138 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-79e12860-6d50-4182-a63f-5e91201d11b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:45:13.809069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 651/1302] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:45:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:45:13.895467 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67956982-49cb-44b2-a8b4-1b4d5857dbaa None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:45:13.909565 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67956982-49cb-44b2-a8b4-1b4d5857dbaa None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:45:13.914514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4926c8-1108-4674-873b-0fcfbd55053c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:45:13.915075 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4926c8-1108-4674-873b-0fcfbd55053c service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:13.915363 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4926c8-1108-4674-873b-0fcfbd55053c service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:13.915648 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4926c8-1108-4674-873b-0fcfbd55053c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:13.923421 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4926c8-1108-4674-873b-0fcfbd55053c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:45:13.948602 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4926c8-1108-4674-873b-0fcfbd55053c service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:45:13.957913 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 652/1303] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:45:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:45:15.930514 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c273f-94a0-48ab-a17a-9155d39c309b None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:15.931040 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c273f-94a0-48ab-a17a-9155d39c309b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:15.931179 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c273f-94a0-48ab-a17a-9155d39c309b None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:15.932826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 652/1304] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:45:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:45:15.938362 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb74e99-2b22-40a9-abea-e7e541fe9e05 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:15.938805 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb74e99-2b22-40a9-abea-e7e541fe9e05 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:15.938923 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb74e99-2b22-40a9-abea-e7e541fe9e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:15.961635 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-4cb74e99-2b22-40a9-abea-e7e541fe9e05 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:45:15.962772 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4cb74e99-2b22-40a9-abea-e7e541fe9e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:45:15.969661 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 653/1305] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:45:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:45:16.056809 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c273f-94a0-48ab-a17a-9155d39c309b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:45:16.070723 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c273f-94a0-48ab-a17a-9155d39c309b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:45:16.075547 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c255a-1426-43e1-b480-7f65544bc821 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:45:16.076113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c255a-1426-43e1-b480-7f65544bc821 service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:16.076399 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c255a-1426-43e1-b480-7f65544bc821 service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:16.076708 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c255a-1426-43e1-b480-7f65544bc821 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:16.084894 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c255a-1426-43e1-b480-7f65544bc821 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:45:16.110090 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c255a-1426-43e1-b480-7f65544bc821 service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:45:16.118742 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 653/1306] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:45:16 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:45:18.292375 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f0554-2963-4c2b-bf81-c0f9592cd2cf None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:18.292966 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f0554-2963-4c2b-bf81-c0f9592cd2cf None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:18.292966 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f0554-2963-4c2b-bf81-c0f9592cd2cf None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:18.294622 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 654/1307] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:45:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:45:18.300245 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d2d0e-e255-4a09-b772-923e095b945e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:18.300686 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d2d0e-e255-4a09-b772-923e095b945e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:18.300829 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d2d0e-e255-4a09-b772-923e095b945e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:18.322933 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-893d2d0e-e255-4a09-b772-923e095b945e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:45:18.324034 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-893d2d0e-e255-4a09-b772-923e095b945e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:45:18.331685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 654/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:45:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:45:18.422057 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f0554-2963-4c2b-bf81-c0f9592cd2cf None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:45:18.435425 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f0554-2963-4c2b-bf81-c0f9592cd2cf None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:45:18.440366 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b5f18-de2a-46fc-ad96-8a50a79fcfe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:45:18.440962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b5f18-de2a-46fc-ad96-8a50a79fcfe0 service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:18.441253 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b5f18-de2a-46fc-ad96-8a50a79fcfe0 service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:18.441533 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b5f18-de2a-46fc-ad96-8a50a79fcfe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:18.449626 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b5f18-de2a-46fc-ad96-8a50a79fcfe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:45:18.475708 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b5f18-de2a-46fc-ad96-8a50a79fcfe0 service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:45:18.484821 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 655/1309] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:45:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:45:20.675547 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375ae8a-5024-473f-9b10-c000b0920ade None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:20.676085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375ae8a-5024-473f-9b10-c000b0920ade None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:20.676199 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375ae8a-5024-473f-9b10-c000b0920ade None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:20.677820 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 655/1310] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:45:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:45:20.682840 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9cb73-342e-4acf-a757-63892649258f None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:20.683266 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9cb73-342e-4acf-a757-63892649258f None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:20.683449 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9cb73-342e-4acf-a757-63892649258f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:20.707571 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-34c9cb73-342e-4acf-a757-63892649258f None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:45:20.708766 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-34c9cb73-342e-4acf-a757-63892649258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:45:20.715577 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 656/1311] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:45:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:45:20.802181 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375ae8a-5024-473f-9b10-c000b0920ade None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:45:20.815993 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375ae8a-5024-473f-9b10-c000b0920ade None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:45:20.821232 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6f112-9e01-486f-bea3-dc6eb96e53ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:45:20.828113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6f112-9e01-486f-bea3-dc6eb96e53ce service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:20.828113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6f112-9e01-486f-bea3-dc6eb96e53ce service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:20.828113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6f112-9e01-486f-bea3-dc6eb96e53ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:20.830298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6f112-9e01-486f-bea3-dc6eb96e53ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:45:20.855088 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6f112-9e01-486f-bea3-dc6eb96e53ce service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:45:20.864435 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 656/1312] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:45:20 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:45:23.187806 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf225e-7542-4333-ad57-8be10adccb0d None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:23.188367 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf225e-7542-4333-ad57-8be10adccb0d None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:23.188367 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf225e-7542-4333-ad57-8be10adccb0d None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:23.190038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 657/1313] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:45:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:45:23.195477 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39eef9a-64b9-4c32-9dca-010a2565af51 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:23.195885 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39eef9a-64b9-4c32-9dca-010a2565af51 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:23.196039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39eef9a-64b9-4c32-9dca-010a2565af51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:23.218438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-e39eef9a-64b9-4c32-9dca-010a2565af51 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:45:23.220126 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e39eef9a-64b9-4c32-9dca-010a2565af51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:45:23.226929 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 657/1314] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:45:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:45:23.311697 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf225e-7542-4333-ad57-8be10adccb0d None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:45:23.325677 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf225e-7542-4333-ad57-8be10adccb0d None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:45:23.331147 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef883744-e3ab-49fc-806d-af578a74b24d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:45:23.331712 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef883744-e3ab-49fc-806d-af578a74b24d service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:23.332002 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef883744-e3ab-49fc-806d-af578a74b24d service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:23.332281 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef883744-e3ab-49fc-806d-af578a74b24d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:23.340026 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef883744-e3ab-49fc-806d-af578a74b24d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:45:23.365130 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef883744-e3ab-49fc-806d-af578a74b24d service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:45:23.374100 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 658/1315] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:45:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:45:25.609024 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89390b-278b-4d9a-98bd-700f9a754aa0 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:25.610173 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89390b-278b-4d9a-98bd-700f9a754aa0 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:25.610173 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89390b-278b-4d9a-98bd-700f9a754aa0 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:25.611970 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 658/1316] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:45:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:45:25.617034 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd38338-b046-4b08-bf00-9d254b844116 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:25.619042 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd38338-b046-4b08-bf00-9d254b844116 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:25.619042 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd38338-b046-4b08-bf00-9d254b844116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:25.640292 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-4bd38338-b046-4b08-bf00-9d254b844116 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:45:25.641899 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4bd38338-b046-4b08-bf00-9d254b844116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:45:25.648476 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 659/1317] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:45:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:45:25.735351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89390b-278b-4d9a-98bd-700f9a754aa0 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:45:25.748517 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89390b-278b-4d9a-98bd-700f9a754aa0 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:45:25.753504 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01103d3b-c094-4256-8473-c85d83f2abd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:45:25.754064 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01103d3b-c094-4256-8473-c85d83f2abd6 service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:25.754350 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01103d3b-c094-4256-8473-c85d83f2abd6 service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:25.754629 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01103d3b-c094-4256-8473-c85d83f2abd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:25.762336 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01103d3b-c094-4256-8473-c85d83f2abd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:45:25.787739 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01103d3b-c094-4256-8473-c85d83f2abd6 service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:45:25.796438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 659/1318] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:45:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:45:36.136873 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6821b6-4f8e-4ecb-bd4a-038be2fab77e None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:36.137480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6821b6-4f8e-4ecb-bd4a-038be2fab77e None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:36.137480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6821b6-4f8e-4ecb-bd4a-038be2fab77e None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:36.139188 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 660/1319] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:45:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:45:36.144401 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da3d02-acff-435d-9692-d90d2396dfbd None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:36.144884 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da3d02-acff-435d-9692-d90d2396dfbd None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:36.145137 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da3d02-acff-435d-9692-d90d2396dfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:36.167603 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-32da3d02-acff-435d-9692-d90d2396dfbd None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:45:36.168802 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-32da3d02-acff-435d-9692-d90d2396dfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:45:36.176530 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 660/1320] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:45:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:45:36.238357 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66592c6-ffa7-4766-b050-8254a35e60f9 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:36.238827 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66592c6-ffa7-4766-b050-8254a35e60f9 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:36.239207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66592c6-ffa7-4766-b050-8254a35e60f9 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:36.241013 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 661/1321] 10.222.0.20 () {54 vars in 962 bytes} [Mon Aug 23 01:45:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:45:36.246022 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8280bab-aec4-4416-bcdc-ce52b00dc30e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:36.246347 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8280bab-aec4-4416-bcdc-ce52b00dc30e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:36.246636 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8280bab-aec4-4416-bcdc-ce52b00dc30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:36.314641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-f8280bab-aec4-4416-bcdc-ce52b00dc30e None None] MFA Rules not processed for user `43ec554d6a304e029ee4f244f4a18e24`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:45:36.315761 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f8280bab-aec4-4416-bcdc-ce52b00dc30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:45:36.382725 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 661/1322] 10.222.0.20 () {58 vars in 1060 bytes} [Mon Aug 23 01:45:36 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:45:36.390991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66592c6-ffa7-4766-b050-8254a35e60f9 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:45:36.401752 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66592c6-ffa7-4766-b050-8254a35e60f9 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:45:36.405404 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0212b3d-0567-4186-9c01-654d56e041f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:45:36.406623 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0212b3d-0567-4186-9c01-654d56e041f2 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:36.406910 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0212b3d-0567-4186-9c01-654d56e041f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:36.407187 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0212b3d-0567-4186-9c01-654d56e041f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:36.416500 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0212b3d-0567-4186-9c01-654d56e041f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:45:36.441661 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0212b3d-0567-4186-9c01-654d56e041f2 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:45:36.451764 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 662/1323] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:45:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:45:49.832446 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315f1a9-8047-49f4-bae9-f40931774b6e None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:49.833149 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315f1a9-8047-49f4-bae9-f40931774b6e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:49.833267 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315f1a9-8047-49f4-bae9-f40931774b6e None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:49.835994 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 662/1324] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:45:49 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:45:49.842498 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbf620-f0ee-4b79-9428-880dc15b7f73 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:49.843162 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbf620-f0ee-4b79-9428-880dc15b7f73 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:49.843162 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbf620-f0ee-4b79-9428-880dc15b7f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:49.866606 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-9ddbf620-f0ee-4b79-9428-880dc15b7f73 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:45:49.890490 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-9ddbf620-f0ee-4b79-9428-880dc15b7f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:45:49.890490 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 663/1325] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:45:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:45:49.937039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99462c5-6218-407b-b5af-b7393dfbf69a None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:49.937322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99462c5-6218-407b-b5af-b7393dfbf69a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:49.938948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99462c5-6218-407b-b5af-b7393dfbf69a None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:49.940679 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 663/1326] 10.222.0.20 () {54 vars in 962 bytes} [Mon Aug 23 01:45:49 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:45:49.946967 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4e4fa-20cf-4d65-b69a-8e1e9e535914 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:49.947308 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4e4fa-20cf-4d65-b69a-8e1e9e535914 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:49.947629 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4e4fa-20cf-4d65-b69a-8e1e9e535914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:50.023822 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-59c4e4fa-20cf-4d65-b69a-8e1e9e535914 None None] MFA Rules not processed for user `913cd471ba494382af7dda858b9010c2`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:45:50.025170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-59c4e4fa-20cf-4d65-b69a-8e1e9e535914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:45:50.096448 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 664/1327] 10.222.0.20 () {58 vars in 1060 bytes} [Mon Aug 23 01:45:49 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:45:50.105338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99462c5-6218-407b-b5af-b7393dfbf69a None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:45:50.116045 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99462c5-6218-407b-b5af-b7393dfbf69a None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:45:50.119327 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88218d0-1888-473c-b214-b823dcb6c37c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913cd471ba494382af7dda858b9010c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:45:50.119882 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88218d0-1888-473c-b214-b823dcb6c37c service glance] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:50.120161 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88218d0-1888-473c-b214-b823dcb6c37c service glance] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:50.120434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88218d0-1888-473c-b214-b823dcb6c37c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:50.129540 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88218d0-1888-473c-b214-b823dcb6c37c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:45:50.154918 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88218d0-1888-473c-b214-b823dcb6c37c service glance] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:45:50.164196 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 664/1328] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:45:50 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:45:50.727003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ce86f-a213-4a2f-9efd-dc4418ee5cd8 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:50.727301 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ce86f-a213-4a2f-9efd-dc4418ee5cd8 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:50.727585 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ce86f-a213-4a2f-9efd-dc4418ee5cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:50.794650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-5f9ce86f-a213-4a2f-9efd-dc4418ee5cd8 None None] MFA Rules not processed for user `8f0dd32880d14ec9990bc09685d26326`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:45:50.795792 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5f9ce86f-a213-4a2f-9efd-dc4418ee5cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:45:50.865689 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 665/1329] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Aug 23 01:45:50 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:45:50.908311 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5477e4-42a3-4ac7-b6c1-7ff07f0b6a14 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:50.908763 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5477e4-42a3-4ac7-b6c1-7ff07f0b6a14 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:50.908937 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5477e4-42a3-4ac7-b6c1-7ff07f0b6a14 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:50.910591 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 665/1330] 10.222.0.20 () {54 vars in 942 bytes} [Mon Aug 23 01:45:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:45:50.916864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e5675-8836-4302-a639-bbfd9294bab6 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:50.917156 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e5675-8836-4302-a639-bbfd9294bab6 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:50.917444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e5675-8836-4302-a639-bbfd9294bab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:50.985342 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-0c4e5675-8836-4302-a639-bbfd9294bab6 None None] MFA Rules not processed for user `82e4cab3c8cb4a18bf3c1a8a85d1675c`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:45:50.986398 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-0c4e5675-8836-4302-a639-bbfd9294bab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:45:51.062998 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 666/1331] 10.222.0.20 () {58 vars in 1040 bytes} [Mon Aug 23 01:45:50 2021] POST /identity/v3/auth/tokens => generated 3734 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:45:51.071763 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5477e4-42a3-4ac7-b6c1-7ff07f0b6a14 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:45:51.083999 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5477e4-42a3-4ac7-b6c1-7ff07f0b6a14 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:45:51.088376 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cc3fb-74e2-4691-9b51-d43223403393 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e4cab3c8cb4a18bf3c1a8a85d1675c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:45:51.088971 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cc3fb-74e2-4691-9b51-d43223403393 service swift] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:45:51.089259 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cc3fb-74e2-4691-9b51-d43223403393 service swift] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:45:51.089538 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cc3fb-74e2-4691-9b51-d43223403393 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:45:51.097657 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cc3fb-74e2-4691-9b51-d43223403393 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:45:51.123022 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cc3fb-74e2-4691-9b51-d43223403393 service swift] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:45:51.131035 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 666/1332] 10.222.0.20 () {60 vars in 1385 bytes} [Mon Aug 23 01:45:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 01:46:11.106138 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1383e9d-5e08-4d1f-947c-97288a93309e None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:11.106767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1383e9d-5e08-4d1f-947c-97288a93309e None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:11.106767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1383e9d-5e08-4d1f-947c-97288a93309e None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:11.108354 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 667/1333] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:46:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:11.114027 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d78a00-f746-461a-a7d1-d7f64648dd2a None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:11.114465 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d78a00-f746-461a-a7d1-d7f64648dd2a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:11.114614 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d78a00-f746-461a-a7d1-d7f64648dd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:11.136877 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-36d78a00-f746-461a-a7d1-d7f64648dd2a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:11.138153 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-36d78a00-f746-461a-a7d1-d7f64648dd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:11.145302 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 667/1334] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:46:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:11.169003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1383e9d-5e08-4d1f-947c-97288a93309e None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:11.180898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1383e9d-5e08-4d1f-947c-97288a93309e None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:11.184943 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec5b58-926b-4c93-8ee7-2d5c52ea1acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:11.185510 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec5b58-926b-4c93-8ee7-2d5c52ea1acf admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:11.185811 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec5b58-926b-4c93-8ee7-2d5c52ea1acf admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:11.186072 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec5b58-926b-4c93-8ee7-2d5c52ea1acf admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:11.186750 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec5b58-926b-4c93-8ee7-2d5c52ea1acf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:11.214363 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec5b58-926b-4c93-8ee7-2d5c52ea1acf admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:11.230172 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 668/1335] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 23 01:46:11 2021] GET /identity/v3/projects => generated 2553 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:46:13.139178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d3080-216b-4c97-a550-cde6a6a1d3d1 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:13.139709 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d3080-216b-4c97-a550-cde6a6a1d3d1 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:13.139821 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d3080-216b-4c97-a550-cde6a6a1d3d1 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:13.141509 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 668/1336] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:46:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:13.146647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abf201-9e57-408b-baf1-ac44069c5f90 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:13.147094 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abf201-9e57-408b-baf1-ac44069c5f90 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:13.147240 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abf201-9e57-408b-baf1-ac44069c5f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:13.169188 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-83abf201-9e57-408b-baf1-ac44069c5f90 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:13.170341 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-83abf201-9e57-408b-baf1-ac44069c5f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:13.177585 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 669/1337] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:46:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:13.199899 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d3080-216b-4c97-a550-cde6a6a1d3d1 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:13.211634 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d3080-216b-4c97-a550-cde6a6a1d3d1 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:13.215651 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a629f1-dd98-4bbf-83d9-489bb018997b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:13.216421 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a629f1-dd98-4bbf-83d9-489bb018997b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:13.216747 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a629f1-dd98-4bbf-83d9-489bb018997b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:13.217031 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a629f1-dd98-4bbf-83d9-489bb018997b admin admin] PATH_INFO: `/v3/projects/0ea79b37877f4192a0638335e14355f9` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:13.228903 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a629f1-dd98-4bbf-83d9-489bb018997b admin admin] RBAC: Authorizing `identity:get_project(project_id=0ea79b37877f4192a0638335e14355f9)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:13.255578 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a629f1-dd98-4bbf-83d9-489bb018997b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:13.257152 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 669/1338] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:46:13 2021] GET /identity/v3/projects/0ea79b37877f4192a0638335e14355f9 => generated 311 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:13.263043 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abf201-9e57-408b-baf1-ac44069c5f90 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:13.271617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abf201-9e57-408b-baf1-ac44069c5f90 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:13.275644 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb8967-ac93-4a39-8c2a-445bed211804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:13.276205 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb8967-ac93-4a39-8c2a-445bed211804 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:13.276489 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb8967-ac93-4a39-8c2a-445bed211804 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:13.276810 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb8967-ac93-4a39-8c2a-445bed211804 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:13.277521 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb8967-ac93-4a39-8c2a-445bed211804 admin admin] RBAC: Adding query filter params (scope.project.id=0ea79b37877f4192a0638335e14355f9) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:46:13.277816 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb8967-ac93-4a39-8c2a-445bed211804 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:13.303358 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb8967-ac93-4a39-8c2a-445bed211804 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:13.308870 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 670/1339] 10.222.0.20 () {56 vars in 1232 bytes} [Mon Aug 23 01:46:13 2021] GET /identity/v3/role_assignments?scope.project.id=0ea79b37877f4192a0638335e14355f9 => generated 877 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:13.314941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a629f1-dd98-4bbf-83d9-489bb018997b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:13.324319 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a629f1-dd98-4bbf-83d9-489bb018997b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:13.329020 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa52408-726c-4494-a180-ccfd0b705d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:13.329800 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa52408-726c-4494-a180-ccfd0b705d28 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:13.330086 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa52408-726c-4494-a180-ccfd0b705d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:13.330367 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa52408-726c-4494-a180-ccfd0b705d28 admin admin] PATH_INFO: `/v3/users/f0da9292d72f4e74a6ec28b70a9fc352` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:13.348996 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa52408-726c-4494-a180-ccfd0b705d28 admin admin] RBAC: Authorizing `identity:get_user(user_id=f0da9292d72f4e74a6ec28b70a9fc352)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:13.374172 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa52408-726c-4494-a180-ccfd0b705d28 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:13.375826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 670/1340] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:46:13 2021] GET /identity/v3/users/f0da9292d72f4e74a6ec28b70a9fc352 => generated 285 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:13.381133 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb8967-ac93-4a39-8c2a-445bed211804 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:13.391030 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb8967-ac93-4a39-8c2a-445bed211804 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:13.395022 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55007d2c-ef28-4302-a7b3-9e0c3d8b341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:13.395797 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55007d2c-ef28-4302-a7b3-9e0c3d8b341e admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:13.396079 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55007d2c-ef28-4302-a7b3-9e0c3d8b341e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:13.396357 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55007d2c-ef28-4302-a7b3-9e0c3d8b341e admin admin] PATH_INFO: `/v3/users/6bda4131e0194708ad3ad9295abc4f92` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:13.415070 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55007d2c-ef28-4302-a7b3-9e0c3d8b341e admin admin] RBAC: Authorizing `identity:get_user(user_id=6bda4131e0194708ad3ad9295abc4f92)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:13.440676 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55007d2c-ef28-4302-a7b3-9e0c3d8b341e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:13.442272 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 671/1341] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:46:13 2021] GET /identity/v3/users/6bda4131e0194708ad3ad9295abc4f92 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:15.472556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a45427-241e-4e6c-bbd7-6b997a695ac8 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:15.473068 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a45427-241e-4e6c-bbd7-6b997a695ac8 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:15.473174 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a45427-241e-4e6c-bbd7-6b997a695ac8 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:15.474807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 671/1342] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:46:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:15.479990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7b4e0-b208-4c45-ac19-6aeefcd7adbc None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:15.480413 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7b4e0-b208-4c45-ac19-6aeefcd7adbc None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:15.480586 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7b4e0-b208-4c45-ac19-6aeefcd7adbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:15.504989 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-52a7b4e0-b208-4c45-ac19-6aeefcd7adbc None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:15.506117 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-52a7b4e0-b208-4c45-ac19-6aeefcd7adbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:15.512955 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 672/1343] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:46:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:15.534998 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a45427-241e-4e6c-bbd7-6b997a695ac8 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:15.547146 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a45427-241e-4e6c-bbd7-6b997a695ac8 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:15.551236 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea5922-7e29-407b-a9bb-cf82c92443c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:15.552013 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea5922-7e29-407b-a9bb-cf82c92443c6 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:15.552355 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea5922-7e29-407b-a9bb-cf82c92443c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:15.552703 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea5922-7e29-407b-a9bb-cf82c92443c6 admin admin] PATH_INFO: `/v3/projects/18b6a01d26b441fbbbbd3d111d05c77b` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:15.565513 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea5922-7e29-407b-a9bb-cf82c92443c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=18b6a01d26b441fbbbbd3d111d05c77b)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:15.591375 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea5922-7e29-407b-a9bb-cf82c92443c6 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:15.592931 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 672/1344] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:46:15 2021] GET /identity/v3/projects/18b6a01d26b441fbbbbd3d111d05c77b => generated 312 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:15.599279 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7b4e0-b208-4c45-ac19-6aeefcd7adbc None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:15.607856 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7b4e0-b208-4c45-ac19-6aeefcd7adbc None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:15.611967 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffda2de-7662-48b4-816f-cb1922716215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:15.612534 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffda2de-7662-48b4-816f-cb1922716215 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:15.612855 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffda2de-7662-48b4-816f-cb1922716215 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:15.613139 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffda2de-7662-48b4-816f-cb1922716215 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:15.613855 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffda2de-7662-48b4-816f-cb1922716215 admin admin] RBAC: Adding query filter params (scope.project.id=18b6a01d26b441fbbbbd3d111d05c77b) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:46:15.614152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffda2de-7662-48b4-816f-cb1922716215 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:15.639614 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffda2de-7662-48b4-816f-cb1922716215 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:15.645889 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 673/1345] 10.222.0.20 () {56 vars in 1232 bytes} [Mon Aug 23 01:46:15 2021] GET /identity/v3/role_assignments?scope.project.id=18b6a01d26b441fbbbbd3d111d05c77b => generated 526 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:15.651716 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea5922-7e29-407b-a9bb-cf82c92443c6 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:15.661756 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea5922-7e29-407b-a9bb-cf82c92443c6 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:15.665874 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e636bf7-6c04-4300-ae65-5f0e962d0851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:15.666651 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e636bf7-6c04-4300-ae65-5f0e962d0851 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:15.666938 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e636bf7-6c04-4300-ae65-5f0e962d0851 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:15.667217 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e636bf7-6c04-4300-ae65-5f0e962d0851 admin admin] PATH_INFO: `/v3/users/dc2016d1d16043ccbcc1e69278abf4b4` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:15.685383 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e636bf7-6c04-4300-ae65-5f0e962d0851 admin admin] RBAC: Authorizing `identity:get_user(user_id=dc2016d1d16043ccbcc1e69278abf4b4)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:15.711281 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e636bf7-6c04-4300-ae65-5f0e962d0851 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:15.712770 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 673/1346] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:46:15 2021] GET /identity/v3/users/dc2016d1d16043ccbcc1e69278abf4b4 => generated 275 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:17.692421 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8db5c-cbf8-48cd-8779-e5ffb411e9a2 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:17.692963 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8db5c-cbf8-48cd-8779-e5ffb411e9a2 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:17.692963 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8db5c-cbf8-48cd-8779-e5ffb411e9a2 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:17.694889 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 674/1347] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:46:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:17.700302 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb53aa-a7d6-4d25-b827-b9ab154330f3 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:17.700737 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb53aa-a7d6-4d25-b827-b9ab154330f3 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:17.700918 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb53aa-a7d6-4d25-b827-b9ab154330f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:17.722731 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-6beb53aa-a7d6-4d25-b827-b9ab154330f3 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:17.723843 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-6beb53aa-a7d6-4d25-b827-b9ab154330f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:17.730677 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 674/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:46:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:17.753786 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8db5c-cbf8-48cd-8779-e5ffb411e9a2 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:17.765458 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8db5c-cbf8-48cd-8779-e5ffb411e9a2 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:17.769558 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4669a-301e-4ee7-b8e0-f28c7a1ee863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:17.770318 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4669a-301e-4ee7-b8e0-f28c7a1ee863 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:17.770603 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4669a-301e-4ee7-b8e0-f28c7a1ee863 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:17.770881 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4669a-301e-4ee7-b8e0-f28c7a1ee863 admin admin] PATH_INFO: `/v3/projects/4f6bd6480e9c4a609f8c029a43846e42` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:17.771951 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4669a-301e-4ee7-b8e0-f28c7a1ee863 admin admin] RBAC: Authorizing `identity:get_project(project_id=4f6bd6480e9c4a609f8c029a43846e42)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:17.797741 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4669a-301e-4ee7-b8e0-f28c7a1ee863 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:17.799427 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 675/1349] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:46:17 2021] GET /identity/v3/projects/4f6bd6480e9c4a609f8c029a43846e42 => generated 344 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:17.805653 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb53aa-a7d6-4d25-b827-b9ab154330f3 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:17.815032 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb53aa-a7d6-4d25-b827-b9ab154330f3 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:17.826029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9769dc-6863-4426-b091-ce0ae7e2808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:17.826596 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9769dc-6863-4426-b091-ce0ae7e2808f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:17.826882 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9769dc-6863-4426-b091-ce0ae7e2808f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:17.827155 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9769dc-6863-4426-b091-ce0ae7e2808f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:17.827882 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9769dc-6863-4426-b091-ce0ae7e2808f admin admin] RBAC: Adding query filter params (scope.project.id=4f6bd6480e9c4a609f8c029a43846e42) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:46:17.828175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9769dc-6863-4426-b091-ce0ae7e2808f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:17.853315 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9769dc-6863-4426-b091-ce0ae7e2808f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:17.859356 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 675/1350] 10.222.0.20 () {56 vars in 1232 bytes} [Mon Aug 23 01:46:17 2021] GET /identity/v3/role_assignments?scope.project.id=4f6bd6480e9c4a609f8c029a43846e42 => generated 879 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:17.865215 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4669a-301e-4ee7-b8e0-f28c7a1ee863 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:17.875131 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4669a-301e-4ee7-b8e0-f28c7a1ee863 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:17.879329 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdee1a2-45b4-45ef-a49e-d221ecb92021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:17.880105 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee1a2-45b4-45ef-a49e-d221ecb92021 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:17.880393 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee1a2-45b4-45ef-a49e-d221ecb92021 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:17.880713 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee1a2-45b4-45ef-a49e-d221ecb92021 admin admin] PATH_INFO: `/v3/users/f126ecc3e0554a38839d919cf3fec6e7` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:17.881796 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdee1a2-45b4-45ef-a49e-d221ecb92021 admin admin] RBAC: Authorizing `identity:get_user(user_id=f126ecc3e0554a38839d919cf3fec6e7)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:17.906813 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdee1a2-45b4-45ef-a49e-d221ecb92021 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:17.908376 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 676/1351] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:46:17 2021] GET /identity/v3/users/f126ecc3e0554a38839d919cf3fec6e7 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:19.865206 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27e1fe-f86f-4ff5-9c5b-4739f17abdb0 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:19.865786 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27e1fe-f86f-4ff5-9c5b-4739f17abdb0 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:19.865786 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27e1fe-f86f-4ff5-9c5b-4739f17abdb0 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:19.867421 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 676/1352] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:46:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:19.872524 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaedf98-538a-44e7-b02d-a892474f1f58 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:19.872963 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaedf98-538a-44e7-b02d-a892474f1f58 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:19.873101 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaedf98-538a-44e7-b02d-a892474f1f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:19.895513 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-acaedf98-538a-44e7-b02d-a892474f1f58 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:19.896679 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-acaedf98-538a-44e7-b02d-a892474f1f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:19.903572 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 677/1353] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:46:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:19.925816 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27e1fe-f86f-4ff5-9c5b-4739f17abdb0 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:19.937346 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27e1fe-f86f-4ff5-9c5b-4739f17abdb0 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:19.941358 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e05d0-90e4-431f-8c87-3cebea20cab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:19.942113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e05d0-90e4-431f-8c87-3cebea20cab8 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:19.942397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e05d0-90e4-431f-8c87-3cebea20cab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:19.942673 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e05d0-90e4-431f-8c87-3cebea20cab8 admin admin] PATH_INFO: `/v3/projects/656f45800fdc48a9bcd3a4f71423c1fd` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:19.956552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e05d0-90e4-431f-8c87-3cebea20cab8 admin admin] RBAC: Authorizing `identity:get_project(project_id=656f45800fdc48a9bcd3a4f71423c1fd)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:19.982134 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e05d0-90e4-431f-8c87-3cebea20cab8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:19.983680 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 677/1354] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:46:19 2021] GET /identity/v3/projects/656f45800fdc48a9bcd3a4f71423c1fd => generated 361 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:19.989617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaedf98-538a-44e7-b02d-a892474f1f58 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:19.998104 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaedf98-538a-44e7-b02d-a892474f1f58 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:20.002275 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430fda5-41de-4cbc-8611-b1a2e0ec7d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:20.002833 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430fda5-41de-4cbc-8611-b1a2e0ec7d37 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:20.003119 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430fda5-41de-4cbc-8611-b1a2e0ec7d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:20.003395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430fda5-41de-4cbc-8611-b1a2e0ec7d37 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:20.004110 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430fda5-41de-4cbc-8611-b1a2e0ec7d37 admin admin] RBAC: Adding query filter params (scope.project.id=656f45800fdc48a9bcd3a4f71423c1fd) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:46:20.004404 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430fda5-41de-4cbc-8611-b1a2e0ec7d37 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:20.030095 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430fda5-41de-4cbc-8611-b1a2e0ec7d37 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:20.035861 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 678/1355] 10.222.0.20 () {56 vars in 1232 bytes} [Mon Aug 23 01:46:19 2021] GET /identity/v3/role_assignments?scope.project.id=656f45800fdc48a9bcd3a4f71423c1fd => generated 526 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:20.041224 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e05d0-90e4-431f-8c87-3cebea20cab8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:20.050248 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e05d0-90e4-431f-8c87-3cebea20cab8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:20.054331 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986c33e-3882-4337-8389-3058db34b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:20.055096 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c33e-3882-4337-8389-3058db34b23f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:20.055378 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c33e-3882-4337-8389-3058db34b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:20.055653 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c33e-3882-4337-8389-3058db34b23f admin admin] PATH_INFO: `/v3/users/bbb915efcc624ad8b8254076e316966a` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:20.073856 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986c33e-3882-4337-8389-3058db34b23f admin admin] RBAC: Authorizing `identity:get_user(user_id=bbb915efcc624ad8b8254076e316966a)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:20.099974 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986c33e-3882-4337-8389-3058db34b23f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:20.101440 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 678/1356] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:46:20 2021] GET /identity/v3/users/bbb915efcc624ad8b8254076e316966a => generated 311 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:22.102768 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53af525-222d-4eff-a71d-7a454a565aa2 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:22.103401 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53af525-222d-4eff-a71d-7a454a565aa2 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:22.103401 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53af525-222d-4eff-a71d-7a454a565aa2 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:22.105015 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 679/1357] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:46:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:22.110756 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8827e-5ea0-421c-8da2-a304c5531a0b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:22.111192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8827e-5ea0-421c-8da2-a304c5531a0b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:22.111316 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8827e-5ea0-421c-8da2-a304c5531a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:22.135523 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-17e8827e-5ea0-421c-8da2-a304c5531a0b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:22.138732 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-17e8827e-5ea0-421c-8da2-a304c5531a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:22.143703 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 679/1358] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:46:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:22.165747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53af525-222d-4eff-a71d-7a454a565aa2 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:22.178036 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53af525-222d-4eff-a71d-7a454a565aa2 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:22.181988 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d755e34-be7c-4d12-94b7-790420994179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:22.182743 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d755e34-be7c-4d12-94b7-790420994179 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:22.183031 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d755e34-be7c-4d12-94b7-790420994179 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:22.183307 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d755e34-be7c-4d12-94b7-790420994179 admin admin] PATH_INFO: `/v3/projects/8b911a0aab104a27b5aba859cc3c0914` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:22.196095 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d755e34-be7c-4d12-94b7-790420994179 admin admin] RBAC: Authorizing `identity:get_project(project_id=8b911a0aab104a27b5aba859cc3c0914)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:22.221326 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d755e34-be7c-4d12-94b7-790420994179 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:22.222843 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 680/1359] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:46:22 2021] GET /identity/v3/projects/8b911a0aab104a27b5aba859cc3c0914 => generated 311 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:22.228680 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8827e-5ea0-421c-8da2-a304c5531a0b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:22.237711 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8827e-5ea0-421c-8da2-a304c5531a0b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:22.241782 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325c2b7-8077-4232-80bc-66085b737502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:22.242350 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c2b7-8077-4232-80bc-66085b737502 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:22.242634 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c2b7-8077-4232-80bc-66085b737502 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:22.242913 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c2b7-8077-4232-80bc-66085b737502 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:22.243623 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325c2b7-8077-4232-80bc-66085b737502 admin admin] RBAC: Adding query filter params (scope.project.id=8b911a0aab104a27b5aba859cc3c0914) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:46:22.243921 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325c2b7-8077-4232-80bc-66085b737502 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:22.269615 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325c2b7-8077-4232-80bc-66085b737502 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:22.274779 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 680/1360] 10.222.0.20 () {56 vars in 1232 bytes} [Mon Aug 23 01:46:22 2021] GET /identity/v3/role_assignments?scope.project.id=8b911a0aab104a27b5aba859cc3c0914 => generated 526 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:22.280178 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d755e34-be7c-4d12-94b7-790420994179 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:22.289461 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d755e34-be7c-4d12-94b7-790420994179 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:22.293494 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4c376-a57c-44ed-b768-c4fcb12589ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:22.294264 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4c376-a57c-44ed-b768-c4fcb12589ff admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:22.294565 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4c376-a57c-44ed-b768-c4fcb12589ff admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:22.294824 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4c376-a57c-44ed-b768-c4fcb12589ff admin admin] PATH_INFO: `/v3/users/c5d28bf301124e4ea80c3dad73835920` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:22.313967 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4c376-a57c-44ed-b768-c4fcb12589ff admin admin] RBAC: Authorizing `identity:get_user(user_id=c5d28bf301124e4ea80c3dad73835920)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:22.339516 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4c376-a57c-44ed-b768-c4fcb12589ff admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:22.341155 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 681/1361] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:46:22 2021] GET /identity/v3/users/c5d28bf301124e4ea80c3dad73835920 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:24.315947 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99a4b7-956f-41e5-9707-7031ef8fa724 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:24.316483 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99a4b7-956f-41e5-9707-7031ef8fa724 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:24.316626 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99a4b7-956f-41e5-9707-7031ef8fa724 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:24.318463 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 681/1362] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:46:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:24.323587 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1899e8-1793-4383-bc7a-f3d733aaa440 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:24.323975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1899e8-1793-4383-bc7a-f3d733aaa440 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:24.324155 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1899e8-1793-4383-bc7a-f3d733aaa440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:24.346605 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-7f1899e8-1793-4383-bc7a-f3d733aaa440 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:24.347726 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-7f1899e8-1793-4383-bc7a-f3d733aaa440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:24.354614 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 682/1363] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:46:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:24.376999 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99a4b7-956f-41e5-9707-7031ef8fa724 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:24.388804 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99a4b7-956f-41e5-9707-7031ef8fa724 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:24.393237 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c653d45-31bc-48af-af0c-f44906433c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:24.393997 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c653d45-31bc-48af-af0c-f44906433c91 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:24.394279 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c653d45-31bc-48af-af0c-f44906433c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:24.394554 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c653d45-31bc-48af-af0c-f44906433c91 admin admin] PATH_INFO: `/v3/projects/d95c944d92ef4aebaa584978535338d1` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:24.407171 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c653d45-31bc-48af-af0c-f44906433c91 admin admin] RBAC: Authorizing `identity:get_project(project_id=d95c944d92ef4aebaa584978535338d1)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:24.432667 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c653d45-31bc-48af-af0c-f44906433c91 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:24.434530 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 682/1364] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:46:24 2021] GET /identity/v3/projects/d95c944d92ef4aebaa584978535338d1 => generated 302 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:24.440514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1899e8-1793-4383-bc7a-f3d733aaa440 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:24.450081 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1899e8-1793-4383-bc7a-f3d733aaa440 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:24.455207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dbb6a-dffd-43d3-ade7-5a64adf29606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:24.455788 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dbb6a-dffd-43d3-ade7-5a64adf29606 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:24.456080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dbb6a-dffd-43d3-ade7-5a64adf29606 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:24.456364 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dbb6a-dffd-43d3-ade7-5a64adf29606 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:24.457153 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dbb6a-dffd-43d3-ade7-5a64adf29606 admin admin] RBAC: Adding query filter params (scope.project.id=d95c944d92ef4aebaa584978535338d1) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:46:24.457456 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dbb6a-dffd-43d3-ade7-5a64adf29606 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:24.484200 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dbb6a-dffd-43d3-ade7-5a64adf29606 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:24.490880 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 683/1365] 10.222.0.20 () {56 vars in 1232 bytes} [Mon Aug 23 01:46:24 2021] GET /identity/v3/role_assignments?scope.project.id=d95c944d92ef4aebaa584978535338d1 => generated 1934 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:46:24.496631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c653d45-31bc-48af-af0c-f44906433c91 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:24.506577 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c653d45-31bc-48af-af0c-f44906433c91 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:24.510689 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dafc3-5f9a-451d-b527-73ecdd77eded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:24.511473 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dafc3-5f9a-451d-b527-73ecdd77eded admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:24.511760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dafc3-5f9a-451d-b527-73ecdd77eded admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:24.512041 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dafc3-5f9a-451d-b527-73ecdd77eded admin admin] PATH_INFO: `/v3/users/6703011d24c7402bb8c2d3b4c9279b5b` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:24.530357 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544dafc3-5f9a-451d-b527-73ecdd77eded admin admin] RBAC: Authorizing `identity:get_user(user_id=6703011d24c7402bb8c2d3b4c9279b5b)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:24.556221 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544dafc3-5f9a-451d-b527-73ecdd77eded admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:24.557809 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 683/1366] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:46:24 2021] GET /identity/v3/users/6703011d24c7402bb8c2d3b4c9279b5b => generated 283 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:24.563934 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dbb6a-dffd-43d3-ade7-5a64adf29606 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:24.573550 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dbb6a-dffd-43d3-ade7-5a64adf29606 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:24.578092 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2156f84-f4f6-4993-b019-8f881b7cccb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:24.578875 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156f84-f4f6-4993-b019-8f881b7cccb3 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:24.579167 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156f84-f4f6-4993-b019-8f881b7cccb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:24.579456 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156f84-f4f6-4993-b019-8f881b7cccb3 admin admin] PATH_INFO: `/v3/users/f126ecc3e0554a38839d919cf3fec6e7` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:24.580525 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2156f84-f4f6-4993-b019-8f881b7cccb3 admin admin] RBAC: Authorizing `identity:get_user(user_id=f126ecc3e0554a38839d919cf3fec6e7)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:24.606744 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2156f84-f4f6-4993-b019-8f881b7cccb3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:24.608175 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 684/1367] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:46:24 2021] GET /identity/v3/users/f126ecc3e0554a38839d919cf3fec6e7 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:26.620788 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07216641-8b67-44e0-8b64-7d728701dcf3 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:26.621299 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07216641-8b67-44e0-8b64-7d728701dcf3 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:26.621299 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07216641-8b67-44e0-8b64-7d728701dcf3 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:26.622964 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 684/1368] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:46:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:26.627960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa726b-f150-45ff-b72d-727fce7ff6f5 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:26.628384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa726b-f150-45ff-b72d-727fce7ff6f5 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:26.628527 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa726b-f150-45ff-b72d-727fce7ff6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:26.650878 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-e6aa726b-f150-45ff-b72d-727fce7ff6f5 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:26.652005 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-e6aa726b-f150-45ff-b72d-727fce7ff6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:26.659420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 685/1369] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:46:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:26.681106 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07216641-8b67-44e0-8b64-7d728701dcf3 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:26.692749 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07216641-8b67-44e0-8b64-7d728701dcf3 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:26.697006 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1b9e7-0ca6-4fec-840f-38fa832e6c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:26.697791 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1b9e7-0ca6-4fec-840f-38fa832e6c4b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:26.698076 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1b9e7-0ca6-4fec-840f-38fa832e6c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:26.698354 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1b9e7-0ca6-4fec-840f-38fa832e6c4b admin admin] PATH_INFO: `/v3/projects/fa4552970c8f438c8319be7d42c1811a` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:26.711610 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1b9e7-0ca6-4fec-840f-38fa832e6c4b admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4552970c8f438c8319be7d42c1811a)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:26.737596 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1b9e7-0ca6-4fec-840f-38fa832e6c4b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:26.739189 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 685/1370] 10.222.0.20 () {56 vars in 1208 bytes} [Mon Aug 23 01:46:26 2021] GET /identity/v3/projects/fa4552970c8f438c8319be7d42c1811a => generated 298 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:26.745009 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa726b-f150-45ff-b72d-727fce7ff6f5 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:26.753694 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa726b-f150-45ff-b72d-727fce7ff6f5 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:26.757840 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e00458-e8a3-438e-b70d-f5be3365e6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:26.758448 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e00458-e8a3-438e-b70d-f5be3365e6ca admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:26.758740 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e00458-e8a3-438e-b70d-f5be3365e6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:26.759020 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e00458-e8a3-438e-b70d-f5be3365e6ca admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:26.759738 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e00458-e8a3-438e-b70d-f5be3365e6ca admin admin] RBAC: Adding query filter params (scope.project.id=fa4552970c8f438c8319be7d42c1811a) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:46:26.760036 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e00458-e8a3-438e-b70d-f5be3365e6ca admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:26.786484 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e00458-e8a3-438e-b70d-f5be3365e6ca admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:26.792962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 686/1371] 10.222.0.20 () {56 vars in 1232 bytes} [Mon Aug 23 01:46:26 2021] GET /identity/v3/role_assignments?scope.project.id=fa4552970c8f438c8319be7d42c1811a => generated 1934 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:46:26.799387 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1b9e7-0ca6-4fec-840f-38fa832e6c4b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:26.808638 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1b9e7-0ca6-4fec-840f-38fa832e6c4b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:26.813349 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5852c8-0f11-4a0f-954b-946d807679c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:26.814129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5852c8-0f11-4a0f-954b-946d807679c3 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:26.814413 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5852c8-0f11-4a0f-954b-946d807679c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:26.814698 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5852c8-0f11-4a0f-954b-946d807679c3 admin admin] PATH_INFO: `/v3/users/dc2016d1d16043ccbcc1e69278abf4b4` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:26.815738 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5852c8-0f11-4a0f-954b-946d807679c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=dc2016d1d16043ccbcc1e69278abf4b4)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:26.841291 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5852c8-0f11-4a0f-954b-946d807679c3 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:26.842832 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 686/1372] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:46:26 2021] GET /identity/v3/users/dc2016d1d16043ccbcc1e69278abf4b4 => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:46:26.848069 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e00458-e8a3-438e-b70d-f5be3365e6ca admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:26.857262 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e00458-e8a3-438e-b70d-f5be3365e6ca admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:26.861969 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d29540-df82-4276-a2ad-c645d6a67f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:26.862753 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d29540-df82-4276-a2ad-c645d6a67f79 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:26.863041 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d29540-df82-4276-a2ad-c645d6a67f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:26.863323 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d29540-df82-4276-a2ad-c645d6a67f79 admin admin] PATH_INFO: `/v3/users/f126ecc3e0554a38839d919cf3fec6e7` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:26.864380 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d29540-df82-4276-a2ad-c645d6a67f79 admin admin] RBAC: Authorizing `identity:get_user(user_id=f126ecc3e0554a38839d919cf3fec6e7)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:26.890636 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d29540-df82-4276-a2ad-c645d6a67f79 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:26.892055 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 687/1373] 10.222.0.20 () {56 vars in 1199 bytes} [Mon Aug 23 01:46:26 2021] GET /identity/v3/users/f126ecc3e0554a38839d919cf3fec6e7 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:46:31.497068 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca280f-2a55-47ba-93bd-01c1e7caf4c2 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:31.497617 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca280f-2a55-47ba-93bd-01c1e7caf4c2 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:31.497727 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca280f-2a55-47ba-93bd-01c1e7caf4c2 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:31.499841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 687/1374] 10.222.0.20 () {54 vars in 918 bytes} [Mon Aug 23 01:46:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:31.504663 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a884f-e3a0-418f-831d-a470f1779f43 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:31.505084 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a884f-e3a0-418f-831d-a470f1779f43 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:31.505225 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a884f-e3a0-418f-831d-a470f1779f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:31.527601 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-c47a884f-e3a0-418f-831d-a470f1779f43 None None] MFA Rules not processed for user `c4a6c587fd604395908134c50ce7618d`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:31.528747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-c47a884f-e3a0-418f-831d-a470f1779f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:31.536159 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 688/1375] 10.222.0.20 () {58 vars in 1016 bytes} [Mon Aug 23 01:46:31 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:31.591820 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a09df-8e85-4a81-a1fd-9c951dc2f403 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:31.592158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a09df-8e85-4a81-a1fd-9c951dc2f403 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:31.592965 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a09df-8e85-4a81-a1fd-9c951dc2f403 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:31.594651 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 688/1376] 10.222.0.20 () {54 vars in 918 bytes} [Mon Aug 23 01:46:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:31.599619 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a6c25-822a-442e-8266-b1e91cb912e5 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:31.599914 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a6c25-822a-442e-8266-b1e91cb912e5 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:31.600195 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a6c25-822a-442e-8266-b1e91cb912e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:31.621956 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-bf5a6c25-822a-442e-8266-b1e91cb912e5 None None] MFA Rules not processed for user `094c5e571da7480584098ba6ebcb70ed`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:31.623075 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-bf5a6c25-822a-442e-8266-b1e91cb912e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:31.631517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 689/1377] 10.222.0.20 () {58 vars in 1016 bytes} [Mon Aug 23 01:46:31 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:33.952746 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879f8d5-1d6d-42fa-bdee-27b77b965a43 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:33.953322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879f8d5-1d6d-42fa-bdee-27b77b965a43 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:33.953322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879f8d5-1d6d-42fa-bdee-27b77b965a43 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:33.954971 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 689/1378] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:46:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:33.960103 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1f7a3-edca-45d0-ae7e-ffba44da9567 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:33.960543 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1f7a3-edca-45d0-ae7e-ffba44da9567 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:33.960679 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1f7a3-edca-45d0-ae7e-ffba44da9567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:33.982423 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-edd1f7a3-edca-45d0-ae7e-ffba44da9567 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:33.984181 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-edd1f7a3-edca-45d0-ae7e-ffba44da9567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:33.990899 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 690/1379] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:46:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:34.075697 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879f8d5-1d6d-42fa-bdee-27b77b965a43 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:34.088654 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879f8d5-1d6d-42fa-bdee-27b77b965a43 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:34.093890 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c9c5a-3b1a-4637-b71a-e3d0fd3e2ae9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:34.094450 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c9c5a-3b1a-4637-b71a-e3d0fd3e2ae9 service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:34.094734 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c9c5a-3b1a-4637-b71a-e3d0fd3e2ae9 service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:34.095011 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c9c5a-3b1a-4637-b71a-e3d0fd3e2ae9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:34.102951 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c9c5a-3b1a-4637-b71a-e3d0fd3e2ae9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:34.128464 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c9c5a-3b1a-4637-b71a-e3d0fd3e2ae9 service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:34.137195 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 690/1380] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:46:34 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:46:35.519493 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669921f-201d-4e75-9925-67c7a1cd3d22 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:35.520005 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669921f-201d-4e75-9925-67c7a1cd3d22 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:35.520129 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669921f-201d-4e75-9925-67c7a1cd3d22 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:35.521745 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 691/1381] 10.222.0.20 () {54 vars in 911 bytes} [Mon Aug 23 01:46:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:35.526584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4727d-307b-4446-acd2-aedb2b730a69 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:35.527047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4727d-307b-4446-acd2-aedb2b730a69 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:35.527143 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4727d-307b-4446-acd2-aedb2b730a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:35.550223 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-aac4727d-307b-4446-acd2-aedb2b730a69 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:35.551375 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-aac4727d-307b-4446-acd2-aedb2b730a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:35.558257 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 691/1382] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 23 01:46:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:35.708276 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669921f-201d-4e75-9925-67c7a1cd3d22 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:35.721480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669921f-201d-4e75-9925-67c7a1cd3d22 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:35.726728 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbcd66-6913-415e-9174-0ad4ac326f8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:35.727302 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbcd66-6913-415e-9174-0ad4ac326f8f service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:35.727591 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbcd66-6913-415e-9174-0ad4ac326f8f service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:35.727880 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbcd66-6913-415e-9174-0ad4ac326f8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:35.736594 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fbcd66-6913-415e-9174-0ad4ac326f8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:35.762211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fbcd66-6913-415e-9174-0ad4ac326f8f service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:35.771291 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 692/1383] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:46:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:46:37.176979 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18693b0a-363e-4fc4-9f7e-2c51369ce2f0 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:37.177554 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18693b0a-363e-4fc4-9f7e-2c51369ce2f0 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:37.177554 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18693b0a-363e-4fc4-9f7e-2c51369ce2f0 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:37.179187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 692/1384] 10.222.0.20 () {54 vars in 911 bytes} [Mon Aug 23 01:46:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:37.183972 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef94ae4-aed4-44ab-b3cd-74a9e29b251e None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:37.184428 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef94ae4-aed4-44ab-b3cd-74a9e29b251e None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:37.184588 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef94ae4-aed4-44ab-b3cd-74a9e29b251e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:37.207560 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-2ef94ae4-aed4-44ab-b3cd-74a9e29b251e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:37.208734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2ef94ae4-aed4-44ab-b3cd-74a9e29b251e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:37.215519 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 693/1385] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 23 01:46:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:37.362089 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18693b0a-363e-4fc4-9f7e-2c51369ce2f0 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:37.375822 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18693b0a-363e-4fc4-9f7e-2c51369ce2f0 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:37.380530 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11d045-e0ad-4537-a8b7-9c997ea5e2aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:37.381119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11d045-e0ad-4537-a8b7-9c997ea5e2aa service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:37.381402 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11d045-e0ad-4537-a8b7-9c997ea5e2aa service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:37.381679 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11d045-e0ad-4537-a8b7-9c997ea5e2aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:37.389902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11d045-e0ad-4537-a8b7-9c997ea5e2aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:37.415191 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11d045-e0ad-4537-a8b7-9c997ea5e2aa service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:37.424668 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 693/1386] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:46:37 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:46:38.819050 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5293-530c-481e-be28-fb4e1984b437 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:38.819591 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5293-530c-481e-be28-fb4e1984b437 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:38.819591 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5293-530c-481e-be28-fb4e1984b437 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:38.821303 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 694/1387] 10.222.0.20 () {54 vars in 911 bytes} [Mon Aug 23 01:46:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:38.826066 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df10799-bea3-44fd-9f3f-3d8ed57f58fd None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:38.826446 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df10799-bea3-44fd-9f3f-3d8ed57f58fd None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:38.827166 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df10799-bea3-44fd-9f3f-3d8ed57f58fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:38.851424 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-0df10799-bea3-44fd-9f3f-3d8ed57f58fd None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:38.852592 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0df10799-bea3-44fd-9f3f-3d8ed57f58fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:38.859517 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 694/1388] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 23 01:46:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:39.003905 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa5293-530c-481e-be28-fb4e1984b437 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:39.017515 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa5293-530c-481e-be28-fb4e1984b437 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:39.022288 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd851a-f863-4185-9335-8170e4290c46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:39.022847 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd851a-f863-4185-9335-8170e4290c46 service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:39.023134 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd851a-f863-4185-9335-8170e4290c46 service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:39.023413 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd851a-f863-4185-9335-8170e4290c46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:39.031065 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd851a-f863-4185-9335-8170e4290c46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:39.055895 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd851a-f863-4185-9335-8170e4290c46 service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:39.065095 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 695/1389] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:46:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:46:40.469272 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbec80-e926-4c30-ae00-7e81e0eaf679 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:40.469721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbec80-e926-4c30-ae00-7e81e0eaf679 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:40.469829 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbec80-e926-4c30-ae00-7e81e0eaf679 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:40.471575 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 695/1390] 10.222.0.20 () {54 vars in 911 bytes} [Mon Aug 23 01:46:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:40.476174 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f836c-9440-4af2-9fcf-19fc5306282c None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:40.476630 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f836c-9440-4af2-9fcf-19fc5306282c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:40.476771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f836c-9440-4af2-9fcf-19fc5306282c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:40.499080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-fd7f836c-9440-4af2-9fcf-19fc5306282c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:40.500220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-fd7f836c-9440-4af2-9fcf-19fc5306282c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:40.507119 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 696/1391] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 23 01:46:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:40.654316 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbec80-e926-4c30-ae00-7e81e0eaf679 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:40.668237 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbec80-e926-4c30-ae00-7e81e0eaf679 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:40.673715 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff0c98-21bb-4777-afd0-2aeb36eff412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:40.674282 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff0c98-21bb-4777-afd0-2aeb36eff412 service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:40.674571 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff0c98-21bb-4777-afd0-2aeb36eff412 service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:40.674853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff0c98-21bb-4777-afd0-2aeb36eff412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:40.682718 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff0c98-21bb-4777-afd0-2aeb36eff412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:40.707962 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff0c98-21bb-4777-afd0-2aeb36eff412 service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:40.716838 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 696/1392] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:46:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:46:42.105206 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c204540-d759-45e9-bebd-dd32d9dfcb1f None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:42.105779 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c204540-d759-45e9-bebd-dd32d9dfcb1f None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:42.105779 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c204540-d759-45e9-bebd-dd32d9dfcb1f None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:42.107480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 697/1393] 10.222.0.20 () {54 vars in 911 bytes} [Mon Aug 23 01:46:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:42.112804 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f944860-661b-4b8b-9f83-83b345a2d20e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:42.113227 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f944860-661b-4b8b-9f83-83b345a2d20e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:42.113348 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f944860-661b-4b8b-9f83-83b345a2d20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:42.136301 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-0f944860-661b-4b8b-9f83-83b345a2d20e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:42.137447 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0f944860-661b-4b8b-9f83-83b345a2d20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:42.144833 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 697/1394] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 23 01:46:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:46:42.291710 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c204540-d759-45e9-bebd-dd32d9dfcb1f None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:42.305037 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c204540-d759-45e9-bebd-dd32d9dfcb1f None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:42.309871 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcddda-b9cb-4668-a0c4-113f05de83ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:42.310457 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcddda-b9cb-4668-a0c4-113f05de83ce service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:42.311531 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcddda-b9cb-4668-a0c4-113f05de83ce service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:42.311820 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcddda-b9cb-4668-a0c4-113f05de83ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:42.319864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcddda-b9cb-4668-a0c4-113f05de83ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:42.345282 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcddda-b9cb-4668-a0c4-113f05de83ce service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:42.353990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 698/1395] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:46:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:46:43.724210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb9a42-25ea-4d02-a5a5-17d702bd1f22 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:43.724768 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb9a42-25ea-4d02-a5a5-17d702bd1f22 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:43.724768 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb9a42-25ea-4d02-a5a5-17d702bd1f22 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:43.726469 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 698/1396] 10.222.0.20 () {54 vars in 911 bytes} [Mon Aug 23 01:46:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:43.731096 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf34578-212d-4c2d-9ec4-43fa60dde772 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:43.731475 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf34578-212d-4c2d-9ec4-43fa60dde772 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:43.731667 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf34578-212d-4c2d-9ec4-43fa60dde772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:43.754026 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-caf34578-212d-4c2d-9ec4-43fa60dde772 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:43.755152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-caf34578-212d-4c2d-9ec4-43fa60dde772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:43.762188 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 699/1397] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 23 01:46:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:43.908118 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb9a42-25ea-4d02-a5a5-17d702bd1f22 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:43.921469 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb9a42-25ea-4d02-a5a5-17d702bd1f22 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:43.926298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5686ca-a410-41e9-8d23-5af1003dd33e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:43.926862 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5686ca-a410-41e9-8d23-5af1003dd33e service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:43.927151 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5686ca-a410-41e9-8d23-5af1003dd33e service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:43.927434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5686ca-a410-41e9-8d23-5af1003dd33e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:43.935211 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5686ca-a410-41e9-8d23-5af1003dd33e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:43.961212 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5686ca-a410-41e9-8d23-5af1003dd33e service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:43.970563 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 699/1398] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:46:43 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:46:45.322541 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df302a3a-0429-4d85-bfa7-b4a3f03e4cdb None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:45.323115 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df302a3a-0429-4d85-bfa7-b4a3f03e4cdb None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:45.323115 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df302a3a-0429-4d85-bfa7-b4a3f03e4cdb None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:45.324784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 700/1399] 10.222.0.20 () {54 vars in 911 bytes} [Mon Aug 23 01:46:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:45.329493 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed170353-a27a-4163-9a79-11fe501a084b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:45.329895 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed170353-a27a-4163-9a79-11fe501a084b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:45.330066 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed170353-a27a-4163-9a79-11fe501a084b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:45.352737 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-ed170353-a27a-4163-9a79-11fe501a084b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:45.353894 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ed170353-a27a-4163-9a79-11fe501a084b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:45.361373 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 700/1400] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 23 01:46:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:45.523842 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df302a3a-0429-4d85-bfa7-b4a3f03e4cdb None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:45.537724 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df302a3a-0429-4d85-bfa7-b4a3f03e4cdb None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:45.542473 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b0530-23d7-46c0-8a72-9d2db95e1a5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:45.543032 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b0530-23d7-46c0-8a72-9d2db95e1a5b service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:45.543316 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b0530-23d7-46c0-8a72-9d2db95e1a5b service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:45.543594 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b0530-23d7-46c0-8a72-9d2db95e1a5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:45.551296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b0530-23d7-46c0-8a72-9d2db95e1a5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:45.576963 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b0530-23d7-46c0-8a72-9d2db95e1a5b service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:45.585568 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 701/1401] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:46:45 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:46:46.969565 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d86b8-108c-45a1-92ee-b1aa7548cd3e None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:46.970127 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d86b8-108c-45a1-92ee-b1aa7548cd3e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:46.970127 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d86b8-108c-45a1-92ee-b1aa7548cd3e None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:46.971800 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 701/1402] 10.222.0.20 () {54 vars in 911 bytes} [Mon Aug 23 01:46:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:46.976445 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbda177-e07d-4ac3-ad7c-fe0a83e578d6 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:46.976888 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbda177-e07d-4ac3-ad7c-fe0a83e578d6 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:46.977055 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbda177-e07d-4ac3-ad7c-fe0a83e578d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:47.001267 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-1cbda177-e07d-4ac3-ad7c-fe0a83e578d6 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:47.002400 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1cbda177-e07d-4ac3-ad7c-fe0a83e578d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:47.009189 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 702/1403] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 23 01:46:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:47.154401 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d86b8-108c-45a1-92ee-b1aa7548cd3e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:47.167593 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d86b8-108c-45a1-92ee-b1aa7548cd3e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:47.172868 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d6bbc-104e-4c1d-935e-eb48475afe52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:47.173428 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d6bbc-104e-4c1d-935e-eb48475afe52 service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:47.173708 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d6bbc-104e-4c1d-935e-eb48475afe52 service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:47.173985 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d6bbc-104e-4c1d-935e-eb48475afe52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:47.181611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d6bbc-104e-4c1d-935e-eb48475afe52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:47.207213 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d6bbc-104e-4c1d-935e-eb48475afe52 service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:47.215982 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 702/1404] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:46:47 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:46:49.119903 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386697ad-064f-4a78-b33d-5f8133892619 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:49.120463 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386697ad-064f-4a78-b33d-5f8133892619 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:49.120463 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386697ad-064f-4a78-b33d-5f8133892619 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:49.122199 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 703/1405] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:46:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:49.127218 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a7c3a-130f-45bc-b52f-9bef7c5dc971 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:49.127623 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a7c3a-130f-45bc-b52f-9bef7c5dc971 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:49.127780 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a7c3a-130f-45bc-b52f-9bef7c5dc971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:49.149930 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-701a7c3a-130f-45bc-b52f-9bef7c5dc971 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:49.151033 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-701a7c3a-130f-45bc-b52f-9bef7c5dc971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:49.158298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 703/1406] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:46:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:49.194650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386697ad-064f-4a78-b33d-5f8133892619 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:49.205440 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386697ad-064f-4a78-b33d-5f8133892619 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:49.208657 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf384e49-a7e7-467e-b3c5-b430d8c8302e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:49.209220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf384e49-a7e7-467e-b3c5-b430d8c8302e service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:49.209508 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf384e49-a7e7-467e-b3c5-b430d8c8302e service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:49.209788 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf384e49-a7e7-467e-b3c5-b430d8c8302e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:49.218781 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf384e49-a7e7-467e-b3c5-b430d8c8302e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:49.243406 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf384e49-a7e7-467e-b3c5-b430d8c8302e service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:49.252197 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 704/1407] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:46:49 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:46:51.318569 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe0b87-06cd-4360-80b2-f14d5e3048e5 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:51.319110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe0b87-06cd-4360-80b2-f14d5e3048e5 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:51.319110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe0b87-06cd-4360-80b2-f14d5e3048e5 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:51.320811 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 704/1408] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:46:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:51.325918 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439c57f-dfa5-4869-ba3d-7fbdc6047909 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:51.326381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439c57f-dfa5-4869-ba3d-7fbdc6047909 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:51.326485 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439c57f-dfa5-4869-ba3d-7fbdc6047909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:51.348827 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-8439c57f-dfa5-4869-ba3d-7fbdc6047909 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:51.349960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-8439c57f-dfa5-4869-ba3d-7fbdc6047909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:51.356830 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 705/1409] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:46:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:51.393954 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe0b87-06cd-4360-80b2-f14d5e3048e5 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:51.404184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe0b87-06cd-4360-80b2-f14d5e3048e5 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:51.408068 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beeb3af-bfc4-407f-9cf7-bb9be114eaab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:51.408665 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beeb3af-bfc4-407f-9cf7-bb9be114eaab service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:51.408953 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beeb3af-bfc4-407f-9cf7-bb9be114eaab service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:51.409230 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beeb3af-bfc4-407f-9cf7-bb9be114eaab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:51.418073 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beeb3af-bfc4-407f-9cf7-bb9be114eaab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:51.443037 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beeb3af-bfc4-407f-9cf7-bb9be114eaab service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:51.452522 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 705/1410] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:46:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:46:54.008935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c83fbf-aa47-43b9-94f5-f53e4773485b None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:54.009539 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c83fbf-aa47-43b9-94f5-f53e4773485b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:54.009539 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c83fbf-aa47-43b9-94f5-f53e4773485b None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:54.011142 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 706/1411] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:46:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:54.017063 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac845229-fc81-4876-be2c-a5dc7fb0f9a5 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:54.017795 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac845229-fc81-4876-be2c-a5dc7fb0f9a5 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:54.018006 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac845229-fc81-4876-be2c-a5dc7fb0f9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:54.039883 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-ac845229-fc81-4876-be2c-a5dc7fb0f9a5 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:54.041022 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ac845229-fc81-4876-be2c-a5dc7fb0f9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:54.047688 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 706/1412] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:46:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:54.085971 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c83fbf-aa47-43b9-94f5-f53e4773485b None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:54.096024 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c83fbf-aa47-43b9-94f5-f53e4773485b None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:54.099236 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8c981-d86e-4cca-85b7-a9be5f25e96e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:54.099789 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8c981-d86e-4cca-85b7-a9be5f25e96e service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:54.100070 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8c981-d86e-4cca-85b7-a9be5f25e96e service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:54.100346 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8c981-d86e-4cca-85b7-a9be5f25e96e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:54.108829 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8c981-d86e-4cca-85b7-a9be5f25e96e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:54.133765 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8c981-d86e-4cca-85b7-a9be5f25e96e service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:54.143194 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 707/1413] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:46:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:46:56.215278 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e039f6d-3cd0-4225-9332-012872419b7a None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:56.215739 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e039f6d-3cd0-4225-9332-012872419b7a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:56.215841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e039f6d-3cd0-4225-9332-012872419b7a None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:56.218144 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 707/1414] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:46:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:56.223359 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8c587-68b9-4961-a19a-b434a4774186 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:56.223789 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8c587-68b9-4961-a19a-b434a4774186 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:56.223953 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8c587-68b9-4961-a19a-b434a4774186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:56.245843 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-d8d8c587-68b9-4961-a19a-b434a4774186 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:56.246977 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d8d8c587-68b9-4961-a19a-b434a4774186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:56.254301 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 708/1415] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:46:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:46:56.291965 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e039f6d-3cd0-4225-9332-012872419b7a None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:56.302179 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e039f6d-3cd0-4225-9332-012872419b7a None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:56.305376 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65076d3-9a5a-4e85-bd78-958a4a47d595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:56.305935 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65076d3-9a5a-4e85-bd78-958a4a47d595 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:56.306222 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65076d3-9a5a-4e85-bd78-958a4a47d595 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:56.306504 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65076d3-9a5a-4e85-bd78-958a4a47d595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:56.315404 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65076d3-9a5a-4e85-bd78-958a4a47d595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:56.340891 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65076d3-9a5a-4e85-bd78-958a4a47d595 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:56.349598 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 708/1416] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:46:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:46:58.421071 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fedafc-7437-47f0-ad56-e3465b757eb2 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:58.421572 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fedafc-7437-47f0-ad56-e3465b757eb2 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:58.421682 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fedafc-7437-47f0-ad56-e3465b757eb2 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:58.423449 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 709/1417] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:46:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:46:58.428374 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48f100-b78a-451e-9513-e3f21b9b3a95 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:58.428816 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48f100-b78a-451e-9513-e3f21b9b3a95 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:58.428983 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48f100-b78a-451e-9513-e3f21b9b3a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:58.451669 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-2e48f100-b78a-451e-9513-e3f21b9b3a95 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:46:58.452775 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-2e48f100-b78a-451e-9513-e3f21b9b3a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:46:58.460590 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 709/1418] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:46:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:46:58.498650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fedafc-7437-47f0-ad56-e3465b757eb2 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:46:58.509291 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fedafc-7437-47f0-ad56-e3465b757eb2 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:46:58.512768 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57775357-81b6-4518-b12b-2dd0cbc44236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:46:58.513323 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57775357-81b6-4518-b12b-2dd0cbc44236 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:46:58.514182 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57775357-81b6-4518-b12b-2dd0cbc44236 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:46:58.514458 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57775357-81b6-4518-b12b-2dd0cbc44236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:46:58.522845 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57775357-81b6-4518-b12b-2dd0cbc44236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:46:58.547982 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57775357-81b6-4518-b12b-2dd0cbc44236 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:46:58.556615 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 710/1419] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:46:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:47:00.581393 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01caa40-4246-4c21-950e-5cf56ce6f4e5 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:00.581956 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01caa40-4246-4c21-950e-5cf56ce6f4e5 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:00.581956 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01caa40-4246-4c21-950e-5cf56ce6f4e5 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:00.583614 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 710/1420] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:47:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:47:00.588751 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac13aa-6e31-48a4-8ec2-6a3e20e525d7 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:00.589168 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac13aa-6e31-48a4-8ec2-6a3e20e525d7 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:00.589318 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac13aa-6e31-48a4-8ec2-6a3e20e525d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:00.612056 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-88ac13aa-6e31-48a4-8ec2-6a3e20e525d7 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:47:00.613232 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-88ac13aa-6e31-48a4-8ec2-6a3e20e525d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:47:00.620103 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 711/1421] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:47:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:47:00.657593 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01caa40-4246-4c21-950e-5cf56ce6f4e5 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:47:00.667891 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01caa40-4246-4c21-950e-5cf56ce6f4e5 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:47:00.671214 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ee3cf-53c3-480e-b203-24c4ea3ef657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:47:00.671781 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ee3cf-53c3-480e-b203-24c4ea3ef657 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:00.672069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ee3cf-53c3-480e-b203-24c4ea3ef657 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:00.672347 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ee3cf-53c3-480e-b203-24c4ea3ef657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:00.680860 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ee3cf-53c3-480e-b203-24c4ea3ef657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:47:00.706302 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ee3cf-53c3-480e-b203-24c4ea3ef657 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:47:00.715034 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 711/1422] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:47:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:47:02.781347 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b32b61-a7e9-496b-a925-342af65cc8c0 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:02.781907 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b32b61-a7e9-496b-a925-342af65cc8c0 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:02.781907 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b32b61-a7e9-496b-a925-342af65cc8c0 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:02.783552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 712/1423] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:47:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:47:02.788592 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00743522-bff0-48e5-aad0-7b14c690a963 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:02.789002 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00743522-bff0-48e5-aad0-7b14c690a963 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:02.789164 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00743522-bff0-48e5-aad0-7b14c690a963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:02.811266 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-00743522-bff0-48e5-aad0-7b14c690a963 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:47:02.812388 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-00743522-bff0-48e5-aad0-7b14c690a963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:47:02.819391 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 712/1424] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:47:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:47:02.856260 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b32b61-a7e9-496b-a925-342af65cc8c0 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:47:02.866450 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b32b61-a7e9-496b-a925-342af65cc8c0 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:47:02.869615 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b6796-ae8c-4862-8903-73659f98eaf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:47:02.870171 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b6796-ae8c-4862-8903-73659f98eaf0 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:02.870455 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b6796-ae8c-4862-8903-73659f98eaf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:02.870732 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b6796-ae8c-4862-8903-73659f98eaf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:02.879034 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b6796-ae8c-4862-8903-73659f98eaf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:47:02.904455 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b6796-ae8c-4862-8903-73659f98eaf0 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:47:02.913164 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 713/1425] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:47:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:47:04.955468 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086b3bf-3e90-4247-a9db-8301cf4f443b None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:04.956032 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086b3bf-3e90-4247-a9db-8301cf4f443b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:04.956032 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086b3bf-3e90-4247-a9db-8301cf4f443b None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:04.957723 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 713/1426] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:47:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:47:04.962804 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328843b-07bd-4408-b3f8-218ee6655bcc None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:04.963208 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328843b-07bd-4408-b3f8-218ee6655bcc None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:04.963366 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328843b-07bd-4408-b3f8-218ee6655bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:04.985725 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-7328843b-07bd-4408-b3f8-218ee6655bcc None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:47:04.986844 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-7328843b-07bd-4408-b3f8-218ee6655bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:47:04.993688 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 714/1427] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:47:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:47:05.030341 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086b3bf-3e90-4247-a9db-8301cf4f443b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:47:05.040589 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086b3bf-3e90-4247-a9db-8301cf4f443b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:47:05.043833 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d25f5-3cb1-4072-ab38-c327872af68d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:47:05.044435 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d25f5-3cb1-4072-ab38-c327872af68d service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:05.044767 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d25f5-3cb1-4072-ab38-c327872af68d service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:05.045052 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d25f5-3cb1-4072-ab38-c327872af68d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:05.053908 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d25f5-3cb1-4072-ab38-c327872af68d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:47:05.079325 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d25f5-3cb1-4072-ab38-c327872af68d service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:47:05.088072 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 714/1428] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:47:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:47:07.120297 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0607c-fd23-4118-8e29-d122d28651a3 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:07.120865 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0607c-fd23-4118-8e29-d122d28651a3 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:07.120865 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0607c-fd23-4118-8e29-d122d28651a3 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:07.122571 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 715/1429] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:47:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:47:07.127596 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54892b7a-68ad-4cfc-ac17-21eac3d07a7a None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:07.128053 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54892b7a-68ad-4cfc-ac17-21eac3d07a7a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:07.128162 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54892b7a-68ad-4cfc-ac17-21eac3d07a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:07.151703 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-54892b7a-68ad-4cfc-ac17-21eac3d07a7a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:47:07.152842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-54892b7a-68ad-4cfc-ac17-21eac3d07a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:47:07.160079 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 715/1430] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:47:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:47:07.195195 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0607c-fd23-4118-8e29-d122d28651a3 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:47:07.206049 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0607c-fd23-4118-8e29-d122d28651a3 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:47:07.209280 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ea873-637e-4150-92fb-c544aa6fa408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:47:07.209841 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ea873-637e-4150-92fb-c544aa6fa408 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:07.210127 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ea873-637e-4150-92fb-c544aa6fa408 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:07.210406 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ea873-637e-4150-92fb-c544aa6fa408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:07.219630 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ea873-637e-4150-92fb-c544aa6fa408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:47:07.244226 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ea873-637e-4150-92fb-c544aa6fa408 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:47:07.252864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 716/1431] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:47:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:47:09.236146 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97678645-e624-46a7-9cbb-cfda4651ba02 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:09.236704 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97678645-e624-46a7-9cbb-cfda4651ba02 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:09.236823 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97678645-e624-46a7-9cbb-cfda4651ba02 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:09.238452 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 716/1432] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:47:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:47:09.243723 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd3a85-e039-4524-83fd-cd2a425a3a34 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:09.244167 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd3a85-e039-4524-83fd-cd2a425a3a34 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:09.244293 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd3a85-e039-4524-83fd-cd2a425a3a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:09.266295 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-82cd3a85-e039-4524-83fd-cd2a425a3a34 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:47:09.267450 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-82cd3a85-e039-4524-83fd-cd2a425a3a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:47:09.274337 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 717/1433] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:47:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:47:09.310962 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97678645-e624-46a7-9cbb-cfda4651ba02 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:47:09.321531 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97678645-e624-46a7-9cbb-cfda4651ba02 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:47:09.324799 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94a4a1-a1b0-4c6f-86fe-f97b44120ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:47:09.325365 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94a4a1-a1b0-4c6f-86fe-f97b44120ace service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:09.325670 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94a4a1-a1b0-4c6f-86fe-f97b44120ace service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:09.325951 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94a4a1-a1b0-4c6f-86fe-f97b44120ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:09.334407 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94a4a1-a1b0-4c6f-86fe-f97b44120ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:47:09.360175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94a4a1-a1b0-4c6f-86fe-f97b44120ace service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:47:09.369020 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 717/1434] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:47:09 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:47:21.516969 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8f74c-542f-4d99-9215-7aa51824d390 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:21.517521 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8f74c-542f-4d99-9215-7aa51824d390 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:21.517617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8f74c-542f-4d99-9215-7aa51824d390 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:21.519229 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 718/1435] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:47:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:47:21.524254 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e0355-7d1e-4444-9dba-e77018daf4ed None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:21.524738 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e0355-7d1e-4444-9dba-e77018daf4ed None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:21.524864 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e0355-7d1e-4444-9dba-e77018daf4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:21.547078 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-396e0355-7d1e-4444-9dba-e77018daf4ed None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:47:21.548186 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-396e0355-7d1e-4444-9dba-e77018daf4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:47:21.554970 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 718/1436] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:47:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:47:21.598799 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8f74c-542f-4d99-9215-7aa51824d390 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:47:21.609623 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8f74c-542f-4d99-9215-7aa51824d390 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:47:21.612842 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74793968-9a08-4d5e-ae01-1dc95f793b08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913cd471ba494382af7dda858b9010c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:47:21.613404 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793968-9a08-4d5e-ae01-1dc95f793b08 service glance] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:21.613691 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793968-9a08-4d5e-ae01-1dc95f793b08 service glance] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:21.613971 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793968-9a08-4d5e-ae01-1dc95f793b08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:21.622451 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74793968-9a08-4d5e-ae01-1dc95f793b08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:47:21.647593 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74793968-9a08-4d5e-ae01-1dc95f793b08 service glance] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:47:21.658548 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 719/1437] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:47:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:47:23.705954 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f002d-a781-4096-8a7a-a603969bd64b None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:23.706540 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f002d-a781-4096-8a7a-a603969bd64b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:23.706540 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f002d-a781-4096-8a7a-a603969bd64b None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:23.708080 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 719/1438] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:47:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:47:23.713122 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0501f-296a-498d-9913-63865832eaa8 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:23.713548 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0501f-296a-498d-9913-63865832eaa8 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:23.713700 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0501f-296a-498d-9913-63865832eaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:23.736225 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-d4c0501f-296a-498d-9913-63865832eaa8 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:47:23.737404 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d4c0501f-296a-498d-9913-63865832eaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:47:23.744170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 720/1439] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:47:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:47:23.766509 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f002d-a781-4096-8a7a-a603969bd64b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:47:23.777927 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f002d-a781-4096-8a7a-a603969bd64b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:47:23.781859 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca394d-9b2b-458b-b2c4-a1f45666206e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:47:23.782424 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca394d-9b2b-458b-b2c4-a1f45666206e admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:23.782707 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca394d-9b2b-458b-b2c4-a1f45666206e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:23.782983 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca394d-9b2b-458b-b2c4-a1f45666206e admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:23.783661 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca394d-9b2b-458b-b2c4-a1f45666206e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:47:23.809211 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca394d-9b2b-458b-b2c4-a1f45666206e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:47:23.824396 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 720/1440] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 23 01:47:23 2021] GET /identity/v3/projects => generated 2553 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:47:25.334145 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430712c-297a-4e8c-9f48-5a5c7d479660 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:25.334743 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430712c-297a-4e8c-9f48-5a5c7d479660 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:25.334743 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430712c-297a-4e8c-9f48-5a5c7d479660 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:25.336371 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 721/1441] 10.222.0.20 () {54 vars in 911 bytes} [Mon Aug 23 01:47:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:47:25.340998 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614ab1f-1c92-4dae-a875-a17b7d93f541 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:25.341446 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614ab1f-1c92-4dae-a875-a17b7d93f541 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:25.341574 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614ab1f-1c92-4dae-a875-a17b7d93f541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:25.364687 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-5614ab1f-1c92-4dae-a875-a17b7d93f541 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:47:25.366142 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-5614ab1f-1c92-4dae-a875-a17b7d93f541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:47:25.373902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 721/1442] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 23 01:47:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:47:25.520550 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430712c-297a-4e8c-9f48-5a5c7d479660 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:47:25.534216 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430712c-297a-4e8c-9f48-5a5c7d479660 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:47:25.539072 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf52c18-3511-4c0a-afbb-af49df4b273a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:47:25.539694 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf52c18-3511-4c0a-afbb-af49df4b273a service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:25.539985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf52c18-3511-4c0a-afbb-af49df4b273a service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:25.540268 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf52c18-3511-4c0a-afbb-af49df4b273a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:25.548822 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf52c18-3511-4c0a-afbb-af49df4b273a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:47:25.574502 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf52c18-3511-4c0a-afbb-af49df4b273a service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:47:25.583890 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 722/1443] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:47:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:47:27.555856 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee11658-35f2-4edb-923f-120938dc31b3 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:27.556433 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee11658-35f2-4edb-923f-120938dc31b3 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:27.556433 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee11658-35f2-4edb-923f-120938dc31b3 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:27.558121 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 722/1444] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:47:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:47:27.563910 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75274b19-263c-4b92-bbec-669db37e95b6 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:27.564349 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75274b19-263c-4b92-bbec-669db37e95b6 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:27.564503 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75274b19-263c-4b92-bbec-669db37e95b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:27.587200 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-75274b19-263c-4b92-bbec-669db37e95b6 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:47:27.588344 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-75274b19-263c-4b92-bbec-669db37e95b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:47:27.595836 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 723/1445] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:47:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:47:27.633494 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee11658-35f2-4edb-923f-120938dc31b3 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:47:27.644695 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee11658-35f2-4edb-923f-120938dc31b3 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:47:27.648110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d42437-85f0-4610-b7c8-c5563d82582b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:47:27.648725 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d42437-85f0-4610-b7c8-c5563d82582b service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:27.649012 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d42437-85f0-4610-b7c8-c5563d82582b service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:27.649291 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d42437-85f0-4610-b7c8-c5563d82582b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:27.658884 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d42437-85f0-4610-b7c8-c5563d82582b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:47:27.685037 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d42437-85f0-4610-b7c8-c5563d82582b service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:47:27.695043 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 723/1446] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:47:27 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:47:29.681799 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9b44-0edf-49c2-a6ff-8118ecbefb81 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:29.682392 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9b44-0edf-49c2-a6ff-8118ecbefb81 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:29.682392 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9b44-0edf-49c2-a6ff-8118ecbefb81 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:29.684082 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 724/1447] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:47:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 01:47:29.690018 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db67fc-24d5-4ddd-b2b4-0a6db5025c5a None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:29.690421 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db67fc-24d5-4ddd-b2b4-0a6db5025c5a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:29.690522 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db67fc-24d5-4ddd-b2b4-0a6db5025c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:29.712773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-67db67fc-24d5-4ddd-b2b4-0a6db5025c5a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:47:29.716626 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-67db67fc-24d5-4ddd-b2b4-0a6db5025c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:47:29.721215 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 724/1448] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:47:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:47:29.758871 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a9b44-0edf-49c2-a6ff-8118ecbefb81 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:47:29.769075 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a9b44-0edf-49c2-a6ff-8118ecbefb81 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:47:29.772189 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb4e18-9425-4d8a-bc88-3efc488d51c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:47:29.772772 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb4e18-9425-4d8a-bc88-3efc488d51c3 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:29.773058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb4e18-9425-4d8a-bc88-3efc488d51c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:29.773335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb4e18-9425-4d8a-bc88-3efc488d51c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:29.781934 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb4e18-9425-4d8a-bc88-3efc488d51c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:47:29.807287 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb4e18-9425-4d8a-bc88-3efc488d51c3 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:47:29.817533 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 725/1449] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:47:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:47:31.893731 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146a130-796f-4b16-96c0-d87941529935 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:31.894263 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146a130-796f-4b16-96c0-d87941529935 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:31.894372 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146a130-796f-4b16-96c0-d87941529935 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:31.895999 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 725/1450] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:47:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:47:31.901190 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c47944-02cd-41a9-a2f5-5b3647f33ea8 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:31.901618 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c47944-02cd-41a9-a2f5-5b3647f33ea8 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:31.901750 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c47944-02cd-41a9-a2f5-5b3647f33ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:31.923938 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-f5c47944-02cd-41a9-a2f5-5b3647f33ea8 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:47:31.925098 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-f5c47944-02cd-41a9-a2f5-5b3647f33ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:47:31.931845 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 726/1451] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:47:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:47:31.975675 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146a130-796f-4b16-96c0-d87941529935 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:47:31.985993 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146a130-796f-4b16-96c0-d87941529935 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:47:31.989290 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989a331-dfe6-4503-b501-4674c8f54f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:47:31.989868 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989a331-dfe6-4503-b501-4674c8f54f59 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:31.990157 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989a331-dfe6-4503-b501-4674c8f54f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:31.990438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989a331-dfe6-4503-b501-4674c8f54f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:31.999795 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989a331-dfe6-4503-b501-4674c8f54f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:47:32.024948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989a331-dfe6-4503-b501-4674c8f54f59 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:47:32.034677 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 726/1452] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:47:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:47:34.557961 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e95d5-dffa-452f-9814-2a8728cfeb53 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:34.558499 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e95d5-dffa-452f-9814-2a8728cfeb53 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:34.558499 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e95d5-dffa-452f-9814-2a8728cfeb53 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:34.560696 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 727/1453] 10.222.0.20 () {54 vars in 926 bytes} [Mon Aug 23 01:47:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:47:34.565742 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd5f5a-b83c-4aeb-a984-7129d9e54161 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:34.566161 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd5f5a-b83c-4aeb-a984-7129d9e54161 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:34.566306 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd5f5a-b83c-4aeb-a984-7129d9e54161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:34.589253 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-f0fd5f5a-b83c-4aeb-a984-7129d9e54161 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:47:34.590399 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f0fd5f5a-b83c-4aeb-a984-7129d9e54161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:47:34.597399 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 727/1454] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 23 01:47:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:47:34.634718 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e95d5-dffa-452f-9814-2a8728cfeb53 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:47:34.645426 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e95d5-dffa-452f-9814-2a8728cfeb53 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:47:34.648532 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d20b51-6cef-4d31-b0df-31f572471ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:47:34.649111 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d20b51-6cef-4d31-b0df-31f572471ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:47:34.649392 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d20b51-6cef-4d31-b0df-31f572471ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:47:34.649666 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d20b51-6cef-4d31-b0df-31f572471ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:47:34.662029 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d20b51-6cef-4d31-b0df-31f572471ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:47:34.687485 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d20b51-6cef-4d31-b0df-31f572471ce9 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:47:34.698092 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 728/1455] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:47:34 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:49:15.326283 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81876abe-e4d2-4e1a-89cf-f85e00f1f97d None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:49:15.326875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81876abe-e4d2-4e1a-89cf-f85e00f1f97d None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:49:15.326875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81876abe-e4d2-4e1a-89cf-f85e00f1f97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:49:15.348708 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-81876abe-e4d2-4e1a-89cf-f85e00f1f97d None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:49:15.349815 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-81876abe-e4d2-4e1a-89cf-f85e00f1f97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:49:15.356630 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 728/1456] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:49:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:49:15.364277 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561793ab-1cb3-40e1-b3d6-cbb22153313c None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:49:15.364805 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561793ab-1cb3-40e1-b3d6-cbb22153313c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:49:15.364905 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561793ab-1cb3-40e1-b3d6-cbb22153313c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:49:15.387511 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-561793ab-1cb3-40e1-b3d6-cbb22153313c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:49:15.388675 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-561793ab-1cb3-40e1-b3d6-cbb22153313c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:49:15.395529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 729/1457] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:49:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:49:15.399956 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81876abe-e4d2-4e1a-89cf-f85e00f1f97d None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:49:15.409434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81876abe-e4d2-4e1a-89cf-f85e00f1f97d None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:49:15.413533 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a971b52-bae5-428d-a98b-481d65f2ae9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:49:15.414110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a971b52-bae5-428d-a98b-481d65f2ae9b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:49:15.414397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a971b52-bae5-428d-a98b-481d65f2ae9b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:49:15.414679 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a971b52-bae5-428d-a98b-481d65f2ae9b admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:49:15.415353 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a971b52-bae5-428d-a98b-481d65f2ae9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:49:15.415650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a971b52-bae5-428d-a98b-481d65f2ae9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:49:15.441246 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a971b52-bae5-428d-a98b-481d65f2ae9b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:49:15.463288 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 729/1458] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:49:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:49:15.471670 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561793ab-1cb3-40e1-b3d6-cbb22153313c None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:49:15.480453 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561793ab-1cb3-40e1-b3d6-cbb22153313c None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:49:15.484591 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc979c3e-b372-4b74-9756-116fb2220e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:49:15.485178 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc979c3e-b372-4b74-9756-116fb2220e02 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:49:15.485466 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc979c3e-b372-4b74-9756-116fb2220e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:49:15.485750 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc979c3e-b372-4b74-9756-116fb2220e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:49:15.486381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc979c3e-b372-4b74-9756-116fb2220e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:49:15.512687 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc979c3e-b372-4b74-9756-116fb2220e02 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:49:15.616498 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 730/1459] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:49:15 2021] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:49:15.620278 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a971b52-bae5-428d-a98b-481d65f2ae9b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:49:15.629649 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a971b52-bae5-428d-a98b-481d65f2ae9b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:49:15.690510 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca06502-17db-4302-87de-90c4f562414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:49:15.691107 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca06502-17db-4302-87de-90c4f562414d admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:49:15.691398 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca06502-17db-4302-87de-90c4f562414d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:49:15.691684 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca06502-17db-4302-87de-90c4f562414d admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:49:15.692348 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca06502-17db-4302-87de-90c4f562414d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:49:15.718658 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca06502-17db-4302-87de-90c4f562414d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:49:15.796798 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 730/1460] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:49:15 2021] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:49:15.800976 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc979c3e-b372-4b74-9756-116fb2220e02 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:49:15.811644 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc979c3e-b372-4b74-9756-116fb2220e02 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:49:15.816040 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53827659-f48e-4acc-86d1-4cfd2683344d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:49:15.816657 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53827659-f48e-4acc-86d1-4cfd2683344d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:49:15.816949 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53827659-f48e-4acc-86d1-4cfd2683344d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:49:15.817229 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53827659-f48e-4acc-86d1-4cfd2683344d admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:49:15.818030 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53827659-f48e-4acc-86d1-4cfd2683344d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:49:15.843129 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53827659-f48e-4acc-86d1-4cfd2683344d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:49:15.853128 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 731/1461] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:49:15 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:49:15.857693 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca06502-17db-4302-87de-90c4f562414d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:49:15.867044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca06502-17db-4302-87de-90c4f562414d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:49:15.871714 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e326354-677a-43d7-a161-95085e62b2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:49:15.872505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e326354-677a-43d7-a161-95085e62b2a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:49:15.872825 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e326354-677a-43d7-a161-95085e62b2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:49:15.873100 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e326354-677a-43d7-a161-95085e62b2a2 admin admin] PATH_INFO: `/v3/projects/2e8a1d7479264d5bbcf040eb637aeb04/users/f9d5ae4a3fc4448bb9e27290e788fa34/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:49:15.892384 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e326354-677a-43d7-a161-95085e62b2a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8a1d7479264d5bbcf040eb637aeb04, user_id=f9d5ae4a3fc4448bb9e27290e788fa34, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:49:15.919007 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e326354-677a-43d7-a161-95085e62b2a2 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:49:15.985008 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 731/1462] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:49:15 2021] PUT /identity/v3/projects/2e8a1d7479264d5bbcf040eb637aeb04/users/f9d5ae4a3fc4448bb9e27290e788fa34/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:49:16.004221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090f5c-2629-402b-9a6d-80586008a00c None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:49:16.004519 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090f5c-2629-402b-9a6d-80586008a00c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:49:16.004843 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090f5c-2629-402b-9a6d-80586008a00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:49:16.041165 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-cf090f5c-2629-402b-9a6d-80586008a00c None None] MFA Rules not processed for user `f9d5ae4a3fc4448bb9e27290e788fa34`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:49:16.042793 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-cf090f5c-2629-402b-9a6d-80586008a00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:49:16.111482 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 732/1463] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:49:16 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:49:16.122392 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e326354-677a-43d7-a161-95085e62b2a2 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:49:16.198074 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e326354-677a-43d7-a161-95085e62b2a2 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:49:16.203271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ee413-3480-469a-ad0e-86c6e0145378 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:49:16.203863 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ee413-3480-469a-ad0e-86c6e0145378 service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:49:16.204150 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ee413-3480-469a-ad0e-86c6e0145378 service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:49:16.204431 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ee413-3480-469a-ad0e-86c6e0145378 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:49:16.212221 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ee413-3480-469a-ad0e-86c6e0145378 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:49:16.238235 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ee413-3480-469a-ad0e-86c6e0145378 service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:49:16.246622 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 732/1464] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:49:16 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:49:16.324519 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13bd85-0747-4357-a251-56fd87100f75 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:49:16.324841 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13bd85-0747-4357-a251-56fd87100f75 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:49:16.325118 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13bd85-0747-4357-a251-56fd87100f75 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:49:16.326769 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 733/1465] 10.222.0.20 () {52 vars in 829 bytes} [Mon Aug 23 01:49:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:49:16.330215 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ee413-3480-469a-ad0e-86c6e0145378 service nova] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:49:16.397686 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ee413-3480-469a-ad0e-86c6e0145378 service nova] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:49:16.402272 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a273f50-7061-43e7-9402-ace4de001f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:49:16.403102 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a273f50-7061-43e7-9402-ace4de001f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:49:16.403388 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a273f50-7061-43e7-9402-ace4de001f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:49:16.403665 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a273f50-7061-43e7-9402-ace4de001f41 admin admin] PATH_INFO: `/v3/users/f9d5ae4a3fc4448bb9e27290e788fa34` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:49:16.404755 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a273f50-7061-43e7-9402-ace4de001f41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9d5ae4a3fc4448bb9e27290e788fa34)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:49:16.430111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-0a273f50-7061-43e7-9402-ace4de001f41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:49:16.430111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:49:16.430111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:49:16.431294 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a273f50-7061-43e7-9402-ace4de001f41 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:49:16.647126 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0a273f50-7061-43e7-9402-ace4de001f41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9d5ae4a3fc4448bb9e27290e788fa34'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:49:16.647772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0a273f50-7061-43e7-9402-ace4de001f41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9d5ae4a3fc4448bb9e27290e788fa34'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:49:16.739014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0a273f50-7061-43e7-9402-ace4de001f41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9d5ae4a3fc4448bb9e27290e788fa34'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:49:16.748877 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0a273f50-7061-43e7-9402-ace4de001f41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9d5ae4a3fc4448bb9e27290e788fa34'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:49:16.749561 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0a273f50-7061-43e7-9402-ace4de001f41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9d5ae4a3fc4448bb9e27290e788fa34'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:49:16.771534 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 733/1466] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:49:16 2021] DELETE /identity/v3/users/f9d5ae4a3fc4448bb9e27290e788fa34 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:49:16.776888 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b81999-d476-4170-b33b-06d3fc0fe2a7 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:49:16.776888 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b81999-d476-4170-b33b-06d3fc0fe2a7 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:49:16.777430 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b81999-d476-4170-b33b-06d3fc0fe2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:49:16.798073 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-71b81999-d476-4170-b33b-06d3fc0fe2a7 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:49:16.799203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-71b81999-d476-4170-b33b-06d3fc0fe2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:49:16.861045 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 734/1467] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:49:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:49:16.871170 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a273f50-7061-43e7-9402-ace4de001f41 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:49:16.872458 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0a273f50-7061-43e7-9402-ace4de001f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:49:16.934254 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a273f50-7061-43e7-9402-ace4de001f41 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:49:16.937469 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d9f29-eb8c-493f-bbf6-b3520c7fba86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:49:16.938044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d9f29-eb8c-493f-bbf6-b3520c7fba86 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:49:16.938331 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d9f29-eb8c-493f-bbf6-b3520c7fba86 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:49:16.938611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d9f29-eb8c-493f-bbf6-b3520c7fba86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:49:16.947376 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d9f29-eb8c-493f-bbf6-b3520c7fba86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:49:16.972643 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d9f29-eb8c-493f-bbf6-b3520c7fba86 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:49:16.981318 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 734/1468] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:49:16 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:49:17.594977 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b81999-d476-4170-b33b-06d3fc0fe2a7 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:49:17.596344 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-71b81999-d476-4170-b33b-06d3fc0fe2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:49:17.607742 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b81999-d476-4170-b33b-06d3fc0fe2a7 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:49:17.612176 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377ff33-6601-4f33-9021-f4e5f924ee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:49:17.613039 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377ff33-6601-4f33-9021-f4e5f924ee17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:49:17.613308 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377ff33-6601-4f33-9021-f4e5f924ee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:49:17.613592 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377ff33-6601-4f33-9021-f4e5f924ee17 admin admin] PATH_INFO: `/v3/projects/2e8a1d7479264d5bbcf040eb637aeb04` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:49:17.614772 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377ff33-6601-4f33-9021-f4e5f924ee17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e8a1d7479264d5bbcf040eb637aeb04)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:49:17.640110 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-0377ff33-6601-4f33-9021-f4e5f924ee17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:49:17.640110 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:49:17.640110 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:49:17.641330 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377ff33-6601-4f33-9021-f4e5f924ee17 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:49:17.754454 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0377ff33-6601-4f33-9021-f4e5f924ee17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8a1d7479264d5bbcf040eb637aeb04', 'request_id': 'req-0377ff33-6601-4f33-9021-f4e5f924ee17'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:49:17.759376 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0377ff33-6601-4f33-9021-f4e5f924ee17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8a1d7479264d5bbcf040eb637aeb04', 'request_id': 'req-0377ff33-6601-4f33-9021-f4e5f924ee17'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:49:17.770163 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0377ff33-6601-4f33-9021-f4e5f924ee17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8a1d7479264d5bbcf040eb637aeb04', 'request_id': 'req-0377ff33-6601-4f33-9021-f4e5f924ee17'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:49:17.846945 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0377ff33-6601-4f33-9021-f4e5f924ee17 admin admin] The token cache is being invalidate because project 2e8a1d7479264d5bbcf040eb637aeb04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:49:17.847586 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0377ff33-6601-4f33-9021-f4e5f924ee17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:49:17.847817 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0377ff33-6601-4f33-9021-f4e5f924ee17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:49:17.849341 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 735/1469] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:49:17 2021] DELETE /identity/v3/projects/2e8a1d7479264d5bbcf040eb637aeb04 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:50:40.675208 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc995b-9c7b-461d-8ac5-f74bdab9528b None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:50:40.675801 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc995b-9c7b-461d-8ac5-f74bdab9528b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:50:40.675902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc995b-9c7b-461d-8ac5-f74bdab9528b None None] PATH_INFO: `/v3` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:50:40.677118 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 735/1470] 10.222.0.21 () {54 vars in 926 bytes} [Mon Aug 23 01:50:40 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:50:40.683605 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f9fd7-c690-4190-9474-262a29e0f50c None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:50:40.684108 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f9fd7-c690-4190-9474-262a29e0f50c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:50:40.684108 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f9fd7-c690-4190-9474-262a29e0f50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:50:40.707892 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-9b1f9fd7-c690-4190-9474-262a29e0f50c None None] MFA Rules not processed for user `c4a6c587fd604395908134c50ce7618d`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:50:40.709142 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-9b1f9fd7-c690-4190-9474-262a29e0f50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:50:40.776871 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 736/1471] 10.222.0.21 () {58 vars in 1016 bytes} [Mon Aug 23 01:50:40 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:50:41.095343 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fcf24-1d30-4287-a665-6de5bac1d11a None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:50:41.095635 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fcf24-1d30-4287-a665-6de5bac1d11a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:50:41.095922 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fcf24-1d30-4287-a665-6de5bac1d11a None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:50:41.097634 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 736/1472] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 23 01:50:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:50:41.102127 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146067de-d4c8-4dca-8ec7-3cece2c03475 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:50:41.102427 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146067de-d4c8-4dca-8ec7-3cece2c03475 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:50:41.102715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146067de-d4c8-4dca-8ec7-3cece2c03475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:50:41.126172 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-146067de-d4c8-4dca-8ec7-3cece2c03475 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:50:41.127304 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-146067de-d4c8-4dca-8ec7-3cece2c03475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:50:41.190017 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 737/1473] 127.0.0.1 () {58 vars in 999 bytes} [Mon Aug 23 01:50:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:50:41.337698 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fcf24-1d30-4287-a665-6de5bac1d11a None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:50:41.339234 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-320fcf24-1d30-4287-a665-6de5bac1d11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:50:41.418298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fcf24-1d30-4287-a665-6de5bac1d11a None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:50:41.423176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f86618-409b-4dd7-833a-a9a176f89249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:50:41.423746 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f86618-409b-4dd7-833a-a9a176f89249 service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:50:41.424041 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f86618-409b-4dd7-833a-a9a176f89249 service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:50:41.424352 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f86618-409b-4dd7-833a-a9a176f89249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:50:41.432770 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f86618-409b-4dd7-833a-a9a176f89249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:50:41.458556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f86618-409b-4dd7-833a-a9a176f89249 service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:50:41.467547 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 737/1474] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:50:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:50:42.819285 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c9d3e-8cbb-4dfa-9d33-987959a2710f None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:50:42.819806 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c9d3e-8cbb-4dfa-9d33-987959a2710f None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:50:42.819806 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c9d3e-8cbb-4dfa-9d33-987959a2710f None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:50:42.821576 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 738/1475] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 23 01:50:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:50:42.827154 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12105c15-7dd9-4d4c-913e-61ee45bbff1a None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:50:42.827609 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12105c15-7dd9-4d4c-913e-61ee45bbff1a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:50:42.827779 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12105c15-7dd9-4d4c-913e-61ee45bbff1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:50:42.850001 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-12105c15-7dd9-4d4c-913e-61ee45bbff1a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:50:42.851124 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-12105c15-7dd9-4d4c-913e-61ee45bbff1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:50:42.858041 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 738/1476] 127.0.0.1 () {58 vars in 999 bytes} [Mon Aug 23 01:50:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:50:43.006790 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c9d3e-8cbb-4dfa-9d33-987959a2710f None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:50:43.020852 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c9d3e-8cbb-4dfa-9d33-987959a2710f None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:50:43.025810 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48822acf-52df-4381-8bd8-2f173363b8a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:50:43.026371 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48822acf-52df-4381-8bd8-2f173363b8a3 service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:50:43.026683 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48822acf-52df-4381-8bd8-2f173363b8a3 service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:50:43.026965 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48822acf-52df-4381-8bd8-2f173363b8a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:50:43.034781 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48822acf-52df-4381-8bd8-2f173363b8a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:50:43.060239 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48822acf-52df-4381-8bd8-2f173363b8a3 service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:50:43.071043 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 739/1477] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:50:43 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:50:44.535224 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597a3e0-9912-4560-a33b-8858fae0c06c None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:50:44.535636 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597a3e0-9912-4560-a33b-8858fae0c06c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:50:44.535790 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597a3e0-9912-4560-a33b-8858fae0c06c None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:50:44.537540 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 739/1478] 10.222.0.20 () {54 vars in 960 bytes} [Mon Aug 23 01:50:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:50:44.543066 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb8d4e-dc96-4a65-a340-b3f4eaf39e57 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:50:44.543524 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb8d4e-dc96-4a65-a340-b3f4eaf39e57 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:50:44.543665 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb8d4e-dc96-4a65-a340-b3f4eaf39e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:50:44.566106 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-f4fb8d4e-dc96-4a65-a340-b3f4eaf39e57 None None] MFA Rules not processed for user `c4a6c587fd604395908134c50ce7618d`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:50:44.567266 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-f4fb8d4e-dc96-4a65-a340-b3f4eaf39e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:50:44.574556 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 740/1479] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Aug 23 01:50:44 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:50:44.581883 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597a3e0-9912-4560-a33b-8858fae0c06c None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:50:44.594584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597a3e0-9912-4560-a33b-8858fae0c06c None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:50:44.598945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35d473-f51c-47ca-b543-55e79b19d180 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4a6c587fd604395908134c50ce7618d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:50:44.599504 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35d473-f51c-47ca-b543-55e79b19d180 service placement] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:50:44.599793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35d473-f51c-47ca-b543-55e79b19d180 service placement] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:50:44.600072 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35d473-f51c-47ca-b543-55e79b19d180 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:50:44.608479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35d473-f51c-47ca-b543-55e79b19d180 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:50:44.633355 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35d473-f51c-47ca-b543-55e79b19d180 service placement] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:50:44.642685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 740/1480] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:50:44 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:50:54.808251 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a73dcf-0602-44ad-92ea-b45593454d76 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:50:54.808818 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a73dcf-0602-44ad-92ea-b45593454d76 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:50:54.808818 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a73dcf-0602-44ad-92ea-b45593454d76 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:50:54.810380 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 741/1481] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 23 01:50:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:50:54.815371 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479ca47-6cf6-4c2b-8007-74e729e602b3 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:50:54.815773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479ca47-6cf6-4c2b-8007-74e729e602b3 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:50:54.815938 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479ca47-6cf6-4c2b-8007-74e729e602b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:50:54.838084 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-6479ca47-6cf6-4c2b-8007-74e729e602b3 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:50:54.839205 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-6479ca47-6cf6-4c2b-8007-74e729e602b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:50:54.846573 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 741/1482] 127.0.0.1 () {58 vars in 999 bytes} [Mon Aug 23 01:50:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:50:54.993963 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a73dcf-0602-44ad-92ea-b45593454d76 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:50:55.007141 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a73dcf-0602-44ad-92ea-b45593454d76 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:50:55.011975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fce12-2668-490a-8013-743058c70323 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:50:55.012532 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fce12-2668-490a-8013-743058c70323 service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:50:55.012844 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fce12-2668-490a-8013-743058c70323 service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:50:55.013122 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fce12-2668-490a-8013-743058c70323 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:50:55.020883 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606fce12-2668-490a-8013-743058c70323 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:50:55.046644 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606fce12-2668-490a-8013-743058c70323 service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:50:55.055322 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 742/1483] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:50:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:50:56.371512 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fbd3c-7f74-4f3e-ad31-92a4cf53e954 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:50:56.372079 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fbd3c-7f74-4f3e-ad31-92a4cf53e954 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:50:56.372079 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fbd3c-7f74-4f3e-ad31-92a4cf53e954 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:50:56.373939 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 742/1484] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 23 01:50:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:50:56.378302 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6f13f-ab7d-4714-ac69-895119301b05 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:50:56.378703 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6f13f-ab7d-4714-ac69-895119301b05 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:50:56.378863 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6f13f-ab7d-4714-ac69-895119301b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:50:56.401529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-63d6f13f-ab7d-4714-ac69-895119301b05 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:50:56.402678 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-63d6f13f-ab7d-4714-ac69-895119301b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:50:56.409454 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 743/1485] 127.0.0.1 () {58 vars in 999 bytes} [Mon Aug 23 01:50:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:50:56.554441 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fbd3c-7f74-4f3e-ad31-92a4cf53e954 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:50:56.568549 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fbd3c-7f74-4f3e-ad31-92a4cf53e954 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:50:56.573522 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbda842-d2c8-45b8-9240-fff1d4eb71d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:50:56.574688 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbda842-d2c8-45b8-9240-fff1d4eb71d8 service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:50:56.574981 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbda842-d2c8-45b8-9240-fff1d4eb71d8 service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:50:56.575267 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbda842-d2c8-45b8-9240-fff1d4eb71d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:50:56.583352 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbda842-d2c8-45b8-9240-fff1d4eb71d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:50:56.608790 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbda842-d2c8-45b8-9240-fff1d4eb71d8 service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:50:56.618103 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 743/1486] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:50:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:51:00.289713 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1872a5e-160f-4267-9be9-6fcb3d94c633 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:51:00.290319 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1872a5e-160f-4267-9be9-6fcb3d94c633 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:51:00.290319 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1872a5e-160f-4267-9be9-6fcb3d94c633 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:51:00.291922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 744/1487] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 23 01:51:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:51:00.297794 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f407aba-8a27-4c8e-8da4-d5c1a2fd191b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:51:00.305074 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f407aba-8a27-4c8e-8da4-d5c1a2fd191b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:51:00.305074 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f407aba-8a27-4c8e-8da4-d5c1a2fd191b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:51:00.328496 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-2f407aba-8a27-4c8e-8da4-d5c1a2fd191b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:51:00.329653 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-2f407aba-8a27-4c8e-8da4-d5c1a2fd191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:51:00.336744 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 744/1488] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 23 01:51:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:51:00.373047 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1872a5e-160f-4267-9be9-6fcb3d94c633 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:51:00.374636 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a1872a5e-160f-4267-9be9-6fcb3d94c633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:51:00.437318 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1872a5e-160f-4267-9be9-6fcb3d94c633 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:51:00.440800 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804ab4c-9f3e-4d33-a807-fcf7b315813d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:51:00.441371 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ab4c-9f3e-4d33-a807-fcf7b315813d service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:51:00.441654 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ab4c-9f3e-4d33-a807-fcf7b315813d service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:51:00.441930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ab4c-9f3e-4d33-a807-fcf7b315813d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:51:00.450927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804ab4c-9f3e-4d33-a807-fcf7b315813d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:51:00.476080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804ab4c-9f3e-4d33-a807-fcf7b315813d service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:51:00.484913 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 745/1489] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:51:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:51:02.443432 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8cbc1-14a1-412a-8e46-eaa40f3aa4cf None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:51:02.443896 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8cbc1-14a1-412a-8e46-eaa40f3aa4cf None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:51:02.443997 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8cbc1-14a1-412a-8e46-eaa40f3aa4cf None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:51:02.445724 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 745/1490] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 23 01:51:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:51:02.450768 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecb1c1-d361-4321-9ba8-bd339445737e None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:51:02.451192 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecb1c1-d361-4321-9ba8-bd339445737e None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:51:02.451426 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecb1c1-d361-4321-9ba8-bd339445737e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:51:02.474115 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-bfecb1c1-d361-4321-9ba8-bd339445737e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:51:02.475233 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-bfecb1c1-d361-4321-9ba8-bd339445737e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:51:02.482640 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 746/1491] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 23 01:51:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:51:02.516697 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8cbc1-14a1-412a-8e46-eaa40f3aa4cf None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:51:02.527319 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8cbc1-14a1-412a-8e46-eaa40f3aa4cf None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:51:02.530494 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b387ec-6d46-4147-9ab1-1f1f900af205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:51:02.531059 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b387ec-6d46-4147-9ab1-1f1f900af205 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:51:02.531341 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b387ec-6d46-4147-9ab1-1f1f900af205 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:51:02.531612 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b387ec-6d46-4147-9ab1-1f1f900af205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:51:02.539924 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b387ec-6d46-4147-9ab1-1f1f900af205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:51:02.565481 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b387ec-6d46-4147-9ab1-1f1f900af205 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:51:02.574657 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 746/1492] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:51:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:51:06.006613 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1436acf-26d1-472b-a8b5-f9d88aa19710 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:51:06.007200 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1436acf-26d1-472b-a8b5-f9d88aa19710 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:51:06.007200 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1436acf-26d1-472b-a8b5-f9d88aa19710 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:51:06.008851 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 747/1493] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 23 01:51:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:51:06.014660 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8eac97-26a4-443c-8538-01825254adfe None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:51:06.015062 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8eac97-26a4-443c-8538-01825254adfe None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:51:06.015229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8eac97-26a4-443c-8538-01825254adfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:51:06.037320 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-0f8eac97-26a4-443c-8538-01825254adfe None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:51:06.038448 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0f8eac97-26a4-443c-8538-01825254adfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:51:06.045282 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 747/1494] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 23 01:51:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:51:06.102368 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1436acf-26d1-472b-a8b5-f9d88aa19710 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:51:06.103949 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-c1436acf-26d1-472b-a8b5-f9d88aa19710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:51:06.165949 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1436acf-26d1-472b-a8b5-f9d88aa19710 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:51:06.169167 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3741115-b576-440a-b762-7e25d2473df0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:51:06.169731 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3741115-b576-440a-b762-7e25d2473df0 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:51:06.170014 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3741115-b576-440a-b762-7e25d2473df0 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:51:06.170290 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3741115-b576-440a-b762-7e25d2473df0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:51:06.178741 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3741115-b576-440a-b762-7e25d2473df0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:51:06.204617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3741115-b576-440a-b762-7e25d2473df0 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:51:06.213310 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 748/1495] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:51:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:51:08.199942 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1523d-599a-4e30-92b8-41e5f3871373 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:51:08.200520 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1523d-599a-4e30-92b8-41e5f3871373 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:51:08.200520 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1523d-599a-4e30-92b8-41e5f3871373 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:51:08.202227 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 748/1496] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 23 01:51:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:51:08.207319 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79170c-83a3-413b-b24c-65a1ee743780 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:51:08.207713 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79170c-83a3-413b-b24c-65a1ee743780 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:51:08.207883 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79170c-83a3-413b-b24c-65a1ee743780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:51:08.229943 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-ed79170c-83a3-413b-b24c-65a1ee743780 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:51:08.231063 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-ed79170c-83a3-413b-b24c-65a1ee743780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:51:08.237887 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 749/1497] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 23 01:51:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:51:08.294809 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76b86b-ab4f-43ae-8eb3-4aeff3514d6d None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:51:08.295104 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76b86b-ab4f-43ae-8eb3-4aeff3514d6d None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:51:08.295416 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76b86b-ab4f-43ae-8eb3-4aeff3514d6d None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:51:08.297145 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 749/1498] 10.222.0.20 () {54 vars in 962 bytes} [Mon Aug 23 01:51:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:51:08.301812 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e52c1-f5d0-4007-ad04-0c2b99feee84 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:51:08.302107 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e52c1-f5d0-4007-ad04-0c2b99feee84 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:51:08.302389 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e52c1-f5d0-4007-ad04-0c2b99feee84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:51:08.325310 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-d52e52c1-f5d0-4007-ad04-0c2b99feee84 None None] MFA Rules not processed for user `43ec554d6a304e029ee4f244f4a18e24`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:51:08.326417 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d52e52c1-f5d0-4007-ad04-0c2b99feee84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:51:08.332121 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 750/1499] 10.222.0.20 () {58 vars in 1060 bytes} [Mon Aug 23 01:51:08 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:51:08.339524 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76b86b-ab4f-43ae-8eb3-4aeff3514d6d None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:51:08.349752 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76b86b-ab4f-43ae-8eb3-4aeff3514d6d None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:51:08.353013 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480aa87-0a9a-4dc6-b64a-1fdabf404a18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:51:08.353567 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480aa87-0a9a-4dc6-b64a-1fdabf404a18 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:51:08.353855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480aa87-0a9a-4dc6-b64a-1fdabf404a18 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:51:08.354133 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480aa87-0a9a-4dc6-b64a-1fdabf404a18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:51:08.362613 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480aa87-0a9a-4dc6-b64a-1fdabf404a18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:51:08.388660 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480aa87-0a9a-4dc6-b64a-1fdabf404a18 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:51:08.397715 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 750/1500] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:51:08 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:34.307059 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456c15c-3439-40b8-a9d2-2c7c5e0877ef None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:34.307650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456c15c-3439-40b8-a9d2-2c7c5e0877ef None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:34.307650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456c15c-3439-40b8-a9d2-2c7c5e0877ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:34.338267 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-8456c15c-3439-40b8-a9d2-2c7c5e0877ef None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:34.339531 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-8456c15c-3439-40b8-a9d2-2c7c5e0877ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:34.351066 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 751/1501] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:52:34.360273 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0232e-657c-45d1-9d7a-bed8e6c26607 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:34.360826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0232e-657c-45d1-9d7a-bed8e6c26607 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:34.361184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0232e-657c-45d1-9d7a-bed8e6c26607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:34.402475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-aca0232e-657c-45d1-9d7a-bed8e6c26607 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:34.403614 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-aca0232e-657c-45d1-9d7a-bed8e6c26607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:34.418205 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 751/1502] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:34.426262 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456c15c-3439-40b8-a9d2-2c7c5e0877ef None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:34.440091 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456c15c-3439-40b8-a9d2-2c7c5e0877ef None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:34.457870 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e16797-610c-4ac9-ac09-efab4af81cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:34.458596 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e16797-610c-4ac9-ac09-efab4af81cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:34.458999 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e16797-610c-4ac9-ac09-efab4af81cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:34.459287 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e16797-610c-4ac9-ac09-efab4af81cc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:34.459977 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e16797-610c-4ac9-ac09-efab4af81cc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:52:34.460386 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e16797-610c-4ac9-ac09-efab4af81cc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:34.502786 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e16797-610c-4ac9-ac09-efab4af81cc7 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:34.527469 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 752/1503] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:52:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:52:34.535959 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0232e-657c-45d1-9d7a-bed8e6c26607 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:34.545316 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0232e-657c-45d1-9d7a-bed8e6c26607 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:34.553152 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d1e27-c7ad-4707-8dfe-eca8a245b311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:34.553747 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d1e27-c7ad-4707-8dfe-eca8a245b311 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:34.554036 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d1e27-c7ad-4707-8dfe-eca8a245b311 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:34.554306 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d1e27-c7ad-4707-8dfe-eca8a245b311 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:34.554956 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d1e27-c7ad-4707-8dfe-eca8a245b311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:34.585700 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d1e27-c7ad-4707-8dfe-eca8a245b311 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:34.731892 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 752/1504] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:52:34 2021] POST /identity/v3/projects => generated 389 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:34.736877 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e16797-610c-4ac9-ac09-efab4af81cc7 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:34.749172 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e16797-610c-4ac9-ac09-efab4af81cc7 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:34.781530 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9485c-f703-453b-8f3c-8025c608782c None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:34.781881 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9485c-f703-453b-8f3c-8025c608782c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:34.782107 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9485c-f703-453b-8f3c-8025c608782c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:34.826432 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-14b9485c-f703-453b-8f3c-8025c608782c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:34.828133 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-14b9485c-f703-453b-8f3c-8025c608782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:34.880415 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6af03-991b-44b2-ac5c-c98ee43a2fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:34.880970 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6af03-991b-44b2-ac5c-c98ee43a2fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:34.881260 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6af03-991b-44b2-ac5c-c98ee43a2fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:34.881538 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6af03-991b-44b2-ac5c-c98ee43a2fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:34.882185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6af03-991b-44b2-ac5c-c98ee43a2fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:34.911012 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6af03-991b-44b2-ac5c-c98ee43a2fb5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:34.949101 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 753/1505] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:52:34.950606 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43e9af-5eef-4dc5-8398-edf398ed067e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:34.951060 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43e9af-5eef-4dc5-8398-edf398ed067e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:34.952021 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43e9af-5eef-4dc5-8398-edf398ed067e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:34.975828 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-4d43e9af-5eef-4dc5-8398-edf398ed067e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:34.977254 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-4d43e9af-5eef-4dc5-8398-edf398ed067e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:34.984714 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 754/1506] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:34.986019 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb5516-98a2-4d34-91ca-acd288f6371e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:34.986314 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb5516-98a2-4d34-91ca-acd288f6371e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:34.986594 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb5516-98a2-4d34-91ca-acd288f6371e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.008191 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-6ddb5516-98a2-4d34-91ca-acd288f6371e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:35.009312 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-6ddb5516-98a2-4d34-91ca-acd288f6371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:35.013549 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 753/1507] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:52:34 2021] POST /identity/v3/users => generated 295 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:35.013549 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6ffee-314f-481f-ab12-9243baf8c77e None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.013549 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6ffee-314f-481f-ab12-9243baf8c77e None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.013549 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6ffee-314f-481f-ab12-9243baf8c77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.017790 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 755/1508] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:35.018969 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc5a5d-bf21-4c7c-9f57-b4d68e748b4c None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.019360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc5a5d-bf21-4c7c-9f57-b4d68e748b4c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.019582 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc5a5d-bf21-4c7c-9f57-b4d68e748b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.035836 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-c0c6ffee-314f-481f-ab12-9243baf8c77e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:35.037064 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-c0c6ffee-314f-481f-ab12-9243baf8c77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:35.041460 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-b0fc5a5d-bf21-4c7c-9f57-b4d68e748b4c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:35.042547 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-b0fc5a5d-bf21-4c7c-9f57-b4d68e748b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:35.043901 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 754/1509] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:35.045898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852d87e-b106-4724-a8f7-c9a2382c6f13 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.046286 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852d87e-b106-4724-a8f7-c9a2382c6f13 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.046836 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852d87e-b106-4724-a8f7-c9a2382c6f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.049700 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 756/1510] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:35.052735 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b94fe3-e213-4179-8455-5a2471425ea1 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.052735 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b94fe3-e213-4179-8455-5a2471425ea1 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.052735 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b94fe3-e213-4179-8455-5a2471425ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.072160 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-c852d87e-b106-4724-a8f7-c9a2382c6f13 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:35.073313 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-c852d87e-b106-4724-a8f7-c9a2382c6f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:35.073455 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-57b94fe3-e213-4179-8455-5a2471425ea1 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:35.074402 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-57b94fe3-e213-4179-8455-5a2471425ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:35.080106 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 755/1511] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:35.087211 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 757/1512] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:35.087326 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1ed87-8877-4d93-87a0-458e448b8758 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.087326 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1ed87-8877-4d93-87a0-458e448b8758 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.087326 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1ed87-8877-4d93-87a0-458e448b8758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.087604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41b7ba-1ccf-4a19-a7f8-bc4f7c368c2b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.087604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41b7ba-1ccf-4a19-a7f8-bc4f7c368c2b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.087604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41b7ba-1ccf-4a19-a7f8-bc4f7c368c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.104700 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-6f41b7ba-1ccf-4a19-a7f8-bc4f7c368c2b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:35.105779 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-7ef1ed87-8877-4d93-87a0-458e448b8758 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:35.105898 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-6f41b7ba-1ccf-4a19-a7f8-bc4f7c368c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:35.106862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-7ef1ed87-8877-4d93-87a0-458e448b8758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:35.113457 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 758/1513] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:35.114396 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 756/1514] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:35.118060 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2273f6-4d46-4243-8630-0c79abf73219 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.118359 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2273f6-4d46-4243-8630-0c79abf73219 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.118784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2273f6-4d46-4243-8630-0c79abf73219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.120911 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41b7ba-1ccf-4a19-a7f8-bc4f7c368c2b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:35.129702 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41b7ba-1ccf-4a19-a7f8-bc4f7c368c2b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:35.133729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7704c7-3a4a-466d-825c-ce677d87c7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:35.134305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7704c7-3a4a-466d-825c-ce677d87c7be admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.134590 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7704c7-3a4a-466d-825c-ce677d87c7be admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.134869 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7704c7-3a4a-466d-825c-ce677d87c7be admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.135553 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7704c7-3a4a-466d-825c-ce677d87c7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:35.140289 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-5c2273f6-4d46-4243-8630-0c79abf73219 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:35.141466 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5c2273f6-4d46-4243-8630-0c79abf73219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:35.148303 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 757/1515] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:35.149531 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf3dca-7f7d-4464-a88b-36a7a8f89dcb None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.149823 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf3dca-7f7d-4464-a88b-36a7a8f89dcb None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.150109 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf3dca-7f7d-4464-a88b-36a7a8f89dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.161313 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7704c7-3a4a-466d-825c-ce677d87c7be admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:35.172704 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 759/1516] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:35 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:35.172996 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-37cf3dca-7f7d-4464-a88b-36a7a8f89dcb None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:35.173889 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa11027-abc1-4bf7-b021-cc805a057f60 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.174178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa11027-abc1-4bf7-b021-cc805a057f60 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.174288 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-37cf3dca-7f7d-4464-a88b-36a7a8f89dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:35.174565 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa11027-abc1-4bf7-b021-cc805a057f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.181379 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 758/1517] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:35.182151 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf3dca-7f7d-4464-a88b-36a7a8f89dcb None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:35.191060 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf3dca-7f7d-4464-a88b-36a7a8f89dcb None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:35.195103 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebb9cd-7661-4ca0-b440-94b59bc3cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:35.195671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebb9cd-7661-4ca0-b440-94b59bc3cc18 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.195958 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebb9cd-7661-4ca0-b440-94b59bc3cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.196240 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebb9cd-7661-4ca0-b440-94b59bc3cc18 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.196949 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebb9cd-7661-4ca0-b440-94b59bc3cc18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:52:35.197251 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebb9cd-7661-4ca0-b440-94b59bc3cc18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:35.198111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-4aa11027-abc1-4bf7-b021-cc805a057f60 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:35.199225 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-4aa11027-abc1-4bf7-b021-cc805a057f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:35.206101 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 760/1518] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:35.207385 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372883b2-9954-4923-ad66-5acb664e9b71 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.207682 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372883b2-9954-4923-ad66-5acb664e9b71 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.207980 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372883b2-9954-4923-ad66-5acb664e9b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.222763 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebb9cd-7661-4ca0-b440-94b59bc3cc18 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:35.229794 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-372883b2-9954-4923-ad66-5acb664e9b71 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:35.230906 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-372883b2-9954-4923-ad66-5acb664e9b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:35.235564 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 759/1519] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:52:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:52:35.236341 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebb9cd-7661-4ca0-b440-94b59bc3cc18 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:35.243193 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 761/1520] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:35.244395 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1382c-76da-43fc-8eb0-e81b766dc16b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.244711 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1382c-76da-43fc-8eb0-e81b766dc16b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.244990 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1382c-76da-43fc-8eb0-e81b766dc16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.249588 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebb9cd-7661-4ca0-b440-94b59bc3cc18 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:35.253888 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c388f-2050-4cc5-85d8-bbeaf253a218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:35.254466 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c388f-2050-4cc5-85d8-bbeaf253a218 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.254763 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c388f-2050-4cc5-85d8-bbeaf253a218 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.255046 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c388f-2050-4cc5-85d8-bbeaf253a218 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.255729 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c388f-2050-4cc5-85d8-bbeaf253a218 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:52:35.256029 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c388f-2050-4cc5-85d8-bbeaf253a218 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:35.266618 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-44d1382c-76da-43fc-8eb0-e81b766dc16b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:35.267753 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-44d1382c-76da-43fc-8eb0-e81b766dc16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:35.274909 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 762/1521] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:35.275816 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1382c-76da-43fc-8eb0-e81b766dc16b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:35.282192 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c388f-2050-4cc5-85d8-bbeaf253a218 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:35.285086 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1382c-76da-43fc-8eb0-e81b766dc16b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:35.289132 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84909c3f-d13d-41ac-8f38-465687e27763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:35.289698 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84909c3f-d13d-41ac-8f38-465687e27763 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.289981 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84909c3f-d13d-41ac-8f38-465687e27763 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.290260 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84909c3f-d13d-41ac-8f38-465687e27763 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.290929 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84909c3f-d13d-41ac-8f38-465687e27763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:52:35.291226 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84909c3f-d13d-41ac-8f38-465687e27763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:35.302891 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 760/1522] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:52:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:52:35.302891 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c388f-2050-4cc5-85d8-bbeaf253a218 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:35.307921 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c388f-2050-4cc5-85d8-bbeaf253a218 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:35.312351 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d520db4-71cc-49e0-bf3b-0e5489172dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:35.313167 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d520db4-71cc-49e0-bf3b-0e5489172dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.313457 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d520db4-71cc-49e0-bf3b-0e5489172dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.313743 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d520db4-71cc-49e0-bf3b-0e5489172dc0 admin admin] PATH_INFO: `/v3/projects/9bb2cbb0b80946b59df7b67e0b0df333/users/7172c19e3f7c4f92bf53305e9f5325d6/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.317408 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84909c3f-d13d-41ac-8f38-465687e27763 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:35.330198 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 763/1523] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:52:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:52:35.331049 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84909c3f-d13d-41ac-8f38-465687e27763 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:35.332263 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d520db4-71cc-49e0-bf3b-0e5489172dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb2cbb0b80946b59df7b67e0b0df333, user_id=7172c19e3f7c4f92bf53305e9f5325d6, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:35.339780 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84909c3f-d13d-41ac-8f38-465687e27763 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:35.344426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83ea58-47ed-4ad2-84f5-8ffeaefd13eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:35.345020 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83ea58-47ed-4ad2-84f5-8ffeaefd13eb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.345305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83ea58-47ed-4ad2-84f5-8ffeaefd13eb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.345591 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83ea58-47ed-4ad2-84f5-8ffeaefd13eb admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.346259 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83ea58-47ed-4ad2-84f5-8ffeaefd13eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:52:35.346556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83ea58-47ed-4ad2-84f5-8ffeaefd13eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:35.359407 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d520db4-71cc-49e0-bf3b-0e5489172dc0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:35.371322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83ea58-47ed-4ad2-84f5-8ffeaefd13eb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:35.384984 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 764/1524] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:52:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:52:35.385739 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83ea58-47ed-4ad2-84f5-8ffeaefd13eb admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:35.394942 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83ea58-47ed-4ad2-84f5-8ffeaefd13eb admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:35.399126 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929afb8-a42c-4953-8b9c-025532b99767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:35.403182 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929afb8-a42c-4953-8b9c-025532b99767 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.403182 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929afb8-a42c-4953-8b9c-025532b99767 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.403182 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929afb8-a42c-4953-8b9c-025532b99767 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.403182 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929afb8-a42c-4953-8b9c-025532b99767 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:52:35.403182 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929afb8-a42c-4953-8b9c-025532b99767 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:35.427268 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929afb8-a42c-4953-8b9c-025532b99767 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:35.440822 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 765/1525] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:52:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:52:35.441598 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929afb8-a42c-4953-8b9c-025532b99767 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:35.450632 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929afb8-a42c-4953-8b9c-025532b99767 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:35.458695 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 761/1526] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:35 2021] PUT /identity/v3/projects/9bb2cbb0b80946b59df7b67e0b0df333/users/7172c19e3f7c4f92bf53305e9f5325d6/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:35.458695 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d520db4-71cc-49e0-bf3b-0e5489172dc0 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:35.514614 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4237363-a0a8-4d1f-8c52-1f7118ce7df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:35.515207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4237363-a0a8-4d1f-8c52-1f7118ce7df1 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.515499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4237363-a0a8-4d1f-8c52-1f7118ce7df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.515806 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4237363-a0a8-4d1f-8c52-1f7118ce7df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.516442 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4237363-a0a8-4d1f-8c52-1f7118ce7df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:35.521374 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d520db4-71cc-49e0-bf3b-0e5489172dc0 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:35.525614 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf2759-cb21-465a-aa1c-7f19dd7125e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:35.526201 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf2759-cb21-465a-aa1c-7f19dd7125e9 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.526488 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf2759-cb21-465a-aa1c-7f19dd7125e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.526767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf2759-cb21-465a-aa1c-7f19dd7125e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.527447 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf2759-cb21-465a-aa1c-7f19dd7125e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:52:35.527743 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf2759-cb21-465a-aa1c-7f19dd7125e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:35.542228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4237363-a0a8-4d1f-8c52-1f7118ce7df1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:35.553328 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf2759-cb21-465a-aa1c-7f19dd7125e9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:35.565431 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 762/1527] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:52:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:52:35.566220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf2759-cb21-465a-aa1c-7f19dd7125e9 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:35.575088 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf2759-cb21-465a-aa1c-7f19dd7125e9 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:35.579770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22d351-cff4-4668-9303-9b3eabe779e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:35.580333 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22d351-cff4-4668-9303-9b3eabe779e2 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.580650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22d351-cff4-4668-9303-9b3eabe779e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.580939 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22d351-cff4-4668-9303-9b3eabe779e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.581642 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22d351-cff4-4668-9303-9b3eabe779e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:52:35.581938 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22d351-cff4-4668-9303-9b3eabe779e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:35.607687 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22d351-cff4-4668-9303-9b3eabe779e2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:35.612186 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 766/1528] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:52:35 2021] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:35.613240 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4237363-a0a8-4d1f-8c52-1f7118ce7df1 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:35.621377 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 763/1529] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:52:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:52:35.622404 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22d351-cff4-4668-9303-9b3eabe779e2 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:35.631690 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22d351-cff4-4668-9303-9b3eabe779e2 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:35.685390 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4237363-a0a8-4d1f-8c52-1f7118ce7df1 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:35.690192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13882c4-70a0-4776-8b6d-14318a2a04e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:35.690788 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13882c4-70a0-4776-8b6d-14318a2a04e9 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.691080 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13882c4-70a0-4776-8b6d-14318a2a04e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.691362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13882c4-70a0-4776-8b6d-14318a2a04e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.691995 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13882c4-70a0-4776-8b6d-14318a2a04e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:35.695052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30b753-7c3a-45ee-b260-926bbf1d18c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:35.695646 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30b753-7c3a-45ee-b260-926bbf1d18c9 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.695934 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30b753-7c3a-45ee-b260-926bbf1d18c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.696327 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30b753-7c3a-45ee-b260-926bbf1d18c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.699211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30b753-7c3a-45ee-b260-926bbf1d18c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:35.718521 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13882c4-70a0-4776-8b6d-14318a2a04e9 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:35.725484 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30b753-7c3a-45ee-b260-926bbf1d18c9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:35.804444 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 767/1530] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:52:35 2021] POST /identity/v3/projects => generated 405 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:35.804444 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13882c4-70a0-4776-8b6d-14318a2a04e9 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:35.836991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 764/1531] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:52:35 2021] POST /identity/v3/projects => generated 371 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:35.836991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30b753-7c3a-45ee-b260-926bbf1d18c9 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:35.870588 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13882c4-70a0-4776-8b6d-14318a2a04e9 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:35.903958 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30b753-7c3a-45ee-b260-926bbf1d18c9 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:35.908323 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3970eb4-3c9f-48e8-be7c-9193229de364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:35.908937 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3970eb4-3c9f-48e8-be7c-9193229de364 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.909227 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3970eb4-3c9f-48e8-be7c-9193229de364 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.909509 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3970eb4-3c9f-48e8-be7c-9193229de364 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.910141 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3970eb4-3c9f-48e8-be7c-9193229de364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:35.933596 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdba27-0faf-48d8-aa8f-9b070406c9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:35.934188 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdba27-0faf-48d8-aa8f-9b070406c9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:35.934475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdba27-0faf-48d8-aa8f-9b070406c9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:35.934756 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdba27-0faf-48d8-aa8f-9b070406c9b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:35.935245 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3970eb4-3c9f-48e8-be7c-9193229de364 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:35.935375 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfdba27-0faf-48d8-aa8f-9b070406c9b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:35.963708 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfdba27-0faf-48d8-aa8f-9b070406c9b6 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:36.040979 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 765/1532] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:52:35 2021] POST /identity/v3/projects => generated 391 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:36.042222 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127ea7-6d8c-4784-89f7-fe7df99bd36e None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:36.042513 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127ea7-6d8c-4784-89f7-fe7df99bd36e None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:36.042796 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127ea7-6d8c-4784-89f7-fe7df99bd36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:36.064498 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 768/1533] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:52:35 2021] POST /identity/v3/projects => generated 377 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:36.064718 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-33127ea7-6d8c-4784-89f7-fe7df99bd36e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:36.065552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdba27-0faf-48d8-aa8f-9b070406c9b6 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:36.065903 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-33127ea7-6d8c-4784-89f7-fe7df99bd36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:36.129245 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 766/1534] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:36.130054 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33127ea7-6d8c-4784-89f7-fe7df99bd36e None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:36.138467 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33127ea7-6d8c-4784-89f7-fe7df99bd36e None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:36.143418 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdba27-0faf-48d8-aa8f-9b070406c9b6 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:36.143567 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4d00a-45bc-45dc-83de-f7ecbb8abe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:36.144096 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4d00a-45bc-45dc-83de-f7ecbb8abe40 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:36.144412 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4d00a-45bc-45dc-83de-f7ecbb8abe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:36.144718 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4d00a-45bc-45dc-83de-f7ecbb8abe40 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:36.145514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4d00a-45bc-45dc-83de-f7ecbb8abe40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:36.147829 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3713f29-6e78-4741-bc60-8bfd02361692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:36.148421 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3713f29-6e78-4741-bc60-8bfd02361692 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:36.148744 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3713f29-6e78-4741-bc60-8bfd02361692 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:36.149029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3713f29-6e78-4741-bc60-8bfd02361692 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:36.149655 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3713f29-6e78-4741-bc60-8bfd02361692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:36.171505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4d00a-45bc-45dc-83de-f7ecbb8abe40 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:36.175480 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3713f29-6e78-4741-bc60-8bfd02361692 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:36.273669 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 767/1535] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:52:36 2021] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:36.275236 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4d00a-45bc-45dc-83de-f7ecbb8abe40 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:36.280599 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 769/1536] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:52:36 2021] POST /identity/v3/projects => generated 365 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:36.281571 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3713f29-6e78-4741-bc60-8bfd02361692 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:36.286301 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4d00a-45bc-45dc-83de-f7ecbb8abe40 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:36.348507 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cf734-a129-4bee-b984-3a8ed2a93adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:36.349230 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cf734-a129-4bee-b984-3a8ed2a93adb admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:36.349344 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3713f29-6e78-4741-bc60-8bfd02361692 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:36.349467 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cf734-a129-4bee-b984-3a8ed2a93adb admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:36.349659 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cf734-a129-4bee-b984-3a8ed2a93adb admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:36.350345 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cf734-a129-4bee-b984-3a8ed2a93adb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:36.353470 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b9fcb-f21c-4a0d-accf-fa05d4d6a06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:36.354063 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b9fcb-f21c-4a0d-accf-fa05d4d6a06c admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:36.354352 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b9fcb-f21c-4a0d-accf-fa05d4d6a06c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:36.354633 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b9fcb-f21c-4a0d-accf-fa05d4d6a06c admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:36.355261 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b9fcb-f21c-4a0d-accf-fa05d4d6a06c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:36.376668 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cf734-a129-4bee-b984-3a8ed2a93adb admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:36.381425 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b9fcb-f21c-4a0d-accf-fa05d4d6a06c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:36.478434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 770/1537] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:52:36 2021] POST /identity/v3/users => generated 303 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:36.479312 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b9fcb-f21c-4a0d-accf-fa05d4d6a06c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:36.490331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 768/1538] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:52:36 2021] POST /identity/v3/projects => generated 379 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:36.490331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cf734-a129-4bee-b984-3a8ed2a93adb admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:36.490598 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b9fcb-f21c-4a0d-accf-fa05d4d6a06c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:36.550618 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19082281-d32c-4a1e-a497-9fb21a935bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:36.551228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19082281-d32c-4a1e-a497-9fb21a935bdb admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:36.551519 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19082281-d32c-4a1e-a497-9fb21a935bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:36.551812 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19082281-d32c-4a1e-a497-9fb21a935bdb admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:36.552436 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19082281-d32c-4a1e-a497-9fb21a935bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:36.556668 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cf734-a129-4bee-b984-3a8ed2a93adb admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:36.560732 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58aab87-780a-4c53-ba7b-445cd892355d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:36.562194 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aab87-780a-4c53-ba7b-445cd892355d admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:36.562479 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aab87-780a-4c53-ba7b-445cd892355d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:36.562755 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aab87-780a-4c53-ba7b-445cd892355d admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:36.563376 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58aab87-780a-4c53-ba7b-445cd892355d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:36.578417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19082281-d32c-4a1e-a497-9fb21a935bdb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:36.588587 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58aab87-780a-4c53-ba7b-445cd892355d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:36.690007 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 771/1539] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:52:36 2021] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:36.690802 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19082281-d32c-4a1e-a497-9fb21a935bdb admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:36.696818 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 769/1540] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:52:36 2021] POST /identity/v3/users => generated 296 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:36.697820 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58aab87-780a-4c53-ba7b-445cd892355d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:36.699856 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19082281-d32c-4a1e-a497-9fb21a935bdb admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:36.704002 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a0e6d-80a5-4537-81f8-c12342fd0ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:36.704610 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a0e6d-80a5-4537-81f8-c12342fd0ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:36.704902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a0e6d-80a5-4537-81f8-c12342fd0ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:36.705183 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a0e6d-80a5-4537-81f8-c12342fd0ef1 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:36.705817 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a0e6d-80a5-4537-81f8-c12342fd0ef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:36.731732 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a0e6d-80a5-4537-81f8-c12342fd0ef1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:36.758948 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58aab87-780a-4c53-ba7b-445cd892355d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:36.762281 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe44cd-ab4c-4668-a2ae-d577d0a18386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:36.762847 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe44cd-ab4c-4668-a2ae-d577d0a18386 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:36.763130 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe44cd-ab4c-4668-a2ae-d577d0a18386 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:36.763403 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe44cd-ab4c-4668-a2ae-d577d0a18386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:36.771931 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe44cd-ab4c-4668-a2ae-d577d0a18386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:36.797951 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe44cd-ab4c-4668-a2ae-d577d0a18386 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:36.806675 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 770/1541] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:36.807429 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe44cd-ab4c-4668-a2ae-d577d0a18386 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:36.817331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe44cd-ab4c-4668-a2ae-d577d0a18386 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:36.822015 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 772/1542] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:52:36 2021] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:36.822184 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931d8d4-2bdb-49b4-a57c-e6d1a77c6b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:36.822775 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931d8d4-2bdb-49b4-a57c-e6d1a77c6b2b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:36.822881 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a0e6d-80a5-4537-81f8-c12342fd0ef1 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:36.823062 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931d8d4-2bdb-49b4-a57c-e6d1a77c6b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:36.823342 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931d8d4-2bdb-49b4-a57c-e6d1a77c6b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:36.824025 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931d8d4-2bdb-49b4-a57c-e6d1a77c6b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:36.834338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a0e6d-80a5-4537-81f8-c12342fd0ef1 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:36.843270 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0cc13-3d06-4553-aa38-00a7e0ebc29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:36.843920 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0cc13-3d06-4553-aa38-00a7e0ebc29c admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:36.844607 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0cc13-3d06-4553-aa38-00a7e0ebc29c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:36.844607 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0cc13-3d06-4553-aa38-00a7e0ebc29c admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:36.845131 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0cc13-3d06-4553-aa38-00a7e0ebc29c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:36.850805 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931d8d4-2bdb-49b4-a57c-e6d1a77c6b2b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:36.862079 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 771/1543] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:36 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:36.862667 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931d8d4-2bdb-49b4-a57c-e6d1a77c6b2b admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:36.871470 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931d8d4-2bdb-49b4-a57c-e6d1a77c6b2b admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:36.874213 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0cc13-3d06-4553-aa38-00a7e0ebc29c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:36.875613 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ca24a-07ee-4ec4-a5ea-396cd358d4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:36.876182 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ca24a-07ee-4ec4-a5ea-396cd358d4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:36.876519 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ca24a-07ee-4ec4-a5ea-396cd358d4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:36.876827 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ca24a-07ee-4ec4-a5ea-396cd358d4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:36.877501 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ca24a-07ee-4ec4-a5ea-396cd358d4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:36.902612 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ca24a-07ee-4ec4-a5ea-396cd358d4c8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:36.913525 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 772/1544] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:36 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:36.914926 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ca24a-07ee-4ec4-a5ea-396cd358d4c8 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:36.924335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ca24a-07ee-4ec4-a5ea-396cd358d4c8 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:36.928360 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b71f4b-194a-4159-af6a-d53231cfc412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:36.928985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b71f4b-194a-4159-af6a-d53231cfc412 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:36.929274 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b71f4b-194a-4159-af6a-d53231cfc412 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:36.929566 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b71f4b-194a-4159-af6a-d53231cfc412 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:36.930201 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b71f4b-194a-4159-af6a-d53231cfc412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:36.956521 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b71f4b-194a-4159-af6a-d53231cfc412 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:36.968597 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 773/1545] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:52:36 2021] POST /identity/v3/users => generated 283 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:36.969299 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0cc13-3d06-4553-aa38-00a7e0ebc29c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:36.978794 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0cc13-3d06-4553-aa38-00a7e0ebc29c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:36.983000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437faaa-c734-45e0-9540-0ca9eae0daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:36.983650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437faaa-c734-45e0-9540-0ca9eae0daf0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:36.984231 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437faaa-c734-45e0-9540-0ca9eae0daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:36.984512 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437faaa-c734-45e0-9540-0ca9eae0daf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:36.985228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437faaa-c734-45e0-9540-0ca9eae0daf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:37.010219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437faaa-c734-45e0-9540-0ca9eae0daf0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:37.022016 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 774/1546] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:36 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:37.022790 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437faaa-c734-45e0-9540-0ca9eae0daf0 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:37.031649 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437faaa-c734-45e0-9540-0ca9eae0daf0 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:37.035652 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c96667-8dc4-417e-ab92-034ad2b2a891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:37.036202 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c96667-8dc4-417e-ab92-034ad2b2a891 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:37.036482 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c96667-8dc4-417e-ab92-034ad2b2a891 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:37.036791 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c96667-8dc4-417e-ab92-034ad2b2a891 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:37.037449 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c96667-8dc4-417e-ab92-034ad2b2a891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:37.057791 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 773/1547] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:52:36 2021] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:37.058916 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b71f4b-194a-4159-af6a-d53231cfc412 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:37.064293 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c96667-8dc4-417e-ab92-034ad2b2a891 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:37.068934 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b71f4b-194a-4159-af6a-d53231cfc412 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:37.073208 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330dde-1202-4b0e-b914-ec77329fa8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:37.078566 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330dde-1202-4b0e-b914-ec77329fa8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:37.078566 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330dde-1202-4b0e-b914-ec77329fa8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:37.078566 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330dde-1202-4b0e-b914-ec77329fa8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:37.078923 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 775/1548] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:37 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:37.079035 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a330dde-1202-4b0e-b914-ec77329fa8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:37.079119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c96667-8dc4-417e-ab92-034ad2b2a891 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:37.086010 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c96667-8dc4-417e-ab92-034ad2b2a891 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:37.090662 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be35536-0291-4747-8074-b3e0c3632f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:37.091488 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be35536-0291-4747-8074-b3e0c3632f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:37.091770 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be35536-0291-4747-8074-b3e0c3632f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:37.092046 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be35536-0291-4747-8074-b3e0c3632f94 admin admin] PATH_INFO: `/v3/projects/86d387b6ac71495f983eb2e7124d1a48/users/876110a9c0944c3fb752512845589d8a/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:37.100098 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a330dde-1202-4b0e-b914-ec77329fa8f8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:37.111305 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 774/1549] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:37 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:37.112109 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330dde-1202-4b0e-b914-ec77329fa8f8 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:37.116730 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be35536-0291-4747-8074-b3e0c3632f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d387b6ac71495f983eb2e7124d1a48, user_id=876110a9c0944c3fb752512845589d8a, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:37.121771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330dde-1202-4b0e-b914-ec77329fa8f8 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:37.126750 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37974367-49d0-474e-9223-c3434ac087e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:37.127554 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37974367-49d0-474e-9223-c3434ac087e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:37.127911 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37974367-49d0-474e-9223-c3434ac087e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:37.128179 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37974367-49d0-474e-9223-c3434ac087e4 admin admin] PATH_INFO: `/v3/projects/2b9ef8c31aa54d34b2c72fb8eaf210ff/users/f07aa5785b6a4b2dab6764f873323395/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:37.146007 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be35536-0291-4747-8074-b3e0c3632f94 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:37.150927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37974367-49d0-474e-9223-c3434ac087e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9ef8c31aa54d34b2c72fb8eaf210ff, user_id=f07aa5785b6a4b2dab6764f873323395, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:37.178471 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37974367-49d0-474e-9223-c3434ac087e4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:37.211191 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 776/1550] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:37 2021] PUT /identity/v3/projects/86d387b6ac71495f983eb2e7124d1a48/users/876110a9c0944c3fb752512845589d8a/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:37.212014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be35536-0291-4747-8074-b3e0c3632f94 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:37.261022 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 775/1551] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:37 2021] PUT /identity/v3/projects/2b9ef8c31aa54d34b2c72fb8eaf210ff/users/f07aa5785b6a4b2dab6764f873323395/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:37.261957 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37974367-49d0-474e-9223-c3434ac087e4 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:37.279382 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be35536-0291-4747-8074-b3e0c3632f94 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:37.333198 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37974367-49d0-474e-9223-c3434ac087e4 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:37.337497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2eef2-3701-43f4-8847-47e0aeed35ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:37.342784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2eef2-3701-43f4-8847-47e0aeed35ba admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:37.342784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2eef2-3701-43f4-8847-47e0aeed35ba admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:37.342784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2eef2-3701-43f4-8847-47e0aeed35ba admin admin] PATH_INFO: `/v3/projects/b9eb56d87c164c5e9d7c176775643262/users/c7d8a4700e3b45c9ac728315b4cd1ac5/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:37.347285 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cba857-9eb8-475e-9428-07780c17b39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:37.348592 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cba857-9eb8-475e-9428-07780c17b39b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:37.348592 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cba857-9eb8-475e-9428-07780c17b39b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:37.348831 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cba857-9eb8-475e-9428-07780c17b39b admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:37.349317 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cba857-9eb8-475e-9428-07780c17b39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:37.359482 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2eef2-3701-43f4-8847-47e0aeed35ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9eb56d87c164c5e9d7c176775643262, user_id=c7d8a4700e3b45c9ac728315b4cd1ac5, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:37.377379 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cba857-9eb8-475e-9428-07780c17b39b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:37.388779 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 777/1552] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:37 2021] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:37.394531 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cba857-9eb8-475e-9428-07780c17b39b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:37.404282 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cba857-9eb8-475e-9428-07780c17b39b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:37.408861 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b12d7c-f45e-45ec-9950-83cb74790319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:37.414076 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b12d7c-f45e-45ec-9950-83cb74790319 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:37.414076 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b12d7c-f45e-45ec-9950-83cb74790319 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:37.414076 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b12d7c-f45e-45ec-9950-83cb74790319 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:37.414076 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b12d7c-f45e-45ec-9950-83cb74790319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:37.418924 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2eef2-3701-43f4-8847-47e0aeed35ba admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:37.436938 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b12d7c-f45e-45ec-9950-83cb74790319 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:37.447740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 778/1553] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:37 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:37.452050 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b12d7c-f45e-45ec-9950-83cb74790319 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:37.461741 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b12d7c-f45e-45ec-9950-83cb74790319 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:37.467886 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab169567-93b4-4867-951b-d878efddea76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:37.468934 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab169567-93b4-4867-951b-d878efddea76 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:37.469390 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab169567-93b4-4867-951b-d878efddea76 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:37.469843 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab169567-93b4-4867-951b-d878efddea76 admin admin] PATH_INFO: `/v3/projects/36b9bb2944ff41d892d03e1ae5a30cd7/users/0d118f35f5c549908cd605a753e4f93b/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:37.492283 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab169567-93b4-4867-951b-d878efddea76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b9bb2944ff41d892d03e1ae5a30cd7, user_id=0d118f35f5c549908cd605a753e4f93b, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:37.515749 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 776/1554] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:37 2021] PUT /identity/v3/projects/b9eb56d87c164c5e9d7c176775643262/users/c7d8a4700e3b45c9ac728315b4cd1ac5/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:37.515749 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2eef2-3701-43f4-8847-47e0aeed35ba admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:37.526004 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab169567-93b4-4867-951b-d878efddea76 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:37.579193 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2eef2-3701-43f4-8847-47e0aeed35ba admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:37.583434 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739233b4-f1c3-4bc8-9306-750d34d5a329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:37.584180 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739233b4-f1c3-4bc8-9306-750d34d5a329 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:37.584465 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739233b4-f1c3-4bc8-9306-750d34d5a329 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:37.584770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739233b4-f1c3-4bc8-9306-750d34d5a329 admin admin] PATH_INFO: `/v3/projects/3e8a365a2ff64421bef434d3568b128e/users/3b6dbf69f7d344b7973747af9cb118ec/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:37.603754 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 779/1555] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:37 2021] PUT /identity/v3/projects/36b9bb2944ff41d892d03e1ae5a30cd7/users/0d118f35f5c549908cd605a753e4f93b/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:37.603754 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512e897-0b44-4db5-af55-330ebb40ec75 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:37.603754 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512e897-0b44-4db5-af55-330ebb40ec75 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:37.603754 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512e897-0b44-4db5-af55-330ebb40ec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:37.607531 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739233b4-f1c3-4bc8-9306-750d34d5a329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8a365a2ff64421bef434d3568b128e, user_id=3b6dbf69f7d344b7973747af9cb118ec, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:37.635398 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739233b4-f1c3-4bc8-9306-750d34d5a329 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:37.641503 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-f512e897-0b44-4db5-af55-330ebb40ec75 None None] MFA Rules not processed for user `876110a9c0944c3fb752512845589d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:37.642741 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f512e897-0b44-4db5-af55-330ebb40ec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:37.715026 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 780/1556] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:37 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:37.716418 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2f866-1691-45e8-85cb-6dedbb2a35d9 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:37.716758 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2f866-1691-45e8-85cb-6dedbb2a35d9 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:37.717044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2f866-1691-45e8-85cb-6dedbb2a35d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:37.739112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-e9b2f866-1691-45e8-85cb-6dedbb2a35d9 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:37.740305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e9b2f866-1691-45e8-85cb-6dedbb2a35d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:37.747102 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 777/1557] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:37 2021] PUT /identity/v3/projects/3e8a365a2ff64421bef434d3568b128e/users/3b6dbf69f7d344b7973747af9cb118ec/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:37.747926 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739233b4-f1c3-4bc8-9306-750d34d5a329 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:37.806725 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 781/1558] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:37.807526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2f866-1691-45e8-85cb-6dedbb2a35d9 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:37.817598 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2f866-1691-45e8-85cb-6dedbb2a35d9 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:37.822580 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af67cec-efe5-4cf2-b1c1-6960b24f2283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:37.823394 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af67cec-efe5-4cf2-b1c1-6960b24f2283 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:37.823684 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af67cec-efe5-4cf2-b1c1-6960b24f2283 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:37.823968 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af67cec-efe5-4cf2-b1c1-6960b24f2283 admin admin] PATH_INFO: `/v3/projects/416847e4711d4c9f9a4baf68f89d10d3/users/5e04d9763a554cc7bea1a8d30e690bd5/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:37.824758 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739233b4-f1c3-4bc8-9306-750d34d5a329 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:37.829270 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2612b-1cb4-498f-afe7-c12b90e316ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:37.830161 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2612b-1cb4-498f-afe7-c12b90e316ea admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:37.830515 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2612b-1cb4-498f-afe7-c12b90e316ea admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:37.830910 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2612b-1cb4-498f-afe7-c12b90e316ea admin admin] PATH_INFO: `/v3/projects/18af26ca094d4ff680483334b92f8325/users/7d0f254397414b6fb994b5ee22416a59/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:37.847724 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af67cec-efe5-4cf2-b1c1-6960b24f2283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=416847e4711d4c9f9a4baf68f89d10d3, user_id=5e04d9763a554cc7bea1a8d30e690bd5, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:37.850662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2612b-1cb4-498f-afe7-c12b90e316ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=18af26ca094d4ff680483334b92f8325, user_id=7d0f254397414b6fb994b5ee22416a59, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:37.876954 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af67cec-efe5-4cf2-b1c1-6960b24f2283 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:37.877662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2612b-1cb4-498f-afe7-c12b90e316ea admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:37.971168 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 778/1559] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:37 2021] PUT /identity/v3/projects/18af26ca094d4ff680483334b92f8325/users/7d0f254397414b6fb994b5ee22416a59/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:37.972430 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda24e63-04fb-404c-9caf-4a31111eb514 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:37.972754 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda24e63-04fb-404c-9caf-4a31111eb514 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:37.973041 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda24e63-04fb-404c-9caf-4a31111eb514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:37.992981 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 782/1560] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:37 2021] PUT /identity/v3/projects/416847e4711d4c9f9a4baf68f89d10d3/users/5e04d9763a554cc7bea1a8d30e690bd5/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:37.999229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b4643-2cb8-49da-b3ea-99a92026dcfc None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:37.999229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b4643-2cb8-49da-b3ea-99a92026dcfc None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:37.999229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b4643-2cb8-49da-b3ea-99a92026dcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:38.012226 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-bda24e63-04fb-404c-9caf-4a31111eb514 None None] MFA Rules not processed for user `c7d8a4700e3b45c9ac728315b4cd1ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:38.013593 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-bda24e63-04fb-404c-9caf-4a31111eb514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:38.020439 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-1f3b4643-2cb8-49da-b3ea-99a92026dcfc None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:38.021658 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1f3b4643-2cb8-49da-b3ea-99a92026dcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:38.097562 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 783/1561] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:38.097991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 779/1562] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:37 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:38.098113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb39f9-d305-423f-9b01-ca7450173663 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:38.098113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb39f9-d305-423f-9b01-ca7450173663 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:38.098747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaee392-7b7a-404b-a2f1-a5c8a1c19d1c None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:38.098858 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb39f9-d305-423f-9b01-ca7450173663 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:38.098949 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaee392-7b7a-404b-a2f1-a5c8a1c19d1c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:38.098949 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaee392-7b7a-404b-a2f1-a5c8a1c19d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:38.099153 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 784/1563] 10.222.0.20 () {54 vars in 959 bytes} [Mon Aug 23 01:52:38 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:52:38.099153 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb39f9-d305-423f-9b01-ca7450173663 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:38.119979 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-eeaee392-7b7a-404b-a2f1-a5c8a1c19d1c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:38.121224 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-eeaee392-7b7a-404b-a2f1-a5c8a1c19d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:38.128503 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 780/1564] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:38.129687 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47014e6-52fa-4f04-9b31-539e3a9d0d6f None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:38.129978 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47014e6-52fa-4f04-9b31-539e3a9d0d6f None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:38.130259 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47014e6-52fa-4f04-9b31-539e3a9d0d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:38.165280 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-f47014e6-52fa-4f04-9b31-539e3a9d0d6f None None] MFA Rules not processed for user `7d0f254397414b6fb994b5ee22416a59`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:38.166405 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-f47014e6-52fa-4f04-9b31-539e3a9d0d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:38.167159 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb39f9-d305-423f-9b01-ca7450173663 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:38.170455 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6913a49-080e-4100-822d-51de6b7aeb00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:38.171032 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6913a49-080e-4100-822d-51de6b7aeb00 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:38.171362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6913a49-080e-4100-822d-51de6b7aeb00 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:38.171645 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6913a49-080e-4100-822d-51de6b7aeb00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:38.180404 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6913a49-080e-4100-822d-51de6b7aeb00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:38.209521 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6913a49-080e-4100-822d-51de6b7aeb00 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:38.219807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 785/1565] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:38.230705 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8694df-68c8-4881-a561-3b8b32e9957d None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:38.231115 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8694df-68c8-4881-a561-3b8b32e9957d None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:38.231497 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8694df-68c8-4881-a561-3b8b32e9957d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:38.247888 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 781/1566] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:38 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:38.253713 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47014e6-52fa-4f04-9b31-539e3a9d0d6f None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:38.260216 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-5d8694df-68c8-4881-a561-3b8b32e9957d None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:38.261527 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-5d8694df-68c8-4881-a561-3b8b32e9957d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:38.266799 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47014e6-52fa-4f04-9b31-539e3a9d0d6f None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:38.270571 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 786/1567] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:38.271948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d3057-f232-4313-a865-a42c4af19610 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:38.272248 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d3057-f232-4313-a865-a42c4af19610 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:38.272531 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d3057-f232-4313-a865-a42c4af19610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:38.274952 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa33a55-48db-41b7-8745-fbb9cd05c5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:38.275568 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa33a55-48db-41b7-8745-fbb9cd05c5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:38.275873 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa33a55-48db-41b7-8745-fbb9cd05c5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:38.276444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa33a55-48db-41b7-8745-fbb9cd05c5b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:38.277213 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa33a55-48db-41b7-8745-fbb9cd05c5b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:38.304068 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa33a55-48db-41b7-8745-fbb9cd05c5b9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:38.305089 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-ff6d3057-f232-4313-a865-a42c4af19610 None None] MFA Rules not processed for user `094c5e571da7480584098ba6ebcb70ed`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:38.306391 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ff6d3057-f232-4313-a865-a42c4af19610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:38.395534 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 787/1568] 10.222.0.20 () {58 vars in 1057 bytes} [Mon Aug 23 01:52:38 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:38.399794 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d3057-f232-4313-a865-a42c4af19610 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:38.399926 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 782/1569] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:52:38 2021] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:38.403529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530a083-69ab-4f63-a743-eca556e7de6a None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:38.404234 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530a083-69ab-4f63-a743-eca556e7de6a None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:38.405146 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530a083-69ab-4f63-a743-eca556e7de6a None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:38.407422 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d3057-f232-4313-a865-a42c4af19610 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:38.408582 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 783/1570] 10.222.0.20 () {54 vars in 962 bytes} [Mon Aug 23 01:52:38 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:52:38.409401 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530a083-69ab-4f63-a743-eca556e7de6a None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:38.479580 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd027318-3c86-407c-8107-25c6eba07659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:38.480314 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd027318-3c86-407c-8107-25c6eba07659 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:38.480633 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd027318-3c86-407c-8107-25c6eba07659 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:38.480923 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd027318-3c86-407c-8107-25c6eba07659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:38.486341 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530a083-69ab-4f63-a743-eca556e7de6a None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:38.491650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384f121-b6ac-4155-86d4-65f592b1d200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:38.492266 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384f121-b6ac-4155-86d4-65f592b1d200 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:38.492959 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384f121-b6ac-4155-86d4-65f592b1d200 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:38.493659 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384f121-b6ac-4155-86d4-65f592b1d200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:38.559185 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd027318-3c86-407c-8107-25c6eba07659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:38.568374 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384f121-b6ac-4155-86d4-65f592b1d200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:38.602273 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384f121-b6ac-4155-86d4-65f592b1d200 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:38.616094 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 784/1571] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:38 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:38.617283 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384f121-b6ac-4155-86d4-65f592b1d200 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:38.618635 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd027318-3c86-407c-8107-25c6eba07659 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:38.630435 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 788/1572] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:38.631277 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd027318-3c86-407c-8107-25c6eba07659 service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:38.638479 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384f121-b6ac-4155-86d4-65f592b1d200 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:38.642831 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd027318-3c86-407c-8107-25c6eba07659 service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:38.649139 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e43d18-5332-4ea6-a8bd-c863221e3940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:38.649333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe0b54-8444-4608-90c3-6de6b773db5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:38.649333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe0b54-8444-4608-90c3-6de6b773db5e admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:38.649333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe0b54-8444-4608-90c3-6de6b773db5e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:38.649333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe0b54-8444-4608-90c3-6de6b773db5e admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:38.649750 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe0b54-8444-4608-90c3-6de6b773db5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:38.650755 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e43d18-5332-4ea6-a8bd-c863221e3940 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:38.651168 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e43d18-5332-4ea6-a8bd-c863221e3940 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:38.651561 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e43d18-5332-4ea6-a8bd-c863221e3940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:38.665573 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e43d18-5332-4ea6-a8bd-c863221e3940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:38.688603 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe0b54-8444-4608-90c3-6de6b773db5e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:38.693452 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e43d18-5332-4ea6-a8bd-c863221e3940 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:38.705756 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 785/1573] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:38.706872 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e43d18-5332-4ea6-a8bd-c863221e3940 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:38.801823 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 789/1574] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:52:38 2021] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:38.804584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6e3af-fb17-417c-8456-97728d2c1ced None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:38.804584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6e3af-fb17-417c-8456-97728d2c1ced None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:38.804584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6e3af-fb17-417c-8456-97728d2c1ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:38.807470 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e43d18-5332-4ea6-a8bd-c863221e3940 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:38.821767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb141a-b15d-48c3-b321-6d2573924d8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:38.822180 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb141a-b15d-48c3-b321-6d2573924d8e service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:38.822480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb141a-b15d-48c3-b321-6d2573924d8e service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:38.822767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb141a-b15d-48c3-b321-6d2573924d8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:38.900880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-64f6e3af-fb17-417c-8456-97728d2c1ced None None] MFA Rules not processed for user `eedaf4b880f24ac48ee6e04b75059ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:38.902145 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-64f6e3af-fb17-417c-8456-97728d2c1ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:38.909659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 790/1575] 10.222.0.20 () {58 vars in 1060 bytes} [Mon Aug 23 01:52:38 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:38.911100 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6e3af-fb17-417c-8456-97728d2c1ced None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:38.925127 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6e3af-fb17-417c-8456-97728d2c1ced None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:38.930902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb868ba1-425e-4118-8cd9-9323c7869b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:38.931608 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb868ba1-425e-4118-8cd9-9323c7869b89 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:38.931971 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb868ba1-425e-4118-8cd9-9323c7869b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:38.932512 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb868ba1-425e-4118-8cd9-9323c7869b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:38.933402 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb868ba1-425e-4118-8cd9-9323c7869b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:38.961372 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb141a-b15d-48c3-b321-6d2573924d8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:38.963140 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb868ba1-425e-4118-8cd9-9323c7869b89 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:38.975966 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 791/1576] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:38 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:38.980368 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb868ba1-425e-4118-8cd9-9323c7869b89 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:38.999462 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb868ba1-425e-4118-8cd9-9323c7869b89 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:39.008070 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4ca51-3153-43c1-b2a9-5976fee863e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:39.010477 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4ca51-3153-43c1-b2a9-5976fee863e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:39.011984 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4ca51-3153-43c1-b2a9-5976fee863e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:39.012625 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4ca51-3153-43c1-b2a9-5976fee863e7 admin admin] PATH_INFO: `/v3/projects/c4b23f998b5c4d7894591776da8a8ea6/users/22d5826815e94f9fa2a2c7a62f12d3e1/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:39.022212 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb141a-b15d-48c3-b321-6d2573924d8e service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:39.044464 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 786/1577] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:38 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:39.057158 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb141a-b15d-48c3-b321-6d2573924d8e service nova] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:39.066942 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4ca51-3153-43c1-b2a9-5976fee863e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b23f998b5c4d7894591776da8a8ea6, user_id=22d5826815e94f9fa2a2c7a62f12d3e1, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:39.080452 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb141a-b15d-48c3-b321-6d2573924d8e service nova] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:39.084473 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbe3e4-478b-45f7-9fbc-d67845e58f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:39.085370 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbe3e4-478b-45f7-9fbc-d67845e58f57 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:39.085756 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbe3e4-478b-45f7-9fbc-d67845e58f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:39.086192 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbe3e4-478b-45f7-9fbc-d67845e58f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:39.104639 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbe3e4-478b-45f7-9fbc-d67845e58f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:39.160939 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbe3e4-478b-45f7-9fbc-d67845e58f57 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:39.184194 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 787/1578] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:39.192151 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4ca51-3153-43c1-b2a9-5976fee863e7 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:39.307032 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 792/1579] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:38 2021] PUT /identity/v3/projects/c4b23f998b5c4d7894591776da8a8ea6/users/22d5826815e94f9fa2a2c7a62f12d3e1/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:39.308299 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbe3e4-478b-45f7-9fbc-d67845e58f57 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:39.318646 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbe3e4-478b-45f7-9fbc-d67845e58f57 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:39.456817 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21514c3f-b167-487d-ad1d-8f24ee60889b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:39.457436 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21514c3f-b167-487d-ad1d-8f24ee60889b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:39.457990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21514c3f-b167-487d-ad1d-8f24ee60889b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:39.458501 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21514c3f-b167-487d-ad1d-8f24ee60889b admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:39.459456 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21514c3f-b167-487d-ad1d-8f24ee60889b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:39.507507 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21514c3f-b167-487d-ad1d-8f24ee60889b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:39.524113 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 788/1580] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:39 2021] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:39.524431 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4ca51-3153-43c1-b2a9-5976fee863e7 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:39.536279 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4ca51-3153-43c1-b2a9-5976fee863e7 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:39.546484 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f3665-e9a3-4e6d-a257-3b41dd874c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:39.546484 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f3665-e9a3-4e6d-a257-3b41dd874c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:39.546484 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f3665-e9a3-4e6d-a257-3b41dd874c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:39.546484 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f3665-e9a3-4e6d-a257-3b41dd874c38 admin admin] PATH_INFO: `/v3/projects/c4b23f998b5c4d7894591776da8a8ea6/users/22d5826815e94f9fa2a2c7a62f12d3e1/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:39.564725 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f3665-e9a3-4e6d-a257-3b41dd874c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b23f998b5c4d7894591776da8a8ea6, user_id=22d5826815e94f9fa2a2c7a62f12d3e1, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:39.639049 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f3665-e9a3-4e6d-a257-3b41dd874c38 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:39.652100 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 793/1581] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:39 2021] PUT /identity/v3/projects/c4b23f998b5c4d7894591776da8a8ea6/users/22d5826815e94f9fa2a2c7a62f12d3e1/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:52:39.656587 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21514c3f-b167-487d-ad1d-8f24ee60889b admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:39.669018 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21514c3f-b167-487d-ad1d-8f24ee60889b admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:39.792621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bcd99-d528-49ac-8f92-f7f1168946d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:39.793477 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bcd99-d528-49ac-8f92-f7f1168946d3 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:39.793946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bcd99-d528-49ac-8f92-f7f1168946d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:39.794433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bcd99-d528-49ac-8f92-f7f1168946d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:39.795884 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34bcd99-d528-49ac-8f92-f7f1168946d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:39.836094 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34bcd99-d528-49ac-8f92-f7f1168946d3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:39.856596 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 789/1582] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:39 2021] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:39.860916 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f3665-e9a3-4e6d-a257-3b41dd874c38 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:39.876861 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f3665-e9a3-4e6d-a257-3b41dd874c38 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:39.891928 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c90777-94f4-4f50-9295-f7397a706783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:39.891928 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c90777-94f4-4f50-9295-f7397a706783 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:39.891928 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c90777-94f4-4f50-9295-f7397a706783 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:39.891928 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c90777-94f4-4f50-9295-f7397a706783 admin admin] PATH_INFO: `/v3/projects/c4b23f998b5c4d7894591776da8a8ea6/users/22d5826815e94f9fa2a2c7a62f12d3e1/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:39.894318 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c90777-94f4-4f50-9295-f7397a706783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b23f998b5c4d7894591776da8a8ea6, user_id=22d5826815e94f9fa2a2c7a62f12d3e1, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:39.965999 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c90777-94f4-4f50-9295-f7397a706783 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:40.092031 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 794/1583] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:39 2021] PUT /identity/v3/projects/c4b23f998b5c4d7894591776da8a8ea6/users/22d5826815e94f9fa2a2c7a62f12d3e1/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:52:40.093129 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371cd78-3ec0-4ac1-9bf7-ac0beeec87dd None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:40.093129 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371cd78-3ec0-4ac1-9bf7-ac0beeec87dd None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:40.093129 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371cd78-3ec0-4ac1-9bf7-ac0beeec87dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:40.132198 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-6371cd78-3ec0-4ac1-9bf7-ac0beeec87dd None None] MFA Rules not processed for user `22d5826815e94f9fa2a2c7a62f12d3e1`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:40.133393 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-6371cd78-3ec0-4ac1-9bf7-ac0beeec87dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:40.262412 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 790/1584] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:40 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:52:40.273143 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c90777-94f4-4f50-9295-f7397a706783 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:40.290180 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3048261-0e88-4e92-931a-b2f313492108 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:40.290645 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3048261-0e88-4e92-931a-b2f313492108 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:40.291050 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3048261-0e88-4e92-931a-b2f313492108 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:40.293224 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 791/1585] 10.222.0.20 () {54 vars in 959 bytes} [Mon Aug 23 01:52:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:52:40.299715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154a402-8c73-4834-bc5c-0debb14e6e0c None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:40.306220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154a402-8c73-4834-bc5c-0debb14e6e0c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:40.306220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154a402-8c73-4834-bc5c-0debb14e6e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:40.334517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-7154a402-8c73-4834-bc5c-0debb14e6e0c None None] MFA Rules not processed for user `094c5e571da7480584098ba6ebcb70ed`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:40.336073 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-7154a402-8c73-4834-bc5c-0debb14e6e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:40.446002 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 792/1586] 10.222.0.20 () {58 vars in 1057 bytes} [Mon Aug 23 01:52:40 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:52:40.448221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154a402-8c73-4834-bc5c-0debb14e6e0c None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:40.530075 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c90777-94f4-4f50-9295-f7397a706783 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:40.535664 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5aaa7-8b8d-446a-87c8-0a18a6c94337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:40.536170 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5aaa7-8b8d-446a-87c8-0a18a6c94337 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:40.536456 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5aaa7-8b8d-446a-87c8-0a18a6c94337 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:40.536787 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5aaa7-8b8d-446a-87c8-0a18a6c94337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:40.568047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5aaa7-8b8d-446a-87c8-0a18a6c94337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:40.630903 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5aaa7-8b8d-446a-87c8-0a18a6c94337 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:40.645695 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154a402-8c73-4834-bc5c-0debb14e6e0c None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:40.657402 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fd157-848d-43a8-aadf-23c4997a5978 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:40.657639 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 795/1587] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:40 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:40.670770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fd157-848d-43a8-aadf-23c4997a5978 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:40.674949 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fd157-848d-43a8-aadf-23c4997a5978 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:40.675375 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fd157-848d-43a8-aadf-23c4997a5978 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:40.699005 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fd157-848d-43a8-aadf-23c4997a5978 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:40.728480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154fd157-848d-43a8-aadf-23c4997a5978 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:40.739926 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 793/1588] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:40 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:52:40.765510 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca8f60-694b-42dc-87f3-db475088920b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:40.768925 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca8f60-694b-42dc-87f3-db475088920b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:40.768925 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca8f60-694b-42dc-87f3-db475088920b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:40.846861 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-c4ca8f60-694b-42dc-87f3-db475088920b None None] MFA Rules not processed for user `f07aa5785b6a4b2dab6764f873323395`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:40.850529 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c4ca8f60-694b-42dc-87f3-db475088920b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:40.944203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fd157-848d-43a8-aadf-23c4997a5978 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:40.953504 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fd157-848d-43a8-aadf-23c4997a5978 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:40.958463 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085251a-b560-4d7f-b6f7-a3e0a199f9b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:40.958654 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085251a-b560-4d7f-b6f7-a3e0a199f9b2 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:40.959103 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085251a-b560-4d7f-b6f7-a3e0a199f9b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:40.959807 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085251a-b560-4d7f-b6f7-a3e0a199f9b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:40.971573 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085251a-b560-4d7f-b6f7-a3e0a199f9b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:40.973921 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 796/1589] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:40 2021] POST /identity/v3/auth/tokens => generated 3712 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:40.994280 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca8f60-694b-42dc-87f3-db475088920b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:41.001284 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085251a-b560-4d7f-b6f7-a3e0a199f9b2 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:41.015230 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 794/1590] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:40 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:52:41.098496 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca8f60-694b-42dc-87f3-db475088920b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:41.116861 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffdfc1-1b2e-4c8e-91a8-94791aa90102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:41.117484 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffdfc1-1b2e-4c8e-91a8-94791aa90102 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:41.117832 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffdfc1-1b2e-4c8e-91a8-94791aa90102 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:41.119586 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffdfc1-1b2e-4c8e-91a8-94791aa90102 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:41.119586 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffdfc1-1b2e-4c8e-91a8-94791aa90102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:41.182472 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffdfc1-1b2e-4c8e-91a8-94791aa90102 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:41.299886 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085251a-b560-4d7f-b6f7-a3e0a199f9b2 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:41.322540 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085251a-b560-4d7f-b6f7-a3e0a199f9b2 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:41.334044 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908893f-4d3e-4625-a0f6-890283fff3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:41.334864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908893f-4d3e-4625-a0f6-890283fff3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:41.337519 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908893f-4d3e-4625-a0f6-890283fff3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:41.337519 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908893f-4d3e-4625-a0f6-890283fff3f2 admin admin] PATH_INFO: `/v3/users/876110a9c0944c3fb752512845589d8a` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:41.345527 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908893f-4d3e-4625-a0f6-890283fff3f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=876110a9c0944c3fb752512845589d8a)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:41.395223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: WARNING py.warnings [None req-e908893f-4d3e-4625-a0f6-890283fff3f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:52:41.395223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: warnings.warn(msg) Aug 23 01:52:41.395223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: Aug 23 01:52:41.397476 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908893f-4d3e-4625-a0f6-890283fff3f2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:41.444157 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 797/1591] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:52:40 2021] POST /identity/v3/projects => generated 403 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:41.448229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffdfc1-1b2e-4c8e-91a8-94791aa90102 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:41.575188 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffdfc1-1b2e-4c8e-91a8-94791aa90102 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:41.582448 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd3394-25e8-4f4f-a40b-d3ed68891ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:41.583233 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd3394-25e8-4f4f-a40b-d3ed68891ffd admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:41.583527 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd3394-25e8-4f4f-a40b-d3ed68891ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:41.583811 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd3394-25e8-4f4f-a40b-d3ed68891ffd admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:41.584638 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd3394-25e8-4f4f-a40b-d3ed68891ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:41.632093 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd3394-25e8-4f4f-a40b-d3ed68891ffd admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:41.674267 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-e908893f-4d3e-4625-a0f6-890283fff3f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876110a9c0944c3fb752512845589d8a'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:41.740655 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 798/1592] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:52:41 2021] POST /identity/v3/users => generated 308 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:41.744090 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd3394-25e8-4f4f-a40b-d3ed68891ffd admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:41.749112 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-e908893f-4d3e-4625-a0f6-890283fff3f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876110a9c0944c3fb752512845589d8a'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:41.749623 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-e908893f-4d3e-4625-a0f6-890283fff3f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876110a9c0944c3fb752512845589d8a'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:41.766383 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-e908893f-4d3e-4625-a0f6-890283fff3f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876110a9c0944c3fb752512845589d8a'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:41.772051 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-e908893f-4d3e-4625-a0f6-890283fff3f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876110a9c0944c3fb752512845589d8a'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:41.773973 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd3394-25e8-4f4f-a40b-d3ed68891ffd admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:41.780339 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca4cde-acd7-488d-abcf-94a68c743eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:41.781041 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca4cde-acd7-488d-abcf-94a68c743eeb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:41.781506 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca4cde-acd7-488d-abcf-94a68c743eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:41.781638 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca4cde-acd7-488d-abcf-94a68c743eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:41.783150 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca4cde-acd7-488d-abcf-94a68c743eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:41.802982 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 795/1593] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:52:41 2021] DELETE /identity/v3/users/876110a9c0944c3fb752512845589d8a => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:41.807245 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54d48f-e83d-4985-859c-f6b5d7453b3e None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:41.807640 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54d48f-e83d-4985-859c-f6b5d7453b3e None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:41.807814 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54d48f-e83d-4985-859c-f6b5d7453b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:41.816817 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca4cde-acd7-488d-abcf-94a68c743eeb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:41.836652 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 799/1594] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:41 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:52:41.836652 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca4cde-acd7-488d-abcf-94a68c743eeb admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:41.853653 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-4fca4cde-acd7-488d-abcf-94a68c743eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:41.861664 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-1a54d48f-e83d-4985-859c-f6b5d7453b3e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:41.862822 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1a54d48f-e83d-4985-859c-f6b5d7453b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:41.877914 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca4cde-acd7-488d-abcf-94a68c743eeb admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:41.962775 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 796/1595] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:52:41.965553 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54d48f-e83d-4985-859c-f6b5d7453b3e None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:41.967771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1a54d48f-e83d-4985-859c-f6b5d7453b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:41.983908 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54d48f-e83d-4985-859c-f6b5d7453b3e None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:41.990971 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30343b9-7e87-4e73-9830-6316fe589f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:41.992259 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30343b9-7e87-4e73-9830-6316fe589f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:41.992825 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30343b9-7e87-4e73-9830-6316fe589f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:41.993318 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30343b9-7e87-4e73-9830-6316fe589f4e admin admin] PATH_INFO: `/v3/projects/573631a3cf9c47eaab2b74f2038eb5e8/users/628f034060964576bdf90de8730432ef/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:41.995749 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6a7e7-bf77-49fc-92d5-40352bdccbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:41.996835 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6a7e7-bf77-49fc-92d5-40352bdccbc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:41.997202 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6a7e7-bf77-49fc-92d5-40352bdccbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:41.997638 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6a7e7-bf77-49fc-92d5-40352bdccbc4 admin admin] PATH_INFO: `/v3/users/c7d8a4700e3b45c9ac728315b4cd1ac5` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:41.999054 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6a7e7-bf77-49fc-92d5-40352bdccbc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d8a4700e3b45c9ac728315b4cd1ac5)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:42.019093 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30343b9-7e87-4e73-9830-6316fe589f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=573631a3cf9c47eaab2b74f2038eb5e8, user_id=628f034060964576bdf90de8730432ef, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:42.033647 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6a7e7-bf77-49fc-92d5-40352bdccbc4 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:42.056628 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30343b9-7e87-4e73-9830-6316fe589f4e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:42.149857 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 797/1596] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:41 2021] PUT /identity/v3/projects/573631a3cf9c47eaab2b74f2038eb5e8/users/628f034060964576bdf90de8730432ef/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:42.155184 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30343b9-7e87-4e73-9830-6316fe589f4e admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:42.155711 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-e30343b9-7e87-4e73-9830-6316fe589f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:42.240250 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30343b9-7e87-4e73-9830-6316fe589f4e admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:42.252969 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e826e-d1bc-4b38-abbc-c9b6c64050f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:42.253550 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e826e-d1bc-4b38-abbc-c9b6c64050f0 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:42.254770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e826e-d1bc-4b38-abbc-c9b6c64050f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:42.254770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e826e-d1bc-4b38-abbc-c9b6c64050f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:42.255413 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8ea6a7e7-bf77-49fc-92d5-40352bdccbc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d8a4700e3b45c9ac728315b4cd1ac5'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:42.256221 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8ea6a7e7-bf77-49fc-92d5-40352bdccbc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d8a4700e3b45c9ac728315b4cd1ac5'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:42.260285 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-922e826e-d1bc-4b38-abbc-c9b6c64050f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:42.344901 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8ea6a7e7-bf77-49fc-92d5-40352bdccbc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d8a4700e3b45c9ac728315b4cd1ac5'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:42.355627 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8ea6a7e7-bf77-49fc-92d5-40352bdccbc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d8a4700e3b45c9ac728315b4cd1ac5'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:42.356349 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8ea6a7e7-bf77-49fc-92d5-40352bdccbc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d8a4700e3b45c9ac728315b4cd1ac5'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:42.393382 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 800/1597] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:52:41 2021] DELETE /identity/v3/users/c7d8a4700e3b45c9ac728315b4cd1ac5 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:42.396629 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6a7e7-bf77-49fc-92d5-40352bdccbc4 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:42.397981 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-8ea6a7e7-bf77-49fc-92d5-40352bdccbc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:42.450482 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e826e-d1bc-4b38-abbc-c9b6c64050f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:42.522102 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e826e-d1bc-4b38-abbc-c9b6c64050f0 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:42.554557 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 798/1598] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:42.555934 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb2a2-4bed-4784-8bd5-2a87318d2253 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:42.556880 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb2a2-4bed-4784-8bd5-2a87318d2253 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:42.557233 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb2a2-4bed-4784-8bd5-2a87318d2253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:42.574922 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6a7e7-bf77-49fc-92d5-40352bdccbc4 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:42.586170 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97e0e4-9e5b-4cdb-9839-3f80b9414659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:42.586799 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e0e4-9e5b-4cdb-9839-3f80b9414659 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:42.587095 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e0e4-9e5b-4cdb-9839-3f80b9414659 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:42.587380 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e0e4-9e5b-4cdb-9839-3f80b9414659 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:42.588094 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97e0e4-9e5b-4cdb-9839-3f80b9414659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:42.618863 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-62ffb2a2-4bed-4784-8bd5-2a87318d2253 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:42.620061 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-62ffb2a2-4bed-4784-8bd5-2a87318d2253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:42.629360 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 799/1599] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:42.647399 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb2a2-4bed-4784-8bd5-2a87318d2253 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:42.648814 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-62ffb2a2-4bed-4784-8bd5-2a87318d2253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:42.669878 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97e0e4-9e5b-4cdb-9839-3f80b9414659 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:42.703290 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 801/1600] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:42 2021] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:42.704544 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97e0e4-9e5b-4cdb-9839-3f80b9414659 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:42.732094 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97e0e4-9e5b-4cdb-9839-3f80b9414659 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:42.747642 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb2a2-4bed-4784-8bd5-2a87318d2253 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:42.748240 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40775072-cad5-4208-8106-37953aeb3c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:42.749363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40775072-cad5-4208-8106-37953aeb3c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:42.749747 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40775072-cad5-4208-8106-37953aeb3c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:42.751894 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40775072-cad5-4208-8106-37953aeb3c8b admin admin] PATH_INFO: `/v3/projects/573631a3cf9c47eaab2b74f2038eb5e8/users/628f034060964576bdf90de8730432ef/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:42.758596 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40775072-cad5-4208-8106-37953aeb3c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=573631a3cf9c47eaab2b74f2038eb5e8, user_id=628f034060964576bdf90de8730432ef, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:42.759886 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab671c-a6c8-4347-b823-081a5511f4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:42.760485 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab671c-a6c8-4347-b823-081a5511f4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:42.760851 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab671c-a6c8-4347-b823-081a5511f4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:42.761141 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab671c-a6c8-4347-b823-081a5511f4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:42.780641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab671c-a6c8-4347-b823-081a5511f4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:42.825769 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40775072-cad5-4208-8106-37953aeb3c8b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:42.833728 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab671c-a6c8-4347-b823-081a5511f4b2 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:42.847828 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 802/1601] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:42 2021] PUT /identity/v3/projects/573631a3cf9c47eaab2b74f2038eb5e8/users/628f034060964576bdf90de8730432ef/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:42.854155 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 800/1602] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:42.854307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40775072-cad5-4208-8106-37953aeb3c8b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:42.953187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40775072-cad5-4208-8106-37953aeb3c8b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:42.958094 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40e92f-57ca-4470-b2c2-fb9985187d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:42.958706 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40e92f-57ca-4470-b2c2-fb9985187d14 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:42.958997 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40e92f-57ca-4470-b2c2-fb9985187d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:42.959281 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40e92f-57ca-4470-b2c2-fb9985187d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:42.960230 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40e92f-57ca-4470-b2c2-fb9985187d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:42.994001 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40e92f-57ca-4470-b2c2-fb9985187d14 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:43.011335 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 803/1603] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:42 2021] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:43.016139 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab671c-a6c8-4347-b823-081a5511f4b2 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:43.037933 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab671c-a6c8-4347-b823-081a5511f4b2 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:43.043231 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284286b3-639f-4d41-b49d-e4d5661ede7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:43.044630 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284286b3-639f-4d41-b49d-e4d5661ede7f admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:43.045076 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284286b3-639f-4d41-b49d-e4d5661ede7f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:43.045530 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284286b3-639f-4d41-b49d-e4d5661ede7f admin admin] PATH_INFO: `/v3/projects/573631a3cf9c47eaab2b74f2038eb5e8/users/628f034060964576bdf90de8730432ef/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:43.048784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284286b3-639f-4d41-b49d-e4d5661ede7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=573631a3cf9c47eaab2b74f2038eb5e8, user_id=628f034060964576bdf90de8730432ef, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:43.098460 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284286b3-639f-4d41-b49d-e4d5661ede7f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:43.203931 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 801/1604] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:43 2021] PUT /identity/v3/projects/573631a3cf9c47eaab2b74f2038eb5e8/users/628f034060964576bdf90de8730432ef/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:43.438218 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40e92f-57ca-4470-b2c2-fb9985187d14 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:43.440276 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-5b40e92f-57ca-4470-b2c2-fb9985187d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:43.459951 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40e92f-57ca-4470-b2c2-fb9985187d14 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:43.532703 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf6957-2d4d-4b30-8ea8-5d67a1e65bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:43.534134 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf6957-2d4d-4b30-8ea8-5d67a1e65bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:43.534763 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf6957-2d4d-4b30-8ea8-5d67a1e65bda admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:43.535199 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf6957-2d4d-4b30-8ea8-5d67a1e65bda admin admin] PATH_INFO: `/v3/projects/86d387b6ac71495f983eb2e7124d1a48` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:43.536756 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf6957-2d4d-4b30-8ea8-5d67a1e65bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d387b6ac71495f983eb2e7124d1a48)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:43.566068 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: WARNING py.warnings [None req-5daf6957-2d4d-4b30-8ea8-5d67a1e65bda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 01:52:43.566068 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: warnings.warn(msg) Aug 23 01:52:43.566068 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: Aug 23 01:52:43.567712 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf6957-2d4d-4b30-8ea8-5d67a1e65bda admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:43.732669 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5daf6957-2d4d-4b30-8ea8-5d67a1e65bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d387b6ac71495f983eb2e7124d1a48', 'request_id': 'req-5daf6957-2d4d-4b30-8ea8-5d67a1e65bda'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:43.755136 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5daf6957-2d4d-4b30-8ea8-5d67a1e65bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d387b6ac71495f983eb2e7124d1a48', 'request_id': 'req-5daf6957-2d4d-4b30-8ea8-5d67a1e65bda'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:43.781936 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5daf6957-2d4d-4b30-8ea8-5d67a1e65bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d387b6ac71495f983eb2e7124d1a48', 'request_id': 'req-5daf6957-2d4d-4b30-8ea8-5d67a1e65bda'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:43.918701 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5daf6957-2d4d-4b30-8ea8-5d67a1e65bda admin admin] The token cache is being invalidate because project 86d387b6ac71495f983eb2e7124d1a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:52:43.925350 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5daf6957-2d4d-4b30-8ea8-5d67a1e65bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:43.925350 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5daf6957-2d4d-4b30-8ea8-5d67a1e65bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:43.925350 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 804/1605] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:52:43 2021] DELETE /identity/v3/projects/86d387b6ac71495f983eb2e7124d1a48 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:43.929701 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bb746-d37c-4927-a11a-21c1a4e2c26c None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:43.930177 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bb746-d37c-4927-a11a-21c1a4e2c26c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:43.930390 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bb746-d37c-4927-a11a-21c1a4e2c26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:43.976207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-cd4bb746-d37c-4927-a11a-21c1a4e2c26c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:43.976207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-cd4bb746-d37c-4927-a11a-21c1a4e2c26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:44.197606 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 802/1606] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:44.198539 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ec03c-1be8-4494-bf2b-2698988d152c None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:44.199010 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ec03c-1be8-4494-bf2b-2698988d152c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:44.199460 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ec03c-1be8-4494-bf2b-2698988d152c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:44.237528 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-642ec03c-1be8-4494-bf2b-2698988d152c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:44.238887 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-642ec03c-1be8-4494-bf2b-2698988d152c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:44.247197 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 805/1607] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:44.251521 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bb746-d37c-4927-a11a-21c1a4e2c26c None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:44.261766 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bb746-d37c-4927-a11a-21c1a4e2c26c None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:44.267330 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf1698-8af5-411f-8935-96d6ee62ddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:44.269203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf1698-8af5-411f-8935-96d6ee62ddef admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:44.269203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf1698-8af5-411f-8935-96d6ee62ddef admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:44.269203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf1698-8af5-411f-8935-96d6ee62ddef admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:44.269780 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf1698-8af5-411f-8935-96d6ee62ddef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:52:44.270016 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf1698-8af5-411f-8935-96d6ee62ddef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:44.302147 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf1698-8af5-411f-8935-96d6ee62ddef admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:44.321213 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 803/1608] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:52:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:52:44.322287 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ec03c-1be8-4494-bf2b-2698988d152c None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:44.332789 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ec03c-1be8-4494-bf2b-2698988d152c None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:44.337807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6c61c-da75-4028-a459-0213270e567c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:44.338503 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6c61c-da75-4028-a459-0213270e567c admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:44.338793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6c61c-da75-4028-a459-0213270e567c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:44.339071 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6c61c-da75-4028-a459-0213270e567c admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:44.340011 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6c61c-da75-4028-a459-0213270e567c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:44.371890 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6c61c-da75-4028-a459-0213270e567c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:44.455647 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 806/1609] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:52:44 2021] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:52:44.460134 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf1698-8af5-411f-8935-96d6ee62ddef admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:44.471597 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf1698-8af5-411f-8935-96d6ee62ddef admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:44.555468 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738257c9-6042-46aa-9960-cc9314f732e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:44.556413 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738257c9-6042-46aa-9960-cc9314f732e2 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:44.556805 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738257c9-6042-46aa-9960-cc9314f732e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:44.557176 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738257c9-6042-46aa-9960-cc9314f732e2 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:44.557890 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738257c9-6042-46aa-9960-cc9314f732e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:44.587900 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738257c9-6042-46aa-9960-cc9314f732e2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:44.692847 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 804/1610] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:52:44 2021] POST /identity/v3/users => generated 283 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:44.697555 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6c61c-da75-4028-a459-0213270e567c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:44.707606 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6c61c-da75-4028-a459-0213270e567c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:44.721085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dc1b3-cd01-41c1-837c-4541cafe28a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:44.721805 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dc1b3-cd01-41c1-837c-4541cafe28a7 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:44.722156 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dc1b3-cd01-41c1-837c-4541cafe28a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:44.722544 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dc1b3-cd01-41c1-837c-4541cafe28a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:44.723370 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7dc1b3-cd01-41c1-837c-4541cafe28a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:44.752662 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7dc1b3-cd01-41c1-837c-4541cafe28a7 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:44.766079 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 807/1611] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:44 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:44.769720 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51720c-6863-4807-8b3a-ccfad276fe87 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:44.769976 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dc1b3-cd01-41c1-837c-4541cafe28a7 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:44.770109 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51720c-6863-4807-8b3a-ccfad276fe87 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:44.770322 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51720c-6863-4807-8b3a-ccfad276fe87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:44.783721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dc1b3-cd01-41c1-837c-4541cafe28a7 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:44.789204 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1aa72-a7a9-426d-8c46-e0e400ac787f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:44.790962 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1aa72-a7a9-426d-8c46-e0e400ac787f admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:44.791528 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1aa72-a7a9-426d-8c46-e0e400ac787f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:44.792485 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1aa72-a7a9-426d-8c46-e0e400ac787f admin admin] PATH_INFO: `/v3/projects/231bab5b4a3547539aeb2e5e6c9e8ba1/users/526b9de70eff467c8d7eef583f9f25e4/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:44.834376 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1aa72-a7a9-426d-8c46-e0e400ac787f admin admin] RBAC: Authorizing `identity:create_grant(project_id=231bab5b4a3547539aeb2e5e6c9e8ba1, user_id=526b9de70eff467c8d7eef583f9f25e4, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:44.857699 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-cc51720c-6863-4807-8b3a-ccfad276fe87 None None] MFA Rules not processed for user `5e04d9763a554cc7bea1a8d30e690bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:44.859154 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-cc51720c-6863-4807-8b3a-ccfad276fe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:44.886949 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1aa72-a7a9-426d-8c46-e0e400ac787f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:44.983715 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 808/1612] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:44 2021] PUT /identity/v3/projects/231bab5b4a3547539aeb2e5e6c9e8ba1/users/526b9de70eff467c8d7eef583f9f25e4/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:52:44.987068 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 805/1613] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:44 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:52:44.994535 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c6599-c33c-4ec6-9843-895c7f5b1176 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:44.995143 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c6599-c33c-4ec6-9843-895c7f5b1176 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:44.995561 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c6599-c33c-4ec6-9843-895c7f5b1176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:45.002922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3eb01d-5815-45fd-99e6-006a7c02460b None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:45.005618 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3eb01d-5815-45fd-99e6-006a7c02460b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:45.011472 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3eb01d-5815-45fd-99e6-006a7c02460b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:45.097047 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-1d3eb01d-5815-45fd-99e6-006a7c02460b None None] MFA Rules not processed for user `5e04d9763a554cc7bea1a8d30e690bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:45.101729 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1d3eb01d-5815-45fd-99e6-006a7c02460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:45.122281 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-438c6599-c33c-4ec6-9843-895c7f5b1176 None None] MFA Rules not processed for user `526b9de70eff467c8d7eef583f9f25e4`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:45.127425 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-438c6599-c33c-4ec6-9843-895c7f5b1176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:45.259092 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 806/1614] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:44 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:45.261574 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3eb01d-5815-45fd-99e6-006a7c02460b None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:45.265473 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1d3eb01d-5815-45fd-99e6-006a7c02460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:45.284246 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 809/1615] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:44 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:45.285512 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c6599-c33c-4ec6-9843-895c7f5b1176 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:45.289786 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-438c6599-c33c-4ec6-9843-895c7f5b1176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:45.440674 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3eb01d-5815-45fd-99e6-006a7c02460b None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:45.452134 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90097725-df5c-4ec5-9b83-88fb65c5aa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:45.453432 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90097725-df5c-4ec5-9b83-88fb65c5aa15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:45.454438 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90097725-df5c-4ec5-9b83-88fb65c5aa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:45.454903 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90097725-df5c-4ec5-9b83-88fb65c5aa15 admin admin] PATH_INFO: `/v3/projects/b9eb56d87c164c5e9d7c176775643262` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:45.457876 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90097725-df5c-4ec5-9b83-88fb65c5aa15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9eb56d87c164c5e9d7c176775643262)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:45.481769 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c6599-c33c-4ec6-9843-895c7f5b1176 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:45.496853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07d318-9cdb-441e-bd71-7e2c5143776d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:45.497697 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07d318-9cdb-441e-bd71-7e2c5143776d service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:45.498725 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07d318-9cdb-441e-bd71-7e2c5143776d service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:45.510455 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07d318-9cdb-441e-bd71-7e2c5143776d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:45.515172 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07d318-9cdb-441e-bd71-7e2c5143776d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:45.517177 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90097725-df5c-4ec5-9b83-88fb65c5aa15 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:45.577825 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07d318-9cdb-441e-bd71-7e2c5143776d service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:45.597307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 810/1616] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:45 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:45.601839 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07d318-9cdb-441e-bd71-7e2c5143776d service nova] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:45.624898 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07d318-9cdb-441e-bd71-7e2c5143776d service nova] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:45.633879 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd065b-7727-4934-b912-a39066165c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:45.634624 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd065b-7727-4934-b912-a39066165c30 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:45.634924 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd065b-7727-4934-b912-a39066165c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:45.635210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd065b-7727-4934-b912-a39066165c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:45.639058 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd065b-7727-4934-b912-a39066165c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:45.703900 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-90097725-df5c-4ec5-9b83-88fb65c5aa15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9eb56d87c164c5e9d7c176775643262', 'request_id': 'req-90097725-df5c-4ec5-9b83-88fb65c5aa15'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:45.724099 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-90097725-df5c-4ec5-9b83-88fb65c5aa15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9eb56d87c164c5e9d7c176775643262', 'request_id': 'req-90097725-df5c-4ec5-9b83-88fb65c5aa15'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:45.736868 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd065b-7727-4934-b912-a39066165c30 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:45.753205 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-90097725-df5c-4ec5-9b83-88fb65c5aa15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9eb56d87c164c5e9d7c176775643262', 'request_id': 'req-90097725-df5c-4ec5-9b83-88fb65c5aa15'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:45.880527 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-90097725-df5c-4ec5-9b83-88fb65c5aa15 admin admin] The token cache is being invalidate because project b9eb56d87c164c5e9d7c176775643262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:52:45.884275 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-90097725-df5c-4ec5-9b83-88fb65c5aa15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:45.884275 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-90097725-df5c-4ec5-9b83-88fb65c5aa15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:45.884470 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 811/1617] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:52:45 2021] POST /identity/v3/projects => generated 363 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:45.886304 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd065b-7727-4934-b912-a39066165c30 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:45.889728 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 807/1618] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:52:45 2021] DELETE /identity/v3/projects/b9eb56d87c164c5e9d7c176775643262 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:45.889986 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-8ddd065b-7727-4934-b912-a39066165c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:45.890488 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90097725-df5c-4ec5-9b83-88fb65c5aa15 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:45.901655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-90097725-df5c-4ec5-9b83-88fb65c5aa15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:46.057346 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90097725-df5c-4ec5-9b83-88fb65c5aa15 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:46.061426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd065b-7727-4934-b912-a39066165c30 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:46.067418 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a33c1-e93a-4e46-88ba-41344ef4ee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:46.069320 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a33c1-e93a-4e46-88ba-41344ef4ee56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:46.070063 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a33c1-e93a-4e46-88ba-41344ef4ee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:46.071152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a33c1-e93a-4e46-88ba-41344ef4ee56 admin admin] PATH_INFO: `/v3/users/22d5826815e94f9fa2a2c7a62f12d3e1` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:46.071886 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05230ff2-edf3-4aa3-ab68-7f4ebf6a91ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:46.072706 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05230ff2-edf3-4aa3-ab68-7f4ebf6a91ae admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:46.073998 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05230ff2-edf3-4aa3-ab68-7f4ebf6a91ae admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:46.074811 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a33c1-e93a-4e46-88ba-41344ef4ee56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d5826815e94f9fa2a2c7a62f12d3e1)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:46.075264 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05230ff2-edf3-4aa3-ab68-7f4ebf6a91ae admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:46.077268 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05230ff2-edf3-4aa3-ab68-7f4ebf6a91ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:46.131535 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05230ff2-edf3-4aa3-ab68-7f4ebf6a91ae admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:46.137848 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a33c1-e93a-4e46-88ba-41344ef4ee56 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:46.319371 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 812/1619] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:52:45 2021] POST /identity/v3/users => generated 288 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:52:46.321116 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05230ff2-edf3-4aa3-ab68-7f4ebf6a91ae admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:46.337029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05230ff2-edf3-4aa3-ab68-7f4ebf6a91ae admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:46.349186 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519c633-c5d5-4a93-90c6-dcc1283198e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:46.350278 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519c633-c5d5-4a93-90c6-dcc1283198e4 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:46.350721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519c633-c5d5-4a93-90c6-dcc1283198e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:46.351180 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519c633-c5d5-4a93-90c6-dcc1283198e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:46.352147 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519c633-c5d5-4a93-90c6-dcc1283198e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:46.438896 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519c633-c5d5-4a93-90c6-dcc1283198e4 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:46.466179 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 813/1620] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:46 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:46.474811 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-391a33c1-e93a-4e46-88ba-41344ef4ee56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d5826815e94f9fa2a2c7a62f12d3e1'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:46.476800 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519c633-c5d5-4a93-90c6-dcc1283198e4 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:46.507372 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519c633-c5d5-4a93-90c6-dcc1283198e4 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:46.516171 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337f260-3e16-4e08-a6d4-9b06ccf9f995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:46.517697 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337f260-3e16-4e08-a6d4-9b06ccf9f995 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:46.518159 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337f260-3e16-4e08-a6d4-9b06ccf9f995 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:46.520931 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337f260-3e16-4e08-a6d4-9b06ccf9f995 admin admin] PATH_INFO: `/v3/projects/9d7176eecfad460bb8f30e4d92d5c7bc/users/7682b142a5a749f5b501d16d86f35663/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:46.574833 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337f260-3e16-4e08-a6d4-9b06ccf9f995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7176eecfad460bb8f30e4d92d5c7bc, user_id=7682b142a5a749f5b501d16d86f35663, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:46.584249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-391a33c1-e93a-4e46-88ba-41344ef4ee56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d5826815e94f9fa2a2c7a62f12d3e1'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:46.584823 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-391a33c1-e93a-4e46-88ba-41344ef4ee56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d5826815e94f9fa2a2c7a62f12d3e1'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:46.599558 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-391a33c1-e93a-4e46-88ba-41344ef4ee56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d5826815e94f9fa2a2c7a62f12d3e1'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:46.601336 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-391a33c1-e93a-4e46-88ba-41344ef4ee56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d5826815e94f9fa2a2c7a62f12d3e1'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:46.642343 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 808/1621] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:52:45 2021] DELETE /identity/v3/users/22d5826815e94f9fa2a2c7a62f12d3e1 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:46.645169 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6107a-14f5-44a6-91c7-0047e7b36ff0 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:46.645467 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6107a-14f5-44a6-91c7-0047e7b36ff0 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:46.645748 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6107a-14f5-44a6-91c7-0047e7b36ff0 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:46.651375 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 809/1622] 10.222.0.20 () {54 vars in 912 bytes} [Mon Aug 23 01:52:46 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:52:46.659296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71fbda-88ce-4909-9fbb-14a4e1207bf4 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:46.659484 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337f260-3e16-4e08-a6d4-9b06ccf9f995 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:46.664540 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71fbda-88ce-4909-9fbb-14a4e1207bf4 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:46.664540 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71fbda-88ce-4909-9fbb-14a4e1207bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:46.713773 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-3d71fbda-88ce-4909-9fbb-14a4e1207bf4 None None] MFA Rules not processed for user `628f034060964576bdf90de8730432ef`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:46.715093 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-3d71fbda-88ce-4909-9fbb-14a4e1207bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:46.768097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 814/1623] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:46 2021] PUT /identity/v3/projects/9d7176eecfad460bb8f30e4d92d5c7bc/users/7682b142a5a749f5b501d16d86f35663/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:46.769579 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaac66f-5ee6-4fcb-acab-e7622ee1137d None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:46.769875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaac66f-5ee6-4fcb-acab-e7622ee1137d None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:46.771274 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaac66f-5ee6-4fcb-acab-e7622ee1137d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:46.831955 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-caaac66f-5ee6-4fcb-acab-e7622ee1137d None None] MFA Rules not processed for user `eedaf4b880f24ac48ee6e04b75059ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:46.835703 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-caaac66f-5ee6-4fcb-acab-e7622ee1137d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:46.911749 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 810/1624] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:46 2021] POST /identity/v3/auth/tokens => generated 3777 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:46.916233 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71fbda-88ce-4909-9fbb-14a4e1207bf4 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:46.918441 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-3d71fbda-88ce-4909-9fbb-14a4e1207bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:47.022944 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 815/1625] 10.222.0.20 () {58 vars in 1010 bytes} [Mon Aug 23 01:52:46 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:47.081505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71fbda-88ce-4909-9fbb-14a4e1207bf4 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:47.192347 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634749c4-f739-4834-9595-5e7a55d0ecbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:47.194029 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634749c4-f739-4834-9595-5e7a55d0ecbd admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:47.194029 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634749c4-f739-4834-9595-5e7a55d0ecbd admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:47.194029 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634749c4-f739-4834-9595-5e7a55d0ecbd admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:47.194977 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634749c4-f739-4834-9595-5e7a55d0ecbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:47.226534 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634749c4-f739-4834-9595-5e7a55d0ecbd admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:47.230851 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaac66f-5ee6-4fcb-acab-e7622ee1137d None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:47.232281 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-caaac66f-5ee6-4fcb-acab-e7622ee1137d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:47.240608 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 811/1626] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:46 2021] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:47.244011 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634749c4-f739-4834-9595-5e7a55d0ecbd admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:47.254592 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaac66f-5ee6-4fcb-acab-e7622ee1137d None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:47.271645 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e34f8-6c64-400c-8dd2-0f19aba21392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:47.271645 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e34f8-6c64-400c-8dd2-0f19aba21392 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:47.271645 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e34f8-6c64-400c-8dd2-0f19aba21392 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:47.271645 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e34f8-6c64-400c-8dd2-0f19aba21392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:47.272834 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634749c4-f739-4834-9595-5e7a55d0ecbd admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:47.284926 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b36361-4817-4ff2-a963-a08febdc82a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:47.286028 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b36361-4817-4ff2-a963-a08febdc82a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:47.286482 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b36361-4817-4ff2-a963-a08febdc82a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:47.288417 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b36361-4817-4ff2-a963-a08febdc82a1 admin admin] PATH_INFO: `/v3/projects/9d7176eecfad460bb8f30e4d92d5c7bc/users/7682b142a5a749f5b501d16d86f35663/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:47.292094 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b36361-4817-4ff2-a963-a08febdc82a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7176eecfad460bb8f30e4d92d5c7bc, user_id=7682b142a5a749f5b501d16d86f35663, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:47.297140 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e34f8-6c64-400c-8dd2-0f19aba21392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:47.370947 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b36361-4817-4ff2-a963-a08febdc82a1 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:47.379069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e34f8-6c64-400c-8dd2-0f19aba21392 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:47.405395 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 816/1627] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:47 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:52:47.415837 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 812/1628] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:47 2021] PUT /identity/v3/projects/9d7176eecfad460bb8f30e4d92d5c7bc/users/7682b142a5a749f5b501d16d86f35663/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:47.417952 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e34f8-6c64-400c-8dd2-0f19aba21392 service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:47.439464 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e34f8-6c64-400c-8dd2-0f19aba21392 service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:47.611260 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1466e5-2faf-408c-b56d-e75e4695770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:47.611881 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1466e5-2faf-408c-b56d-e75e4695770f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:47.612314 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1466e5-2faf-408c-b56d-e75e4695770f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:47.612624 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1466e5-2faf-408c-b56d-e75e4695770f admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:47.613943 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1466e5-2faf-408c-b56d-e75e4695770f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:47.649138 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1466e5-2faf-408c-b56d-e75e4695770f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:47.680255 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 817/1629] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:47 2021] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:47.684633 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b36361-4817-4ff2-a963-a08febdc82a1 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:47.704033 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b36361-4817-4ff2-a963-a08febdc82a1 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:47.716529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e57b8f-6533-483f-a4ce-70164a81f658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:47.719387 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e57b8f-6533-483f-a4ce-70164a81f658 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:47.719735 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e57b8f-6533-483f-a4ce-70164a81f658 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:47.720025 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e57b8f-6533-483f-a4ce-70164a81f658 admin admin] PATH_INFO: `/v3/projects/9d7176eecfad460bb8f30e4d92d5c7bc/users/7682b142a5a749f5b501d16d86f35663/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:47.725898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e57b8f-6533-483f-a4ce-70164a81f658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7176eecfad460bb8f30e4d92d5c7bc, user_id=7682b142a5a749f5b501d16d86f35663, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:47.792024 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e57b8f-6533-483f-a4ce-70164a81f658 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:47.886471 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 813/1630] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:47 2021] PUT /identity/v3/projects/9d7176eecfad460bb8f30e4d92d5c7bc/users/7682b142a5a749f5b501d16d86f35663/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:52:47.953140 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355de77-ef5b-459d-8a62-752169a25e94 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:47.954409 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355de77-ef5b-459d-8a62-752169a25e94 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:47.954911 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355de77-ef5b-459d-8a62-752169a25e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:48.089864 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-1355de77-ef5b-459d-8a62-752169a25e94 None None] MFA Rules not processed for user `7682b142a5a749f5b501d16d86f35663`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:48.092015 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1355de77-ef5b-459d-8a62-752169a25e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:48.349577 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 818/1631] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:47 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:48.360075 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e57b8f-6533-483f-a4ce-70164a81f658 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:48.363105 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-c6e57b8f-6533-483f-a4ce-70164a81f658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:48.536089 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e57b8f-6533-483f-a4ce-70164a81f658 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:48.550063 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ad833-1281-4e43-8983-9a22b138b241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:48.550935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ad833-1281-4e43-8983-9a22b138b241 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:48.551441 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ad833-1281-4e43-8983-9a22b138b241 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:48.552038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ad833-1281-4e43-8983-9a22b138b241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:48.574050 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ad833-1281-4e43-8983-9a22b138b241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:48.630585 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ad833-1281-4e43-8983-9a22b138b241 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:48.670652 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 814/1632] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:48 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:48.997407 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355de77-ef5b-459d-8a62-752169a25e94 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:49.014816 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355de77-ef5b-459d-8a62-752169a25e94 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:49.039512 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92c33a-078c-4c17-9f79-e45a54b86c63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:49.043485 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92c33a-078c-4c17-9f79-e45a54b86c63 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:49.045551 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92c33a-078c-4c17-9f79-e45a54b86c63 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:49.046153 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92c33a-078c-4c17-9f79-e45a54b86c63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:49.053544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f1e95-38d4-439a-a4f8-bebaa281616c None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:49.054799 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f1e95-38d4-439a-a4f8-bebaa281616c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:49.054799 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f1e95-38d4-439a-a4f8-bebaa281616c None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:49.056198 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 815/1633] 10.222.0.20 () {54 vars in 960 bytes} [Mon Aug 23 01:52:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 01:52:49.064211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e6733-1704-4b6b-9e19-6d33f287f67f None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:49.064662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e6733-1704-4b6b-9e19-6d33f287f67f None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:49.065046 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e6733-1704-4b6b-9e19-6d33f287f67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:49.065548 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-cb92c33a-078c-4c17-9f79-e45a54b86c63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:49.136469 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-415e6733-1704-4b6b-9e19-6d33f287f67f None None] MFA Rules not processed for user `c4a6c587fd604395908134c50ce7618d`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:49.140411 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-415e6733-1704-4b6b-9e19-6d33f287f67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:49.258548 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92c33a-078c-4c17-9f79-e45a54b86c63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:49.313693 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 816/1634] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Aug 23 01:52:49 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:49.334228 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e6733-1704-4b6b-9e19-6d33f287f67f None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:49.350488 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e6733-1704-4b6b-9e19-6d33f287f67f None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:49.365318 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92c33a-078c-4c17-9f79-e45a54b86c63 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:49.365684 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e074e-4ff8-46b5-b1fc-8992ca250ee5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4a6c587fd604395908134c50ce7618d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:49.366356 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e074e-4ff8-46b5-b1fc-8992ca250ee5 service placement] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:49.366719 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e074e-4ff8-46b5-b1fc-8992ca250ee5 service placement] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:49.367682 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e074e-4ff8-46b5-b1fc-8992ca250ee5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:49.370915 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-617e074e-4ff8-46b5-b1fc-8992ca250ee5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:49.399771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e074e-4ff8-46b5-b1fc-8992ca250ee5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:49.410517 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 819/1635] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:48 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:49.490567 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e074e-4ff8-46b5-b1fc-8992ca250ee5 service placement] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:49.532590 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 817/1636] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:49 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:49.697950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92c33a-078c-4c17-9f79-e45a54b86c63 service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:49.700473 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-cb92c33a-078c-4c17-9f79-e45a54b86c63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:49.934854 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92c33a-078c-4c17-9f79-e45a54b86c63 service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:49.945997 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6bf11-3724-438b-8fbd-257fae50d4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:49.947076 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6bf11-3724-438b-8fbd-257fae50d4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:49.952584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6bf11-3724-438b-8fbd-257fae50d4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:49.952881 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6bf11-3724-438b-8fbd-257fae50d4ee admin admin] PATH_INFO: `/v3/projects/c4b23f998b5c4d7894591776da8a8ea6` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:49.963765 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6bf11-3724-438b-8fbd-257fae50d4ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4b23f998b5c4d7894591776da8a8ea6)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:49.980085 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e074e-4ff8-46b5-b1fc-8992ca250ee5 service placement] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:49.981611 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-617e074e-4ff8-46b5-b1fc-8992ca250ee5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:50.014764 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e074e-4ff8-46b5-b1fc-8992ca250ee5 service placement] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:50.035239 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683dbe7-94e1-4f6b-91ca-914adb9c8348 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4a6c587fd604395908134c50ce7618d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:50.036014 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683dbe7-94e1-4f6b-91ca-914adb9c8348 service placement] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:50.036310 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683dbe7-94e1-4f6b-91ca-914adb9c8348 service placement] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:50.036635 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683dbe7-94e1-4f6b-91ca-914adb9c8348 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:50.041826 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-9683dbe7-94e1-4f6b-91ca-914adb9c8348 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:50.067936 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6bf11-3724-438b-8fbd-257fae50d4ee admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:50.086073 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683dbe7-94e1-4f6b-91ca-914adb9c8348 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:50.124893 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683dbe7-94e1-4f6b-91ca-914adb9c8348 service placement] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:50.151552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 818/1637] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:49 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:52:50.295069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7fc6bf11-3724-438b-8fbd-257fae50d4ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4b23f998b5c4d7894591776da8a8ea6', 'request_id': 'req-7fc6bf11-3724-438b-8fbd-257fae50d4ee'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:50.311583 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7fc6bf11-3724-438b-8fbd-257fae50d4ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4b23f998b5c4d7894591776da8a8ea6', 'request_id': 'req-7fc6bf11-3724-438b-8fbd-257fae50d4ee'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:50.341088 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7fc6bf11-3724-438b-8fbd-257fae50d4ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4b23f998b5c4d7894591776da8a8ea6', 'request_id': 'req-7fc6bf11-3724-438b-8fbd-257fae50d4ee'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:50.464061 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7fc6bf11-3724-438b-8fbd-257fae50d4ee admin admin] The token cache is being invalidate because project c4b23f998b5c4d7894591776da8a8ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:52:50.464061 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7fc6bf11-3724-438b-8fbd-257fae50d4ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:50.464061 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7fc6bf11-3724-438b-8fbd-257fae50d4ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:50.465355 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 820/1638] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:52:49 2021] DELETE /identity/v3/projects/c4b23f998b5c4d7894591776da8a8ea6 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:50.471559 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7c9eb-84dd-4ef4-b39f-9f6ae80f6156 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:50.472108 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7c9eb-84dd-4ef4-b39f-9f6ae80f6156 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:50.472108 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7c9eb-84dd-4ef4-b39f-9f6ae80f6156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:50.503059 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-1da7c9eb-84dd-4ef4-b39f-9f6ae80f6156 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:50.504909 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1da7c9eb-84dd-4ef4-b39f-9f6ae80f6156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:50.653427 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 819/1639] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:50.662640 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d7f7d-c29e-4702-907c-ac17533d27c9 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:50.663111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d7f7d-c29e-4702-907c-ac17533d27c9 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:50.663673 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d7f7d-c29e-4702-907c-ac17533d27c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:50.727298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-0e0d7f7d-c29e-4702-907c-ac17533d27c9 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:50.728472 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0e0d7f7d-c29e-4702-907c-ac17533d27c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:50.760377 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 821/1640] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:50.764914 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7c9eb-84dd-4ef4-b39f-9f6ae80f6156 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:50.778857 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7c9eb-84dd-4ef4-b39f-9f6ae80f6156 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:50.781779 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9482b0-8e5e-4996-a740-0dd6c6b4b435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:50.782518 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9482b0-8e5e-4996-a740-0dd6c6b4b435 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:50.782877 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9482b0-8e5e-4996-a740-0dd6c6b4b435 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:50.783407 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9482b0-8e5e-4996-a740-0dd6c6b4b435 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:50.784036 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9482b0-8e5e-4996-a740-0dd6c6b4b435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:52:50.784436 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9482b0-8e5e-4996-a740-0dd6c6b4b435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:50.814104 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9482b0-8e5e-4996-a740-0dd6c6b4b435 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:50.829695 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 820/1641] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:52:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:52:50.833377 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d7f7d-c29e-4702-907c-ac17533d27c9 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:50.850284 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d7f7d-c29e-4702-907c-ac17533d27c9 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:50.857393 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755113b-28a6-444c-8a53-fcf857e1556a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:50.858419 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755113b-28a6-444c-8a53-fcf857e1556a admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:50.862549 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755113b-28a6-444c-8a53-fcf857e1556a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:50.862549 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755113b-28a6-444c-8a53-fcf857e1556a admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:50.862549 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755113b-28a6-444c-8a53-fcf857e1556a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:50.895563 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755113b-28a6-444c-8a53-fcf857e1556a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:51.007110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 822/1642] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:52:50 2021] POST /identity/v3/projects => generated 363 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:52:51.009366 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9482b0-8e5e-4996-a740-0dd6c6b4b435 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:51.021457 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9482b0-8e5e-4996-a740-0dd6c6b4b435 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:51.137241 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc575f-e3e9-4d38-b780-f0b064fdb81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:51.137633 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc575f-e3e9-4d38-b780-f0b064fdb81b admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:51.137922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc575f-e3e9-4d38-b780-f0b064fdb81b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:51.138203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc575f-e3e9-4d38-b780-f0b064fdb81b admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:51.138949 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc575f-e3e9-4d38-b780-f0b064fdb81b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:51.166289 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc575f-e3e9-4d38-b780-f0b064fdb81b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:51.308657 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 821/1643] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:52:51 2021] POST /identity/v3/users => generated 282 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:51.310681 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755113b-28a6-444c-8a53-fcf857e1556a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:51.323976 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755113b-28a6-444c-8a53-fcf857e1556a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:51.328944 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c2059-24c6-4450-b7e6-107cf4097b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:51.329782 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c2059-24c6-4450-b7e6-107cf4097b2b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:51.330383 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c2059-24c6-4450-b7e6-107cf4097b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:51.330861 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c2059-24c6-4450-b7e6-107cf4097b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:51.331721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c2059-24c6-4450-b7e6-107cf4097b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:51.360295 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c2059-24c6-4450-b7e6-107cf4097b2b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:51.372125 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 823/1644] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:51 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:51.376464 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc575f-e3e9-4d38-b780-f0b064fdb81b admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:51.394801 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc575f-e3e9-4d38-b780-f0b064fdb81b admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:51.399203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efe92c-efab-42c7-a323-e4d9490466ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:51.400099 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efe92c-efab-42c7-a323-e4d9490466ea admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:51.400464 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efe92c-efab-42c7-a323-e4d9490466ea admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:51.400835 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efe92c-efab-42c7-a323-e4d9490466ea admin admin] PATH_INFO: `/v3/projects/6401257028414f6f8c7c45a8fd30be18/users/962efe2404de4b8e89eddcd9af4c6c0c/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:51.440696 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efe92c-efab-42c7-a323-e4d9490466ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6401257028414f6f8c7c45a8fd30be18, user_id=962efe2404de4b8e89eddcd9af4c6c0c, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:51.506152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efe92c-efab-42c7-a323-e4d9490466ea admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:51.838211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 822/1645] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:51 2021] PUT /identity/v3/projects/6401257028414f6f8c7c45a8fd30be18/users/962efe2404de4b8e89eddcd9af4c6c0c/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:52:51.841865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c4923-ea64-4420-82d3-c58a52b2942e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:51.841865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c4923-ea64-4420-82d3-c58a52b2942e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:51.841865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c4923-ea64-4420-82d3-c58a52b2942e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:51.841865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-715c4923-ea64-4420-82d3-c58a52b2942e None None] MFA Rules not processed for user `962efe2404de4b8e89eddcd9af4c6c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:51.841865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-715c4923-ea64-4420-82d3-c58a52b2942e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:51.955552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 824/1646] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:51 2021] POST /identity/v3/auth/tokens => generated 3670 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:52:51.960053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efe92c-efab-42c7-a323-e4d9490466ea admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:52.054883 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efe92c-efab-42c7-a323-e4d9490466ea admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:52.059532 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ee03c-e3f8-4707-9270-5405186509cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:52.060265 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ee03c-e3f8-4707-9270-5405186509cd admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:52.061480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ee03c-e3f8-4707-9270-5405186509cd admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:52.062212 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ee03c-e3f8-4707-9270-5405186509cd admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:52.068428 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ee03c-e3f8-4707-9270-5405186509cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:52.097185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ee03c-e3f8-4707-9270-5405186509cd admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:52.219852 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 823/1647] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:52:51 2021] POST /identity/v3/projects => generated 363 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:52:52.225742 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c4923-ea64-4420-82d3-c58a52b2942e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:52.240176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c4923-ea64-4420-82d3-c58a52b2942e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:52.336006 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adf434-c557-4682-be6f-f8743a7aaf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:52.337220 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adf434-c557-4682-be6f-f8743a7aaf58 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:52.338013 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adf434-c557-4682-be6f-f8743a7aaf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:52.338722 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adf434-c557-4682-be6f-f8743a7aaf58 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:52.339741 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5adf434-c557-4682-be6f-f8743a7aaf58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:52.392964 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5adf434-c557-4682-be6f-f8743a7aaf58 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:52.532329 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 825/1648] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:52:52 2021] POST /identity/v3/users => generated 288 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:52:52.536295 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ee03c-e3f8-4707-9270-5405186509cd admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:52.548062 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ee03c-e3f8-4707-9270-5405186509cd admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:52.564481 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38c8cd-81d6-4724-a96b-836f529fa3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:52.565900 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38c8cd-81d6-4724-a96b-836f529fa3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:52.566299 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38c8cd-81d6-4724-a96b-836f529fa3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:52.566689 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38c8cd-81d6-4724-a96b-836f529fa3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:52.567509 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38c8cd-81d6-4724-a96b-836f529fa3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:52.625434 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38c8cd-81d6-4724-a96b-836f529fa3e9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:52.660853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adf434-c557-4682-be6f-f8743a7aaf58 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:52.661200 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 824/1649] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:52 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:52.673721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adf434-c557-4682-be6f-f8743a7aaf58 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:52.693479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46388b42-02c2-4bba-9a05-7f3bbead2b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:52.694322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46388b42-02c2-4bba-9a05-7f3bbead2b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:52.696816 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46388b42-02c2-4bba-9a05-7f3bbead2b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:52.697014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46388b42-02c2-4bba-9a05-7f3bbead2b20 admin admin] PATH_INFO: `/v3/projects/092f1f0c343b402d92659dda530c3797/users/312825f8524a4ee6bb1e4781ea61265e/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:52.755432 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46388b42-02c2-4bba-9a05-7f3bbead2b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=092f1f0c343b402d92659dda530c3797, user_id=312825f8524a4ee6bb1e4781ea61265e, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:52.852387 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46388b42-02c2-4bba-9a05-7f3bbead2b20 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:52.958756 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 826/1650] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:52 2021] PUT /identity/v3/projects/092f1f0c343b402d92659dda530c3797/users/312825f8524a4ee6bb1e4781ea61265e/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:52.962675 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38c8cd-81d6-4724-a96b-836f529fa3e9 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:52.977680 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38c8cd-81d6-4724-a96b-836f529fa3e9 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:53.070326 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46388b42-02c2-4bba-9a05-7f3bbead2b20 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:53.074540 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-46388b42-02c2-4bba-9a05-7f3bbead2b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:53.152517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb5237-e200-431f-bf19-01b16c0ddcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:53.153185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb5237-e200-431f-bf19-01b16c0ddcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:53.153476 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb5237-e200-431f-bf19-01b16c0ddcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:53.153759 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb5237-e200-431f-bf19-01b16c0ddcb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:53.154485 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb5237-e200-431f-bf19-01b16c0ddcb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:53.211100 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46388b42-02c2-4bba-9a05-7f3bbead2b20 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:53.215526 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb5237-e200-431f-bf19-01b16c0ddcb8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:53.222292 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311f420-82f1-4af7-a867-92fe17d6623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:53.225020 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311f420-82f1-4af7-a867-92fe17d6623e admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:53.225971 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311f420-82f1-4af7-a867-92fe17d6623e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:53.226317 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311f420-82f1-4af7-a867-92fe17d6623e admin admin] PATH_INFO: `/v3/users/7d0f254397414b6fb994b5ee22416a59` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:53.232146 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311f420-82f1-4af7-a867-92fe17d6623e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d0f254397414b6fb994b5ee22416a59)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:53.241413 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 825/1651] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:52 2021] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:53.245318 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb5237-e200-431f-bf19-01b16c0ddcb8 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:53.270824 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb5237-e200-431f-bf19-01b16c0ddcb8 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:53.288409 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d2eac-ba2c-4fa9-8a3e-92a1c75ce252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:53.289282 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d2eac-ba2c-4fa9-8a3e-92a1c75ce252 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:53.289580 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d2eac-ba2c-4fa9-8a3e-92a1c75ce252 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:53.289861 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d2eac-ba2c-4fa9-8a3e-92a1c75ce252 admin admin] PATH_INFO: `/v3/projects/092f1f0c343b402d92659dda530c3797/users/312825f8524a4ee6bb1e4781ea61265e/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:53.296374 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d2eac-ba2c-4fa9-8a3e-92a1c75ce252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=092f1f0c343b402d92659dda530c3797, user_id=312825f8524a4ee6bb1e4781ea61265e, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:53.325343 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311f420-82f1-4af7-a867-92fe17d6623e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:53.389156 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d2eac-ba2c-4fa9-8a3e-92a1c75ce252 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:53.423396 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 826/1652] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:53 2021] PUT /identity/v3/projects/092f1f0c343b402d92659dda530c3797/users/312825f8524a4ee6bb1e4781ea61265e/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:53.427822 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d2eac-ba2c-4fa9-8a3e-92a1c75ce252 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:53.433844 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-810d2eac-ba2c-4fa9-8a3e-92a1c75ce252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:53.599741 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d2eac-ba2c-4fa9-8a3e-92a1c75ce252 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:53.605773 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6b05d-2983-4b67-9f0a-e62cac95cd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:53.606796 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6b05d-2983-4b67-9f0a-e62cac95cd53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:53.607873 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6b05d-2983-4b67-9f0a-e62cac95cd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:53.608389 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6b05d-2983-4b67-9f0a-e62cac95cd53 admin admin] PATH_INFO: `/v3/users/f07aa5785b6a4b2dab6764f873323395` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:53.609969 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6b05d-2983-4b67-9f0a-e62cac95cd53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f07aa5785b6a4b2dab6764f873323395)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:53.621276 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a311f420-82f1-4af7-a867-92fe17d6623e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d0f254397414b6fb994b5ee22416a59'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:53.622011 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a311f420-82f1-4af7-a867-92fe17d6623e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d0f254397414b6fb994b5ee22416a59'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:53.658806 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6b05d-2983-4b67-9f0a-e62cac95cd53 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:53.724440 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a311f420-82f1-4af7-a867-92fe17d6623e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d0f254397414b6fb994b5ee22416a59'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:53.736830 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a311f420-82f1-4af7-a867-92fe17d6623e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d0f254397414b6fb994b5ee22416a59'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:53.737904 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a311f420-82f1-4af7-a867-92fe17d6623e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d0f254397414b6fb994b5ee22416a59'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:53.840265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 827/1653] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:52:53 2021] DELETE /identity/v3/users/7d0f254397414b6fb994b5ee22416a59 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:53.840265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311f420-82f1-4af7-a867-92fe17d6623e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:53.840642 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-a311f420-82f1-4af7-a867-92fe17d6623e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:54.001693 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311f420-82f1-4af7-a867-92fe17d6623e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:54.007646 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-63b6b05d-2983-4b67-9f0a-e62cac95cd53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f07aa5785b6a4b2dab6764f873323395'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:54.017078 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85ec9c-f5bc-4095-bbc3-1e0f8d517dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:54.017912 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85ec9c-f5bc-4095-bbc3-1e0f8d517dfe admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:54.018272 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85ec9c-f5bc-4095-bbc3-1e0f8d517dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:54.018681 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85ec9c-f5bc-4095-bbc3-1e0f8d517dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:54.019461 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85ec9c-f5bc-4095-bbc3-1e0f8d517dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:54.093993 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85ec9c-f5bc-4095-bbc3-1e0f8d517dfe admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:54.132529 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 828/1654] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:53 2021] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:54.135294 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-63b6b05d-2983-4b67-9f0a-e62cac95cd53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f07aa5785b6a4b2dab6764f873323395'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:54.136464 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f8a96-9120-4140-ad6d-3e3083c9295f None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:54.136788 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f8a96-9120-4140-ad6d-3e3083c9295f None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:54.137080 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f8a96-9120-4140-ad6d-3e3083c9295f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:54.142232 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-63b6b05d-2983-4b67-9f0a-e62cac95cd53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f07aa5785b6a4b2dab6764f873323395'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:54.160214 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-63b6b05d-2983-4b67-9f0a-e62cac95cd53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f07aa5785b6a4b2dab6764f873323395'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:54.162009 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-63b6b05d-2983-4b67-9f0a-e62cac95cd53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f07aa5785b6a4b2dab6764f873323395'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:54.206922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 827/1655] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:52:53 2021] DELETE /identity/v3/users/f07aa5785b6a4b2dab6764f873323395 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:54.206922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6b05d-2983-4b67-9f0a-e62cac95cd53 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:54.206922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-63b6b05d-2983-4b67-9f0a-e62cac95cd53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:54.226098 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-2c4f8a96-9120-4140-ad6d-3e3083c9295f None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:54.229549 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-2c4f8a96-9120-4140-ad6d-3e3083c9295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:54.470311 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 829/1656] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:54.477307 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6b05d-2983-4b67-9f0a-e62cac95cd53 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:54.491544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84903bf-c373-4eff-9b98-dcf159c0ded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:54.492157 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84903bf-c373-4eff-9b98-dcf159c0ded6 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:54.492450 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84903bf-c373-4eff-9b98-dcf159c0ded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:54.492765 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84903bf-c373-4eff-9b98-dcf159c0ded6 admin admin] PATH_INFO: `/v3/projects/092f1f0c343b402d92659dda530c3797/users/312825f8524a4ee6bb1e4781ea61265e/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:54.496236 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84903bf-c373-4eff-9b98-dcf159c0ded6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=092f1f0c343b402d92659dda530c3797, user_id=312825f8524a4ee6bb1e4781ea61265e, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:54.544205 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84903bf-c373-4eff-9b98-dcf159c0ded6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:54.607535 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f8a96-9120-4140-ad6d-3e3083c9295f None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:54.613061 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-2c4f8a96-9120-4140-ad6d-3e3083c9295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:54.657509 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 828/1657] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:54 2021] PUT /identity/v3/projects/092f1f0c343b402d92659dda530c3797/users/312825f8524a4ee6bb1e4781ea61265e/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:54.667907 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398a878-6561-41e7-be1f-0fb391758ac9 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:54.668426 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398a878-6561-41e7-be1f-0fb391758ac9 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:54.668976 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398a878-6561-41e7-be1f-0fb391758ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:54.774618 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-7398a878-6561-41e7-be1f-0fb391758ac9 None None] MFA Rules not processed for user `312825f8524a4ee6bb1e4781ea61265e`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:54.776074 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-7398a878-6561-41e7-be1f-0fb391758ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:54.783291 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f8a96-9120-4140-ad6d-3e3083c9295f None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:54.938835 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7109f2-f7c8-48a9-9022-6400c0c2de64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:54.939454 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7109f2-f7c8-48a9-9022-6400c0c2de64 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:54.939701 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7109f2-f7c8-48a9-9022-6400c0c2de64 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:54.939990 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7109f2-f7c8-48a9-9022-6400c0c2de64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:54.954773 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 829/1658] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:54 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:54.957221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc3891-eba8-4cf1-893e-4fd341f98103 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:54.957221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc3891-eba8-4cf1-893e-4fd341f98103 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:54.957439 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc3891-eba8-4cf1-893e-4fd341f98103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:55.006530 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-dffc3891-eba8-4cf1-893e-4fd341f98103 None None] MFA Rules not processed for user `8f0dd32880d14ec9990bc09685d26326`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:55.007797 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-dffc3891-eba8-4cf1-893e-4fd341f98103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:55.105771 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7109f2-f7c8-48a9-9022-6400c0c2de64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:55.135868 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 830/1659] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Aug 23 01:52:54 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:55.163244 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc3891-eba8-4cf1-893e-4fd341f98103 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:55.167331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-dffc3891-eba8-4cf1-893e-4fd341f98103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:55.195818 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7109f2-f7c8-48a9-9022-6400c0c2de64 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:55.219214 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 830/1660] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:55.341494 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc3891-eba8-4cf1-893e-4fd341f98103 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:55.348268 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aede85d-4575-4b88-be51-d1bdf99a8cd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:55.348889 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aede85d-4575-4b88-be51-d1bdf99a8cd4 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:55.349177 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aede85d-4575-4b88-be51-d1bdf99a8cd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:55.349449 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aede85d-4575-4b88-be51-d1bdf99a8cd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:55.386033 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aede85d-4575-4b88-be51-d1bdf99a8cd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:55.510266 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aede85d-4575-4b88-be51-d1bdf99a8cd4 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:55.524301 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 831/1661] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:55 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:55.645742 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7109f2-f7c8-48a9-9022-6400c0c2de64 service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:55.647328 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1f7109f2-f7c8-48a9-9022-6400c0c2de64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:55.809982 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7109f2-f7c8-48a9-9022-6400c0c2de64 service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:55.821599 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee6768-e9b3-4027-a0e7-9014461910bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e4cab3c8cb4a18bf3c1a8a85d1675c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:55.823231 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee6768-e9b3-4027-a0e7-9014461910bb service swift] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:55.824441 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee6768-e9b3-4027-a0e7-9014461910bb service swift] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:55.824737 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee6768-e9b3-4027-a0e7-9014461910bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:55.839734 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee6768-e9b3-4027-a0e7-9014461910bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:55.907402 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee6768-e9b3-4027-a0e7-9014461910bb service swift] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:55.931713 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 831/1662] 10.222.0.20 () {60 vars in 1385 bytes} [Mon Aug 23 01:52:55 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 01:52:56.099362 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aede85d-4575-4b88-be51-d1bdf99a8cd4 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:56.110376 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aede85d-4575-4b88-be51-d1bdf99a8cd4 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:56.115638 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ff3e8-4673-4f79-b31f-36f6d6e18f61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:56.116710 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ff3e8-4673-4f79-b31f-36f6d6e18f61 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:56.117216 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ff3e8-4673-4f79-b31f-36f6d6e18f61 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:56.118451 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ff3e8-4673-4f79-b31f-36f6d6e18f61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:56.121915 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-8b9ff3e8-4673-4f79-b31f-36f6d6e18f61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:56.251864 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee6768-e9b3-4027-a0e7-9014461910bb service swift] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:56.253216 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1fee6768-e9b3-4027-a0e7-9014461910bb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:56.281774 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee6768-e9b3-4027-a0e7-9014461910bb service swift] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:56.293043 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f307764-a334-47a6-bbce-3be4c3ba3878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:56.293855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f307764-a334-47a6-bbce-3be4c3ba3878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:56.294096 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f307764-a334-47a6-bbce-3be4c3ba3878 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:56.294379 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f307764-a334-47a6-bbce-3be4c3ba3878 admin admin] PATH_INFO: `/v3/projects/2b9ef8c31aa54d34b2c72fb8eaf210ff` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:56.301470 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f307764-a334-47a6-bbce-3be4c3ba3878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b9ef8c31aa54d34b2c72fb8eaf210ff)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:56.374121 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ff3e8-4673-4f79-b31f-36f6d6e18f61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:56.383779 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f307764-a334-47a6-bbce-3be4c3ba3878 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:56.424437 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ff3e8-4673-4f79-b31f-36f6d6e18f61 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:56.448168 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 832/1663] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:56 2021] GET /identity/v3/auth/tokens => generated 3670 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:56.449539 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39acfa-081c-4fd3-ba54-0b64f8832f9b None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:56.449856 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39acfa-081c-4fd3-ba54-0b64f8832f9b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:56.452308 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39acfa-081c-4fd3-ba54-0b64f8832f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:56.543003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-2f39acfa-081c-4fd3-ba54-0b64f8832f9b None None] MFA Rules not processed for user `3b6dbf69f7d344b7973747af9cb118ec`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:56.545407 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7f307764-a334-47a6-bbce-3be4c3ba3878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b9ef8c31aa54d34b2c72fb8eaf210ff', 'request_id': 'req-7f307764-a334-47a6-bbce-3be4c3ba3878'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:56.548070 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2f39acfa-081c-4fd3-ba54-0b64f8832f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:56.566854 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7f307764-a334-47a6-bbce-3be4c3ba3878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b9ef8c31aa54d34b2c72fb8eaf210ff', 'request_id': 'req-7f307764-a334-47a6-bbce-3be4c3ba3878'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:56.615895 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7f307764-a334-47a6-bbce-3be4c3ba3878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b9ef8c31aa54d34b2c72fb8eaf210ff', 'request_id': 'req-7f307764-a334-47a6-bbce-3be4c3ba3878'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:56.758737 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7f307764-a334-47a6-bbce-3be4c3ba3878 admin admin] The token cache is being invalidate because project 2b9ef8c31aa54d34b2c72fb8eaf210ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:52:56.759022 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7f307764-a334-47a6-bbce-3be4c3ba3878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:56.760692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7f307764-a334-47a6-bbce-3be4c3ba3878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:56.764575 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 832/1664] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:52:56 2021] DELETE /identity/v3/projects/2b9ef8c31aa54d34b2c72fb8eaf210ff => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:52:56.768931 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f307764-a334-47a6-bbce-3be4c3ba3878 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:56.771970 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-7f307764-a334-47a6-bbce-3be4c3ba3878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:56.790714 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 833/1665] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:56 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:56.791986 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39acfa-081c-4fd3-ba54-0b64f8832f9b None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:56.801091 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2f39acfa-081c-4fd3-ba54-0b64f8832f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:56.970497 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f307764-a334-47a6-bbce-3be4c3ba3878 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:56.981466 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b59ec-5727-404b-b2d4-23ec0f65434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:56.981466 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b59ec-5727-404b-b2d4-23ec0f65434b admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:56.981466 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b59ec-5727-404b-b2d4-23ec0f65434b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:56.981466 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b59ec-5727-404b-b2d4-23ec0f65434b admin admin] PATH_INFO: `/v3/users/628f034060964576bdf90de8730432ef` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:56.984846 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b59ec-5727-404b-b2d4-23ec0f65434b admin admin] RBAC: Authorizing `identity:delete_user(user_id=628f034060964576bdf90de8730432ef)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:56.993978 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39acfa-081c-4fd3-ba54-0b64f8832f9b None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:57.011830 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db1c75-cca7-4b60-bb12-5fd9c5d6fdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:57.012664 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db1c75-cca7-4b60-bb12-5fd9c5d6fdee admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:57.012978 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db1c75-cca7-4b60-bb12-5fd9c5d6fdee admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:57.013249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db1c75-cca7-4b60-bb12-5fd9c5d6fdee admin admin] PATH_INFO: `/v3/projects/18af26ca094d4ff680483334b92f8325` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:57.014373 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db1c75-cca7-4b60-bb12-5fd9c5d6fdee admin admin] RBAC: Authorizing `identity:delete_project(project_id=18af26ca094d4ff680483334b92f8325)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:57.052382 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b59ec-5727-404b-b2d4-23ec0f65434b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:57.059296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db1c75-cca7-4b60-bb12-5fd9c5d6fdee admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:57.339422 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-41db1c75-cca7-4b60-bb12-5fd9c5d6fdee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18af26ca094d4ff680483334b92f8325', 'request_id': 'req-41db1c75-cca7-4b60-bb12-5fd9c5d6fdee'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:57.354015 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ee4b59ec-5727-404b-b2d4-23ec0f65434b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '628f034060964576bdf90de8730432ef'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:57.354931 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ee4b59ec-5727-404b-b2d4-23ec0f65434b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '628f034060964576bdf90de8730432ef'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:57.365857 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-41db1c75-cca7-4b60-bb12-5fd9c5d6fdee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18af26ca094d4ff680483334b92f8325', 'request_id': 'req-41db1c75-cca7-4b60-bb12-5fd9c5d6fdee'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:57.409068 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-41db1c75-cca7-4b60-bb12-5fd9c5d6fdee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18af26ca094d4ff680483334b92f8325', 'request_id': 'req-41db1c75-cca7-4b60-bb12-5fd9c5d6fdee'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:57.428357 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ee4b59ec-5727-404b-b2d4-23ec0f65434b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '628f034060964576bdf90de8730432ef'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:57.437771 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ee4b59ec-5727-404b-b2d4-23ec0f65434b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '628f034060964576bdf90de8730432ef'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:57.446292 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ee4b59ec-5727-404b-b2d4-23ec0f65434b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '628f034060964576bdf90de8730432ef'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:57.519456 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 833/1666] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:52:56 2021] DELETE /identity/v3/users/628f034060964576bdf90de8730432ef => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:57.520405 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b59ec-5727-404b-b2d4-23ec0f65434b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:57.524266 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ee4b59ec-5727-404b-b2d4-23ec0f65434b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:57.558140 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-41db1c75-cca7-4b60-bb12-5fd9c5d6fdee admin admin] The token cache is being invalidate because project 18af26ca094d4ff680483334b92f8325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:52:57.558526 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-41db1c75-cca7-4b60-bb12-5fd9c5d6fdee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:57.560737 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-41db1c75-cca7-4b60-bb12-5fd9c5d6fdee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:57.568934 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 834/1667] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:52:56 2021] DELETE /identity/v3/projects/18af26ca094d4ff680483334b92f8325 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:57.568934 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134750e-9f21-41da-92c1-e0ff4e49e200 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:57.569580 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134750e-9f21-41da-92c1-e0ff4e49e200 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:57.569945 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134750e-9f21-41da-92c1-e0ff4e49e200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:57.646973 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b59ec-5727-404b-b2d4-23ec0f65434b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:57.655104 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35297ba-fce2-47f5-80a8-0a71321edfe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:57.655810 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35297ba-fce2-47f5-80a8-0a71321edfe1 service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:57.659129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35297ba-fce2-47f5-80a8-0a71321edfe1 service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:57.659129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35297ba-fce2-47f5-80a8-0a71321edfe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:57.659899 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-b35297ba-fce2-47f5-80a8-0a71321edfe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:57.729742 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-5134750e-9f21-41da-92c1-e0ff4e49e200 None None] MFA Rules not processed for user `7172c19e3f7c4f92bf53305e9f5325d6`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:57.731915 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5134750e-9f21-41da-92c1-e0ff4e49e200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:57.779886 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35297ba-fce2-47f5-80a8-0a71321edfe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:57.808003 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35297ba-fce2-47f5-80a8-0a71321edfe1 service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:57.822361 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 834/1668] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:57 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:57.824236 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea7b92-8a46-48ae-8a10-7f922fdd4891 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:57.824786 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea7b92-8a46-48ae-8a10-7f922fdd4891 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:57.825535 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea7b92-8a46-48ae-8a10-7f922fdd4891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:57.858144 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-ccea7b92-8a46-48ae-8a10-7f922fdd4891 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:57.859785 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ccea7b92-8a46-48ae-8a10-7f922fdd4891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:57.893823 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 835/1669] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:57 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:57.906178 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134750e-9f21-41da-92c1-e0ff4e49e200 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:57.907623 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5134750e-9f21-41da-92c1-e0ff4e49e200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:57.925637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134750e-9f21-41da-92c1-e0ff4e49e200 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:57.931584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca18662-4303-4d64-8c2d-35852b598ed8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:57.932420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca18662-4303-4d64-8c2d-35852b598ed8 service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:57.932704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca18662-4303-4d64-8c2d-35852b598ed8 service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:57.933102 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca18662-4303-4d64-8c2d-35852b598ed8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:57.942995 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca18662-4303-4d64-8c2d-35852b598ed8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:58.001453 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca18662-4303-4d64-8c2d-35852b598ed8 service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:58.011567 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 835/1670] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:58.017884 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 836/1671] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:52:57 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:52:58.019853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f8840-42cb-4184-9d45-2837c62ce618 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:58.020796 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f8840-42cb-4184-9d45-2837c62ce618 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:58.021336 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f8840-42cb-4184-9d45-2837c62ce618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:58.059389 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-0f0f8840-42cb-4184-9d45-2837c62ce618 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:58.060737 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0f0f8840-42cb-4184-9d45-2837c62ce618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:58.094293 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 836/1672] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:52:58.098608 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca18662-4303-4d64-8c2d-35852b598ed8 service nova] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:58.110155 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f8840-42cb-4184-9d45-2837c62ce618 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:58.112543 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0f0f8840-42cb-4184-9d45-2837c62ce618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:58.118761 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca18662-4303-4d64-8c2d-35852b598ed8 service nova] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:58.130025 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f8840-42cb-4184-9d45-2837c62ce618 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:58.137431 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8673e1-14ec-4b2e-a2c8-d96075ef0712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:58.138983 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8673e1-14ec-4b2e-a2c8-d96075ef0712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:58.139535 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8673e1-14ec-4b2e-a2c8-d96075ef0712 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:58.139952 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8673e1-14ec-4b2e-a2c8-d96075ef0712 admin admin] PATH_INFO: `/v3/projects/573631a3cf9c47eaab2b74f2038eb5e8` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:58.141736 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8673e1-14ec-4b2e-a2c8-d96075ef0712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=573631a3cf9c47eaab2b74f2038eb5e8)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:58.157396 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21240602-3eed-4c6d-9f40-7e3c6fa3c1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:58.158995 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21240602-3eed-4c6d-9f40-7e3c6fa3c1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:58.159290 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21240602-3eed-4c6d-9f40-7e3c6fa3c1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:58.159573 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21240602-3eed-4c6d-9f40-7e3c6fa3c1c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:58.161611 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21240602-3eed-4c6d-9f40-7e3c6fa3c1c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:52:58.161920 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21240602-3eed-4c6d-9f40-7e3c6fa3c1c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:58.209818 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8673e1-14ec-4b2e-a2c8-d96075ef0712 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:58.252874 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21240602-3eed-4c6d-9f40-7e3c6fa3c1c0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:58.276077 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 837/1673] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:52:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:52:58.280282 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21240602-3eed-4c6d-9f40-7e3c6fa3c1c0 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:58.290381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21240602-3eed-4c6d-9f40-7e3c6fa3c1c0 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:58.296446 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a75e3f-e948-4223-93ec-a7e3b43661b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:58.299637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a75e3f-e948-4223-93ec-a7e3b43661b2 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:58.299637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a75e3f-e948-4223-93ec-a7e3b43661b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:58.299637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a75e3f-e948-4223-93ec-a7e3b43661b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:58.299637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a75e3f-e948-4223-93ec-a7e3b43661b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:58.345381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a75e3f-e948-4223-93ec-a7e3b43661b2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:58.382715 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ce8673e1-14ec-4b2e-a2c8-d96075ef0712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '573631a3cf9c47eaab2b74f2038eb5e8', 'request_id': 'req-ce8673e1-14ec-4b2e-a2c8-d96075ef0712'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:58.391077 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ce8673e1-14ec-4b2e-a2c8-d96075ef0712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '573631a3cf9c47eaab2b74f2038eb5e8', 'request_id': 'req-ce8673e1-14ec-4b2e-a2c8-d96075ef0712'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:58.425784 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ce8673e1-14ec-4b2e-a2c8-d96075ef0712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '573631a3cf9c47eaab2b74f2038eb5e8', 'request_id': 'req-ce8673e1-14ec-4b2e-a2c8-d96075ef0712'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:58.495139 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 838/1674] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:52:58 2021] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:52:58.499813 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a75e3f-e948-4223-93ec-a7e3b43661b2 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:58.552072 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ce8673e1-14ec-4b2e-a2c8-d96075ef0712 admin admin] The token cache is being invalidate because project 573631a3cf9c47eaab2b74f2038eb5e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:52:58.552365 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ce8673e1-14ec-4b2e-a2c8-d96075ef0712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:58.553085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ce8673e1-14ec-4b2e-a2c8-d96075ef0712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:52:58.556540 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 837/1675] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:52:58 2021] DELETE /identity/v3/projects/573631a3cf9c47eaab2b74f2038eb5e8 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:58.562288 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f7cee-96f0-4d17-94e7-1ac0d640d71f None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:58.562572 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f7cee-96f0-4d17-94e7-1ac0d640d71f None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:58.562850 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f7cee-96f0-4d17-94e7-1ac0d640d71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:58.643624 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-ac3f7cee-96f0-4d17-94e7-1ac0d640d71f None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:58.645950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ac3f7cee-96f0-4d17-94e7-1ac0d640d71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:58.647891 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a75e3f-e948-4223-93ec-a7e3b43661b2 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:58.654625 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97b652-cc10-4cea-8ac5-8b58cd231aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:58.655505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97b652-cc10-4cea-8ac5-8b58cd231aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:58.659649 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97b652-cc10-4cea-8ac5-8b58cd231aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:58.659649 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97b652-cc10-4cea-8ac5-8b58cd231aa0 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:58.659649 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97b652-cc10-4cea-8ac5-8b58cd231aa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:58.682920 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 838/1676] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:52:58.684403 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ade86-3c4e-4b03-bd9b-28b077036e80 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:58.685715 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ade86-3c4e-4b03-bd9b-28b077036e80 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:58.686269 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ade86-3c4e-4b03-bd9b-28b077036e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:58.697594 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97b652-cc10-4cea-8ac5-8b58cd231aa0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:58.741711 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-f23ade86-3c4e-4b03-bd9b-28b077036e80 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:58.743393 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f23ade86-3c4e-4b03-bd9b-28b077036e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:58.753005 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 839/1677] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:58.756801 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ade86-3c4e-4b03-bd9b-28b077036e80 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:58.770288 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ade86-3c4e-4b03-bd9b-28b077036e80 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:58.776462 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f6404-e12a-4417-8468-c358afe849a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:58.777212 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f6404-e12a-4417-8468-c358afe849a3 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:58.777600 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f6404-e12a-4417-8468-c358afe849a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:58.778025 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f6404-e12a-4417-8468-c358afe849a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:58.779717 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f6404-e12a-4417-8468-c358afe849a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:52:58.779911 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f6404-e12a-4417-8468-c358afe849a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:58.811925 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f6404-e12a-4417-8468-c358afe849a3 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:58.830318 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 840/1678] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:52:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:52:58.834197 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f6404-e12a-4417-8468-c358afe849a3 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:58.851607 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 839/1679] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:52:58 2021] POST /identity/v3/users => generated 290 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:58.857691 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97b652-cc10-4cea-8ac5-8b58cd231aa0 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:58.859539 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-bf97b652-cc10-4cea-8ac5-8b58cd231aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:58.860903 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f6404-e12a-4417-8468-c358afe849a3 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:58.876858 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97b652-cc10-4cea-8ac5-8b58cd231aa0 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:58.877285 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae05009-3984-42a9-98d7-79848278ab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:58.879166 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae05009-3984-42a9-98d7-79848278ab36 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:58.880242 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae05009-3984-42a9-98d7-79848278ab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:58.881890 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae05009-3984-42a9-98d7-79848278ab36 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:58.883315 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c3868-f3dd-4972-8415-982d508ed6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:58.883755 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c3868-f3dd-4972-8415-982d508ed6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:58.883861 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae05009-3984-42a9-98d7-79848278ab36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:58.884419 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c3868-f3dd-4972-8415-982d508ed6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:58.885169 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c3868-f3dd-4972-8415-982d508ed6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:58.886153 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c3868-f3dd-4972-8415-982d508ed6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:58.915025 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c3868-f3dd-4972-8415-982d508ed6d0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:58.927900 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 840/1680] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:58 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:52:58.932692 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c3868-f3dd-4972-8415-982d508ed6d0 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:58.967645 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae05009-3984-42a9-98d7-79848278ab36 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:58.968529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c3868-f3dd-4972-8415-982d508ed6d0 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:58.985954 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc9bdd-722c-445d-883c-54fc8aaf5781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:58.987211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc9bdd-722c-445d-883c-54fc8aaf5781 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:58.987642 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc9bdd-722c-445d-883c-54fc8aaf5781 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:58.988057 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc9bdd-722c-445d-883c-54fc8aaf5781 admin admin] PATH_INFO: `/v3/projects/4ae7b1aab1514cc69bac722c0eaee1ab/users/f90f30beb7954b5b96f646d8ba92fea6/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:59.015391 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc9bdd-722c-445d-883c-54fc8aaf5781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae7b1aab1514cc69bac722c0eaee1ab, user_id=f90f30beb7954b5b96f646d8ba92fea6, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:59.042304 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc9bdd-722c-445d-883c-54fc8aaf5781 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:59.198496 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 841/1681] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:58 2021] PUT /identity/v3/projects/4ae7b1aab1514cc69bac722c0eaee1ab/users/f90f30beb7954b5b96f646d8ba92fea6/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:52:59.199266 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 841/1682] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:52:58 2021] POST /identity/v3/projects => generated 363 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:52:59.199618 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc9bdd-722c-445d-883c-54fc8aaf5781 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:59.200042 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c85431-f96a-4e32-b609-4001a46aa40b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:59.200486 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c85431-f96a-4e32-b609-4001a46aa40b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:59.201474 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c85431-f96a-4e32-b609-4001a46aa40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:59.258277 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-64c85431-f96a-4e32-b609-4001a46aa40b None None] MFA Rules not processed for user `f90f30beb7954b5b96f646d8ba92fea6`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:52:59.273856 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-64c85431-f96a-4e32-b609-4001a46aa40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:52:59.308740 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc9bdd-722c-445d-883c-54fc8aaf5781 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:59.468096 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 842/1683] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:52:59 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:52:59.470701 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c85431-f96a-4e32-b609-4001a46aa40b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:59.518657 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5cd01-1ea4-4751-bb18-49d9f2ddc7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:59.522045 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5cd01-1ea4-4751-bb18-49d9f2ddc7c2 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:59.522482 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5cd01-1ea4-4751-bb18-49d9f2ddc7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:59.522928 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5cd01-1ea4-4751-bb18-49d9f2ddc7c2 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:59.524687 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5cd01-1ea4-4751-bb18-49d9f2ddc7c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:59.601201 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5cd01-1ea4-4751-bb18-49d9f2ddc7c2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:59.674130 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c85431-f96a-4e32-b609-4001a46aa40b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:59.684234 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc84cb-1e46-49ca-aa71-f056c43fe9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:59.685047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc84cb-1e46-49ca-aa71-f056c43fe9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:59.685531 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc84cb-1e46-49ca-aa71-f056c43fe9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:59.689322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc84cb-1e46-49ca-aa71-f056c43fe9a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:59.690082 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc84cb-1e46-49ca-aa71-f056c43fe9a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:59.757173 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc84cb-1e46-49ca-aa71-f056c43fe9a3 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:59.761134 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 842/1684] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:52:59 2021] POST /identity/v3/users => generated 282 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:59.765545 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5cd01-1ea4-4751-bb18-49d9f2ddc7c2 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:59.795457 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5cd01-1ea4-4751-bb18-49d9f2ddc7c2 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:52:59.814741 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d68ff-0045-4711-99ca-0d956fc5562e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:52:59.816276 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d68ff-0045-4711-99ca-0d956fc5562e admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:52:59.817185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d68ff-0045-4711-99ca-0d956fc5562e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:52:59.817673 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d68ff-0045-4711-99ca-0d956fc5562e admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:52:59.820412 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d68ff-0045-4711-99ca-0d956fc5562e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:52:59.921058 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 843/1685] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:52:59 2021] POST /identity/v3/projects => generated 381 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:52:59.927728 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d68ff-0045-4711-99ca-0d956fc5562e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:52:59.952530 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 843/1686] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:52:59 2021] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:52:59.954307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc84cb-1e46-49ca-aa71-f056c43fe9a3 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:59.955684 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d68ff-0045-4711-99ca-0d956fc5562e admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:52:59.988633 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d68ff-0045-4711-99ca-0d956fc5562e admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:00.120145 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9e84a-36ba-4978-b850-097f2880c37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:00.121181 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e84a-36ba-4978-b850-097f2880c37c admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:00.121588 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e84a-36ba-4978-b850-097f2880c37c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:00.121898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e84a-36ba-4978-b850-097f2880c37c admin admin] PATH_INFO: `/v3/projects/b3a30a76732b482cb8196fdac65359ad/users/ff1c76afc6d74a01a05813ebaf5ed940/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:00.152168 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc84cb-1e46-49ca-aa71-f056c43fe9a3 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:00.155287 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9e84a-36ba-4978-b850-097f2880c37c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a30a76732b482cb8196fdac65359ad, user_id=ff1c76afc6d74a01a05813ebaf5ed940, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:00.161564 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141a97c-2f21-4173-b1fe-cbdfbfe4a4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:00.164118 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141a97c-2f21-4173-b1fe-cbdfbfe4a4e6 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:00.164468 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141a97c-2f21-4173-b1fe-cbdfbfe4a4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:00.164790 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141a97c-2f21-4173-b1fe-cbdfbfe4a4e6 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:00.165518 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141a97c-2f21-4173-b1fe-cbdfbfe4a4e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:00.218235 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9e84a-36ba-4978-b850-097f2880c37c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:00.225798 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141a97c-2f21-4173-b1fe-cbdfbfe4a4e6 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:00.366011 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 844/1687] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:52:59 2021] PUT /identity/v3/projects/b3a30a76732b482cb8196fdac65359ad/users/ff1c76afc6d74a01a05813ebaf5ed940/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:00.379965 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 844/1688] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:52:59 2021] POST /identity/v3/users => generated 297 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:00.413294 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141a97c-2f21-4173-b1fe-cbdfbfe4a4e6 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:00.414370 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7719fe-d62c-48f0-8de4-4cc5466b3411 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:00.415133 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7719fe-d62c-48f0-8de4-4cc5466b3411 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:00.415398 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7719fe-d62c-48f0-8de4-4cc5466b3411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:00.437567 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141a97c-2f21-4173-b1fe-cbdfbfe4a4e6 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:00.469842 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-4f7719fe-d62c-48f0-8de4-4cc5466b3411 None None] MFA Rules not processed for user `eedaf4b880f24ac48ee6e04b75059ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:00.472218 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4f7719fe-d62c-48f0-8de4-4cc5466b3411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:00.599270 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 845/1689] 10.222.0.21 () {58 vars in 1016 bytes} [Mon Aug 23 01:53:00 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:00.599270 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fe1b9-8fdc-4136-9550-467d0c9d5973 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:00.599270 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fe1b9-8fdc-4136-9550-467d0c9d5973 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:00.599270 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fe1b9-8fdc-4136-9550-467d0c9d5973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:00.601189 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e0b56-153d-4843-b0b0-142520dd1c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:00.601877 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e0b56-153d-4843-b0b0-142520dd1c9e admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:00.602190 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e0b56-153d-4843-b0b0-142520dd1c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:00.602517 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e0b56-153d-4843-b0b0-142520dd1c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:00.603220 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e0b56-153d-4843-b0b0-142520dd1c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:00.673764 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e0b56-153d-4843-b0b0-142520dd1c9e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:00.691860 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-021fe1b9-8fdc-4136-9550-467d0c9d5973 None None] MFA Rules not processed for user `ff1c76afc6d74a01a05813ebaf5ed940`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:00.693049 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-021fe1b9-8fdc-4136-9550-467d0c9d5973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:00.704486 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 845/1690] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:00 2021] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:00.708505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b75a7e-c267-48f3-b51b-ea62b52cd340 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:00.708730 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b75a7e-c267-48f3-b51b-ea62b52cd340 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:00.708868 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b75a7e-c267-48f3-b51b-ea62b52cd340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:00.784996 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-91b75a7e-c267-48f3-b51b-ea62b52cd340 None None] MFA Rules not processed for user `0d118f35f5c549908cd605a753e4f93b`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:00.786693 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-91b75a7e-c267-48f3-b51b-ea62b52cd340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:00.863275 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 846/1691] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:00 2021] POST /identity/v3/auth/tokens => generated 3670 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:00.866908 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fe1b9-8fdc-4136-9550-467d0c9d5973 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:00.890383 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 846/1692] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:00 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:00.891716 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b75a7e-c267-48f3-b51b-ea62b52cd340 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:00.893428 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-91b75a7e-c267-48f3-b51b-ea62b52cd340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:00.908831 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fe1b9-8fdc-4136-9550-467d0c9d5973 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:00.916706 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b75a7e-c267-48f3-b51b-ea62b52cd340 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:00.921658 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fa2d1-7d33-4ec1-becc-8de95a215ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:00.922495 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fa2d1-7d33-4ec1-becc-8de95a215ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:00.922779 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fa2d1-7d33-4ec1-becc-8de95a215ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:00.923055 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fa2d1-7d33-4ec1-becc-8de95a215ccc admin admin] PATH_INFO: `/v3/projects/4c4153c929904b15b8db6badb0cb0bb6/users/9b27b81a9fac42b4b9e18471abecd756/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:00.928227 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c9260-5dec-4aa6-8139-082324f2b3a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:00.929882 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c9260-5dec-4aa6-8139-082324f2b3a8 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:00.931111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c9260-5dec-4aa6-8139-082324f2b3a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:00.931456 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c9260-5dec-4aa6-8139-082324f2b3a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:00.953115 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c9260-5dec-4aa6-8139-082324f2b3a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:00.976945 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fa2d1-7d33-4ec1-becc-8de95a215ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4153c929904b15b8db6badb0cb0bb6, user_id=9b27b81a9fac42b4b9e18471abecd756, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:01.014900 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c9260-5dec-4aa6-8139-082324f2b3a8 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:01.037540 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 847/1693] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:00 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:01.039317 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fa2d1-7d33-4ec1-becc-8de95a215ccc admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:01.039556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c9260-5dec-4aa6-8139-082324f2b3a8 service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:01.059649 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c9260-5dec-4aa6-8139-082324f2b3a8 service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:01.068751 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07002d5f-3977-4f3c-8657-7b79eb8ecc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:01.068751 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07002d5f-3977-4f3c-8657-7b79eb8ecc36 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:01.068751 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07002d5f-3977-4f3c-8657-7b79eb8ecc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:01.069023 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07002d5f-3977-4f3c-8657-7b79eb8ecc36 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:01.069687 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07002d5f-3977-4f3c-8657-7b79eb8ecc36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:01.113234 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07002d5f-3977-4f3c-8657-7b79eb8ecc36 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:01.132428 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 847/1694] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:00 2021] PUT /identity/v3/projects/4c4153c929904b15b8db6badb0cb0bb6/users/9b27b81a9fac42b4b9e18471abecd756/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:01.137196 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b51f5-b128-406c-bef7-438e80fd35b8 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:01.138447 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b51f5-b128-406c-bef7-438e80fd35b8 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:01.138734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b51f5-b128-406c-bef7-438e80fd35b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:01.183634 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-a14b51f5-b128-406c-bef7-438e80fd35b8 None None] MFA Rules not processed for user `0d118f35f5c549908cd605a753e4f93b`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:01.188144 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a14b51f5-b128-406c-bef7-438e80fd35b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:01.277317 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 848/1695] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:01 2021] POST /identity/v3/projects => generated 363 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:01.281955 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07002d5f-3977-4f3c-8657-7b79eb8ecc36 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:01.308853 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 848/1696] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:01 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:01.311787 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b51f5-b128-406c-bef7-438e80fd35b8 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:01.469153 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07002d5f-3977-4f3c-8657-7b79eb8ecc36 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:01.480282 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6579d-f65f-48c5-9bab-addb1102c89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:01.481428 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6579d-f65f-48c5-9bab-addb1102c89d admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:01.482633 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6579d-f65f-48c5-9bab-addb1102c89d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:01.483298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6579d-f65f-48c5-9bab-addb1102c89d admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:01.484295 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6579d-f65f-48c5-9bab-addb1102c89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:01.508778 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b51f5-b128-406c-bef7-438e80fd35b8 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:01.526408 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12653940-ca54-429b-a08d-9f492963c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:01.527095 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12653940-ca54-429b-a08d-9f492963c79c admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:01.527387 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12653940-ca54-429b-a08d-9f492963c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:01.527665 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12653940-ca54-429b-a08d-9f492963c79c admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:01.528365 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12653940-ca54-429b-a08d-9f492963c79c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:01.579785 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6579d-f65f-48c5-9bab-addb1102c89d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:01.594014 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12653940-ca54-429b-a08d-9f492963c79c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:01.619749 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 849/1697] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:01 2021] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:01.620640 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6579d-f65f-48c5-9bab-addb1102c89d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:01.643212 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-01c6579d-f65f-48c5-9bab-addb1102c89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:01.707576 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 849/1698] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:01 2021] POST /identity/v3/users => generated 288 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:01.708556 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12653940-ca54-429b-a08d-9f492963c79c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:01.729570 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12653940-ca54-429b-a08d-9f492963c79c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:01.742382 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121997e-017d-4b5b-936b-5b70454622d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:01.743217 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121997e-017d-4b5b-936b-5b70454622d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:01.743575 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121997e-017d-4b5b-936b-5b70454622d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:01.743866 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121997e-017d-4b5b-936b-5b70454622d9 admin admin] PATH_INFO: `/v3/projects/4c4153c929904b15b8db6badb0cb0bb6/users/9b27b81a9fac42b4b9e18471abecd756/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:01.748082 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121997e-017d-4b5b-936b-5b70454622d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4153c929904b15b8db6badb0cb0bb6, user_id=9b27b81a9fac42b4b9e18471abecd756, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:01.804220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121997e-017d-4b5b-936b-5b70454622d9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:01.833151 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 850/1699] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:01 2021] PUT /identity/v3/projects/4c4153c929904b15b8db6badb0cb0bb6/users/9b27b81a9fac42b4b9e18471abecd756/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:01.836993 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121997e-017d-4b5b-936b-5b70454622d9 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:01.838778 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a121997e-017d-4b5b-936b-5b70454622d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:01.895031 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6579d-f65f-48c5-9bab-addb1102c89d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:02.002325 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121997e-017d-4b5b-936b-5b70454622d9 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:02.010418 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66e1f5-fd4e-4b00-8a56-b56c90079ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:02.011240 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66e1f5-fd4e-4b00-8a56-b56c90079ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:02.011536 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66e1f5-fd4e-4b00-8a56-b56c90079ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:02.011820 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66e1f5-fd4e-4b00-8a56-b56c90079ec0 admin admin] PATH_INFO: `/v3/users/962efe2404de4b8e89eddcd9af4c6c0c` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:02.021531 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66e1f5-fd4e-4b00-8a56-b56c90079ec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=962efe2404de4b8e89eddcd9af4c6c0c)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:02.093889 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66e1f5-fd4e-4b00-8a56-b56c90079ec0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:02.158688 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa494e0-13e1-4d2e-aae8-52ec91f41ab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:02.159322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa494e0-13e1-4d2e-aae8-52ec91f41ab6 service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:02.159944 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa494e0-13e1-4d2e-aae8-52ec91f41ab6 service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:02.160241 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa494e0-13e1-4d2e-aae8-52ec91f41ab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:02.302746 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa494e0-13e1-4d2e-aae8-52ec91f41ab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:02.359550 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa494e0-13e1-4d2e-aae8-52ec91f41ab6 service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:02.376198 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 850/1700] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:01 2021] GET /identity/v3/auth/tokens => generated 3698 bytes in 756 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:02.377267 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa494e0-13e1-4d2e-aae8-52ec91f41ab6 service nova] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:02.395558 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa494e0-13e1-4d2e-aae8-52ec91f41ab6 service nova] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:02.402438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa463e-4cf8-48fb-8bbf-8ec2acd67713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:02.403297 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa463e-4cf8-48fb-8bbf-8ec2acd67713 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:02.403591 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa463e-4cf8-48fb-8bbf-8ec2acd67713 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:02.404435 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa463e-4cf8-48fb-8bbf-8ec2acd67713 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:02.405178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa463e-4cf8-48fb-8bbf-8ec2acd67713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:02.430382 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6c66e1f5-fd4e-4b00-8a56-b56c90079ec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '962efe2404de4b8e89eddcd9af4c6c0c'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:02.445030 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa463e-4cf8-48fb-8bbf-8ec2acd67713 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:02.462977 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 851/1701] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:02 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:02.464024 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa463e-4cf8-48fb-8bbf-8ec2acd67713 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:02.486760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa463e-4cf8-48fb-8bbf-8ec2acd67713 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:02.494451 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f357a0-0fdf-41ae-ad4b-2e6eb8124d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:02.495097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f357a0-0fdf-41ae-ad4b-2e6eb8124d30 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:02.495387 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f357a0-0fdf-41ae-ad4b-2e6eb8124d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:02.495681 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f357a0-0fdf-41ae-ad4b-2e6eb8124d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:02.496518 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f357a0-0fdf-41ae-ad4b-2e6eb8124d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:02.536781 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6c66e1f5-fd4e-4b00-8a56-b56c90079ec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '962efe2404de4b8e89eddcd9af4c6c0c'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:02.537683 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6c66e1f5-fd4e-4b00-8a56-b56c90079ec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '962efe2404de4b8e89eddcd9af4c6c0c'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:02.546503 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6c66e1f5-fd4e-4b00-8a56-b56c90079ec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '962efe2404de4b8e89eddcd9af4c6c0c'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:02.547292 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f357a0-0fdf-41ae-ad4b-2e6eb8124d30 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:02.547747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6c66e1f5-fd4e-4b00-8a56-b56c90079ec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '962efe2404de4b8e89eddcd9af4c6c0c'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:02.576725 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 852/1702] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:02 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:02.576725 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f357a0-0fdf-41ae-ad4b-2e6eb8124d30 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:02.577811 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-b9f357a0-0fdf-41ae-ad4b-2e6eb8124d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:02.598622 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 851/1703] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:01 2021] DELETE /identity/v3/users/962efe2404de4b8e89eddcd9af4c6c0c => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:02.600075 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66e1f5-fd4e-4b00-8a56-b56c90079ec0 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:02.604747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-6c66e1f5-fd4e-4b00-8a56-b56c90079ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:02.614552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f357a0-0fdf-41ae-ad4b-2e6eb8124d30 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:02.788333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f0346-df90-42a5-9c78-5be88eb4085d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:02.790415 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f0346-df90-42a5-9c78-5be88eb4085d admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:02.790714 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f0346-df90-42a5-9c78-5be88eb4085d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:02.791014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f0346-df90-42a5-9c78-5be88eb4085d admin admin] PATH_INFO: `/v3/projects/e4658196a2c14a2f8082294e4d2aa7e0/users/a1f609ffa11d4c8aaf30527dbd5cd631/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:02.827946 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f0346-df90-42a5-9c78-5be88eb4085d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4658196a2c14a2f8082294e4d2aa7e0, user_id=a1f609ffa11d4c8aaf30527dbd5cd631, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:02.831668 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66e1f5-fd4e-4b00-8a56-b56c90079ec0 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:02.838993 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7da81-df0e-48dd-ad5f-671b364c96c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:02.840151 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7da81-df0e-48dd-ad5f-671b364c96c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:02.841036 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7da81-df0e-48dd-ad5f-671b364c96c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:02.842161 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7da81-df0e-48dd-ad5f-671b364c96c5 admin admin] PATH_INFO: `/v3/projects/4c4153c929904b15b8db6badb0cb0bb6/users/9b27b81a9fac42b4b9e18471abecd756/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:02.846133 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7da81-df0e-48dd-ad5f-671b364c96c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4153c929904b15b8db6badb0cb0bb6, user_id=9b27b81a9fac42b4b9e18471abecd756, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:02.905805 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f0346-df90-42a5-9c78-5be88eb4085d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:02.921469 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7da81-df0e-48dd-ad5f-671b364c96c5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:03.033803 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 853/1704] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:02 2021] PUT /identity/v3/projects/e4658196a2c14a2f8082294e4d2aa7e0/users/a1f609ffa11d4c8aaf30527dbd5cd631/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:03.038540 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b08b22-92c8-4078-b0f9-1b89fb327d4b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:03.039094 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b08b22-92c8-4078-b0f9-1b89fb327d4b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:03.039326 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b08b22-92c8-4078-b0f9-1b89fb327d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:03.085112 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 852/1705] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:02 2021] PUT /identity/v3/projects/4c4153c929904b15b8db6badb0cb0bb6/users/9b27b81a9fac42b4b9e18471abecd756/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:03.086178 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7da81-df0e-48dd-ad5f-671b364c96c5 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:03.094531 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-39b08b22-92c8-4078-b0f9-1b89fb327d4b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:03.095809 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-39b08b22-92c8-4078-b0f9-1b89fb327d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:03.206254 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 854/1706] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:03.208426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2ae15-516a-4fa0-b101-eff5ae132cd2 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:03.208927 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2ae15-516a-4fa0-b101-eff5ae132cd2 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:03.209347 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2ae15-516a-4fa0-b101-eff5ae132cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:03.267338 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7da81-df0e-48dd-ad5f-671b364c96c5 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:03.271144 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-82a2ae15-516a-4fa0-b101-eff5ae132cd2 None None] MFA Rules not processed for user `9b27b81a9fac42b4b9e18471abecd756`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:03.273238 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-82a2ae15-516a-4fa0-b101-eff5ae132cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:03.276546 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8582982-c573-4e38-a0f2-d0249aeb7efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:03.277269 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8582982-c573-4e38-a0f2-d0249aeb7efd admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:03.277486 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8582982-c573-4e38-a0f2-d0249aeb7efd admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:03.277760 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8582982-c573-4e38-a0f2-d0249aeb7efd admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:03.278474 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8582982-c573-4e38-a0f2-d0249aeb7efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:03.331594 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8582982-c573-4e38-a0f2-d0249aeb7efd admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:03.366838 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 853/1707] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:03 2021] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:03.366838 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8582982-c573-4e38-a0f2-d0249aeb7efd admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:03.389477 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-e8582982-c573-4e38-a0f2-d0249aeb7efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:03.454179 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 855/1708] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:03 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:03.460144 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2ae15-516a-4fa0-b101-eff5ae132cd2 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:03.484118 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2ae15-516a-4fa0-b101-eff5ae132cd2 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:03.504915 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0488ac-46bf-4018-9041-baeb66bf17a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:03.506101 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0488ac-46bf-4018-9041-baeb66bf17a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:03.506390 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0488ac-46bf-4018-9041-baeb66bf17a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:03.506885 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0488ac-46bf-4018-9041-baeb66bf17a2 admin admin] PATH_INFO: `/v3/projects/e4658196a2c14a2f8082294e4d2aa7e0/users/a1f609ffa11d4c8aaf30527dbd5cd631/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:03.508738 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0488ac-46bf-4018-9041-baeb66bf17a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4658196a2c14a2f8082294e4d2aa7e0, user_id=a1f609ffa11d4c8aaf30527dbd5cd631, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:03.541524 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0488ac-46bf-4018-9041-baeb66bf17a2 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:03.558964 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 856/1709] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:03 2021] PUT /identity/v3/projects/e4658196a2c14a2f8082294e4d2aa7e0/users/a1f609ffa11d4c8aaf30527dbd5cd631/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:03.563363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0488ac-46bf-4018-9041-baeb66bf17a2 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:03.575079 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8582982-c573-4e38-a0f2-d0249aeb7efd admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:03.715474 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209aefb4-7ee6-4771-8ba6-8d0520d3e543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:03.719422 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209aefb4-7ee6-4771-8ba6-8d0520d3e543 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:03.719985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209aefb4-7ee6-4771-8ba6-8d0520d3e543 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:03.720274 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209aefb4-7ee6-4771-8ba6-8d0520d3e543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:03.739773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0488ac-46bf-4018-9041-baeb66bf17a2 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:03.758065 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda97a7-fe6a-4659-9e05-775a44064259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:03.760685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda97a7-fe6a-4659-9e05-775a44064259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:03.760685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda97a7-fe6a-4659-9e05-775a44064259 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:03.760685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda97a7-fe6a-4659-9e05-775a44064259 admin admin] PATH_INFO: `/v3/users/f90f30beb7954b5b96f646d8ba92fea6` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:03.760685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda97a7-fe6a-4659-9e05-775a44064259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f90f30beb7954b5b96f646d8ba92fea6)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:03.799147 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209aefb4-7ee6-4771-8ba6-8d0520d3e543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:03.827175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda97a7-fe6a-4659-9e05-775a44064259 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:03.859448 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209aefb4-7ee6-4771-8ba6-8d0520d3e543 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:03.890381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 854/1710] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:03.892028 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209aefb4-7ee6-4771-8ba6-8d0520d3e543 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:03.910572 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209aefb4-7ee6-4771-8ba6-8d0520d3e543 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:03.929558 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbb75e-6189-4304-b2ee-d1edd9b4e427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:03.930247 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbb75e-6189-4304-b2ee-d1edd9b4e427 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:03.930589 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbb75e-6189-4304-b2ee-d1edd9b4e427 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:03.930919 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbb75e-6189-4304-b2ee-d1edd9b4e427 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:03.931638 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbb75e-6189-4304-b2ee-d1edd9b4e427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:04.008679 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbb75e-6189-4304-b2ee-d1edd9b4e427 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:04.030471 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 855/1711] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:03 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:04.034620 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbb75e-6189-4304-b2ee-d1edd9b4e427 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:04.045446 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbb75e-6189-4304-b2ee-d1edd9b4e427 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:04.050637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604ed38-67e4-44df-bbad-455ed1d600f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:04.064641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604ed38-67e4-44df-bbad-455ed1d600f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:04.065076 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604ed38-67e4-44df-bbad-455ed1d600f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:04.065540 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604ed38-67e4-44df-bbad-455ed1d600f3 admin admin] PATH_INFO: `/v3/projects/e4658196a2c14a2f8082294e4d2aa7e0/users/a1f609ffa11d4c8aaf30527dbd5cd631/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:04.069421 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604ed38-67e4-44df-bbad-455ed1d600f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4658196a2c14a2f8082294e4d2aa7e0, user_id=a1f609ffa11d4c8aaf30527dbd5cd631, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:04.119106 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604ed38-67e4-44df-bbad-455ed1d600f3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:04.145211 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8dda97a7-fe6a-4659-9e05-775a44064259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f90f30beb7954b5b96f646d8ba92fea6'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:04.146527 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8dda97a7-fe6a-4659-9e05-775a44064259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f90f30beb7954b5b96f646d8ba92fea6'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:04.218161 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 856/1712] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:04 2021] PUT /identity/v3/projects/e4658196a2c14a2f8082294e4d2aa7e0/users/a1f609ffa11d4c8aaf30527dbd5cd631/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:04.229320 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b601a-3664-4043-a151-7ba4bb91b38c None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:04.229603 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b601a-3664-4043-a151-7ba4bb91b38c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:04.229890 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b601a-3664-4043-a151-7ba4bb91b38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:04.237821 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8dda97a7-fe6a-4659-9e05-775a44064259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f90f30beb7954b5b96f646d8ba92fea6'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:04.251142 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8dda97a7-fe6a-4659-9e05-775a44064259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f90f30beb7954b5b96f646d8ba92fea6'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:04.251898 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8dda97a7-fe6a-4659-9e05-775a44064259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f90f30beb7954b5b96f646d8ba92fea6'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:04.314817 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 857/1713] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:03 2021] DELETE /identity/v3/users/f90f30beb7954b5b96f646d8ba92fea6 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:04.316381 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d084b-2918-4b6f-b8ac-937b09beaa09 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:04.316704 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d084b-2918-4b6f-b8ac-937b09beaa09 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:04.316994 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d084b-2918-4b6f-b8ac-937b09beaa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:04.330524 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-867b601a-3664-4043-a151-7ba4bb91b38c None None] MFA Rules not processed for user `a1f609ffa11d4c8aaf30527dbd5cd631`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:04.336329 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-867b601a-3664-4043-a151-7ba4bb91b38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:04.372977 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-322d084b-2918-4b6f-b8ac-937b09beaa09 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:04.373768 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-322d084b-2918-4b6f-b8ac-937b09beaa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:04.569345 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 858/1714] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:53:04.574391 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38283f91-c825-4783-b134-2ec123485290 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:04.574391 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38283f91-c825-4783-b134-2ec123485290 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:04.574391 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38283f91-c825-4783-b134-2ec123485290 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:04.574391 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 859/1715] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 23 01:53:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:53:04.596501 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 857/1716] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:04 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:04.608684 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38283f91-c825-4783-b134-2ec123485290 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:04.610506 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-38283f91-c825-4783-b134-2ec123485290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:04.620153 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdef56-db92-4b8a-b203-9baa20af8be1 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:04.620453 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdef56-db92-4b8a-b203-9baa20af8be1 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:04.620848 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdef56-db92-4b8a-b203-9baa20af8be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:04.686816 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-4ccdef56-db92-4b8a-b203-9baa20af8be1 None None] MFA Rules not processed for user `094c5e571da7480584098ba6ebcb70ed`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:04.688143 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4ccdef56-db92-4b8a-b203-9baa20af8be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:04.759759 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38283f91-c825-4783-b134-2ec123485290 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:04.764320 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3462d35-bd9a-4d44-ac3f-2417589a8d41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:04.765807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3462d35-bd9a-4d44-ac3f-2417589a8d41 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:04.766320 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3462d35-bd9a-4d44-ac3f-2417589a8d41 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:04.766914 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3462d35-bd9a-4d44-ac3f-2417589a8d41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:04.782847 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3462d35-bd9a-4d44-ac3f-2417589a8d41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:04.886290 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3462d35-bd9a-4d44-ac3f-2417589a8d41 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:04.900184 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 858/1717] 10.222.0.20 () {58 vars in 1019 bytes} [Mon Aug 23 01:53:04 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:53:04.903180 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdef56-db92-4b8a-b203-9baa20af8be1 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:04.907716 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4ccdef56-db92-4b8a-b203-9baa20af8be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:04.923928 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 860/1718] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:04 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:05.070240 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdef56-db92-4b8a-b203-9baa20af8be1 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:05.075118 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d2a29-9a69-4a87-9a92-55a5b04ac3d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:05.075118 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d2a29-9a69-4a87-9a92-55a5b04ac3d9 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:05.075118 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d2a29-9a69-4a87-9a92-55a5b04ac3d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:05.075482 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d2a29-9a69-4a87-9a92-55a5b04ac3d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:05.090395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d2a29-9a69-4a87-9a92-55a5b04ac3d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:05.132338 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d2a29-9a69-4a87-9a92-55a5b04ac3d9 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:05.145221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 859/1719] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:05.509585 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3462d35-bd9a-4d44-ac3f-2417589a8d41 service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:05.511080 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-d3462d35-bd9a-4d44-ac3f-2417589a8d41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:05.533950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3462d35-bd9a-4d44-ac3f-2417589a8d41 service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:05.540514 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28765b0e-862c-4d92-94df-7360f35f5bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:05.542293 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28765b0e-862c-4d92-94df-7360f35f5bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:05.542293 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28765b0e-862c-4d92-94df-7360f35f5bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:05.542598 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28765b0e-862c-4d92-94df-7360f35f5bc9 admin admin] PATH_INFO: `/v3/users/ff1c76afc6d74a01a05813ebaf5ed940` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:05.544739 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28765b0e-862c-4d92-94df-7360f35f5bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1c76afc6d74a01a05813ebaf5ed940)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:05.582456 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28765b0e-862c-4d92-94df-7360f35f5bc9 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:05.640944 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d2a29-9a69-4a87-9a92-55a5b04ac3d9 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:05.642889 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-655d2a29-9a69-4a87-9a92-55a5b04ac3d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:05.677546 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d2a29-9a69-4a87-9a92-55a5b04ac3d9 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:05.691377 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1494d2a-38c4-4d17-b0ac-afa105d68cc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:05.692066 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1494d2a-38c4-4d17-b0ac-afa105d68cc1 service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:05.692437 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1494d2a-38c4-4d17-b0ac-afa105d68cc1 service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:05.696367 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1494d2a-38c4-4d17-b0ac-afa105d68cc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:05.726885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1494d2a-38c4-4d17-b0ac-afa105d68cc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:05.776284 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1494d2a-38c4-4d17-b0ac-afa105d68cc1 service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:05.808067 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 860/1720] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:05 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:05.817201 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27431d7-2e65-409c-a7f9-4cb302c325c8 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:05.817583 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27431d7-2e65-409c-a7f9-4cb302c325c8 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:05.817943 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27431d7-2e65-409c-a7f9-4cb302c325c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:05.845545 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-28765b0e-862c-4d92-94df-7360f35f5bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1c76afc6d74a01a05813ebaf5ed940'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:05.847441 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-28765b0e-862c-4d92-94df-7360f35f5bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1c76afc6d74a01a05813ebaf5ed940'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:05.900136 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-a27431d7-2e65-409c-a7f9-4cb302c325c8 None None] MFA Rules not processed for user `0d118f35f5c549908cd605a753e4f93b`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:05.901639 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a27431d7-2e65-409c-a7f9-4cb302c325c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:05.937464 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-28765b0e-862c-4d92-94df-7360f35f5bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1c76afc6d74a01a05813ebaf5ed940'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:05.962751 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-28765b0e-862c-4d92-94df-7360f35f5bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1c76afc6d74a01a05813ebaf5ed940'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:05.965096 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-28765b0e-862c-4d92-94df-7360f35f5bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1c76afc6d74a01a05813ebaf5ed940'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:06.058632 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 861/1721] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:05 2021] DELETE /identity/v3/users/ff1c76afc6d74a01a05813ebaf5ed940 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:06.065331 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d5b7-846e-4aed-9fd9-b2d0618a4be6 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:06.068089 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d5b7-846e-4aed-9fd9-b2d0618a4be6 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:06.069774 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d5b7-846e-4aed-9fd9-b2d0618a4be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:06.168970 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 861/1722] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:05 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:06.172178 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957bbcb-7b75-40c4-a1ca-cc175d3f06ff None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:06.172475 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957bbcb-7b75-40c4-a1ca-cc175d3f06ff None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:06.172780 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957bbcb-7b75-40c4-a1ca-cc175d3f06ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:06.182116 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-be53d5b7-846e-4aed-9fd9-b2d0618a4be6 None None] MFA Rules not processed for user `7172c19e3f7c4f92bf53305e9f5325d6`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:06.186079 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-be53d5b7-846e-4aed-9fd9-b2d0618a4be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:06.266845 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-3957bbcb-7b75-40c4-a1ca-cc175d3f06ff None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:06.268075 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-3957bbcb-7b75-40c4-a1ca-cc175d3f06ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:06.420646 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 862/1723] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:06.483176 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957bbcb-7b75-40c4-a1ca-cc175d3f06ff None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:06.484498 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-3957bbcb-7b75-40c4-a1ca-cc175d3f06ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:06.501405 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 862/1724] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:06 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:06.713920 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957bbcb-7b75-40c4-a1ca-cc175d3f06ff None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:06.718101 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4869dc-fb8c-4951-b592-b3568b0d928c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:06.718762 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4869dc-fb8c-4951-b592-b3568b0d928c service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:06.719053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4869dc-fb8c-4951-b592-b3568b0d928c service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:06.719335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4869dc-fb8c-4951-b592-b3568b0d928c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:06.748447 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4869dc-fb8c-4951-b592-b3568b0d928c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:06.777549 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4869dc-fb8c-4951-b592-b3568b0d928c service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:06.803072 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 863/1725] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:06.828320 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53d5b7-846e-4aed-9fd9-b2d0618a4be6 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:06.829898 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-be53d5b7-846e-4aed-9fd9-b2d0618a4be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:06.863583 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53d5b7-846e-4aed-9fd9-b2d0618a4be6 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:06.872873 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e32e40-a8ae-4da0-80ce-ab71dd4fabfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:06.873863 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e32e40-a8ae-4da0-80ce-ab71dd4fabfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:06.874153 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e32e40-a8ae-4da0-80ce-ab71dd4fabfc admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:06.874478 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e32e40-a8ae-4da0-80ce-ab71dd4fabfc admin admin] PATH_INFO: `/v3/users/526b9de70eff467c8d7eef583f9f25e4` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:06.885196 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e32e40-a8ae-4da0-80ce-ab71dd4fabfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=526b9de70eff467c8d7eef583f9f25e4)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:06.925477 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e32e40-a8ae-4da0-80ce-ab71dd4fabfc admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:06.965708 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9dd72-8b0a-4bd3-945d-b0276074e0d6 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:06.966849 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9dd72-8b0a-4bd3-945d-b0276074e0d6 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:06.967639 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9dd72-8b0a-4bd3-945d-b0276074e0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:07.036278 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-49c9dd72-8b0a-4bd3-945d-b0276074e0d6 None None] MFA Rules not processed for user `3b6dbf69f7d344b7973747af9cb118ec`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:07.040359 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-49c9dd72-8b0a-4bd3-945d-b0276074e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:07.148871 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 864/1726] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:06 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:07.164175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a7e32e40-a8ae-4da0-80ce-ab71dd4fabfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '526b9de70eff467c8d7eef583f9f25e4'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:07.165820 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a7e32e40-a8ae-4da0-80ce-ab71dd4fabfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '526b9de70eff467c8d7eef583f9f25e4'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:07.253114 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9dd72-8b0a-4bd3-945d-b0276074e0d6 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:07.260960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-49c9dd72-8b0a-4bd3-945d-b0276074e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:07.283247 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9dd72-8b0a-4bd3-945d-b0276074e0d6 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:07.285326 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a7e32e40-a8ae-4da0-80ce-ab71dd4fabfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '526b9de70eff467c8d7eef583f9f25e4'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:07.288742 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcc2f1-5ffd-4450-8f3b-7b448d5d2eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:07.289419 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcc2f1-5ffd-4450-8f3b-7b448d5d2eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:07.290212 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcc2f1-5ffd-4450-8f3b-7b448d5d2eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:07.290212 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcc2f1-5ffd-4450-8f3b-7b448d5d2eb4 admin admin] PATH_INFO: `/v3/projects/6401257028414f6f8c7c45a8fd30be18` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:07.293941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a7e32e40-a8ae-4da0-80ce-ab71dd4fabfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '526b9de70eff467c8d7eef583f9f25e4'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:07.294784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcc2f1-5ffd-4450-8f3b-7b448d5d2eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6401257028414f6f8c7c45a8fd30be18)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:07.295189 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a7e32e40-a8ae-4da0-80ce-ab71dd4fabfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '526b9de70eff467c8d7eef583f9f25e4'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:07.339653 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 863/1727] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:06 2021] DELETE /identity/v3/users/526b9de70eff467c8d7eef583f9f25e4 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:07.341942 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b2572-c626-4e23-914f-77c65d6c8aff None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:07.342239 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b2572-c626-4e23-914f-77c65d6c8aff None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:07.342516 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b2572-c626-4e23-914f-77c65d6c8aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:07.344818 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcc2f1-5ffd-4450-8f3b-7b448d5d2eb4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:07.367275 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-2c8b2572-c626-4e23-914f-77c65d6c8aff None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:07.368410 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-2c8b2572-c626-4e23-914f-77c65d6c8aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:07.512888 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 864/1728] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:07.514769 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b2572-c626-4e23-914f-77c65d6c8aff None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:07.529042 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-2c8b2572-c626-4e23-914f-77c65d6c8aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:07.558422 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b2572-c626-4e23-914f-77c65d6c8aff None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:07.565799 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed42d7a-6b19-40c1-803d-7963baf835bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:07.566872 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed42d7a-6b19-40c1-803d-7963baf835bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:07.567162 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed42d7a-6b19-40c1-803d-7963baf835bf admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:07.567440 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed42d7a-6b19-40c1-803d-7963baf835bf admin admin] PATH_INFO: `/v3/projects/4ae7b1aab1514cc69bac722c0eaee1ab` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:07.569001 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed42d7a-6b19-40c1-803d-7963baf835bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ae7b1aab1514cc69bac722c0eaee1ab)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:07.587919 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7fbcc2f1-5ffd-4450-8f3b-7b448d5d2eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6401257028414f6f8c7c45a8fd30be18', 'request_id': 'req-7fbcc2f1-5ffd-4450-8f3b-7b448d5d2eb4'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:07.594952 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7fbcc2f1-5ffd-4450-8f3b-7b448d5d2eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6401257028414f6f8c7c45a8fd30be18', 'request_id': 'req-7fbcc2f1-5ffd-4450-8f3b-7b448d5d2eb4'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:07.637680 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed42d7a-6b19-40c1-803d-7963baf835bf admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:07.638214 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7fbcc2f1-5ffd-4450-8f3b-7b448d5d2eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6401257028414f6f8c7c45a8fd30be18', 'request_id': 'req-7fbcc2f1-5ffd-4450-8f3b-7b448d5d2eb4'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:07.760032 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7fbcc2f1-5ffd-4450-8f3b-7b448d5d2eb4 admin admin] The token cache is being invalidate because project 6401257028414f6f8c7c45a8fd30be18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:07.761211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7fbcc2f1-5ffd-4450-8f3b-7b448d5d2eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:07.762306 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7fbcc2f1-5ffd-4450-8f3b-7b448d5d2eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:07.764687 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 865/1729] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:07 2021] DELETE /identity/v3/projects/6401257028414f6f8c7c45a8fd30be18 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:07.765977 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcc2f1-5ffd-4450-8f3b-7b448d5d2eb4 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:07.769727 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-7fbcc2f1-5ffd-4450-8f3b-7b448d5d2eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:07.882054 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-bed42d7a-6b19-40c1-803d-7963baf835bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae7b1aab1514cc69bac722c0eaee1ab', 'request_id': 'req-bed42d7a-6b19-40c1-803d-7963baf835bf'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:07.889995 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-bed42d7a-6b19-40c1-803d-7963baf835bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae7b1aab1514cc69bac722c0eaee1ab', 'request_id': 'req-bed42d7a-6b19-40c1-803d-7963baf835bf'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:07.903947 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-bed42d7a-6b19-40c1-803d-7963baf835bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae7b1aab1514cc69bac722c0eaee1ab', 'request_id': 'req-bed42d7a-6b19-40c1-803d-7963baf835bf'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:07.954364 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcc2f1-5ffd-4450-8f3b-7b448d5d2eb4 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:07.977637 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-bed42d7a-6b19-40c1-803d-7963baf835bf admin admin] The token cache is being invalidate because project 4ae7b1aab1514cc69bac722c0eaee1ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:07.977859 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-bed42d7a-6b19-40c1-803d-7963baf835bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:07.978461 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-bed42d7a-6b19-40c1-803d-7963baf835bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:07.981205 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 865/1730] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:07 2021] DELETE /identity/v3/projects/4ae7b1aab1514cc69bac722c0eaee1ab => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:07.982692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed42d7a-6b19-40c1-803d-7963baf835bf admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:07.983966 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-bed42d7a-6b19-40c1-803d-7963baf835bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:08.061433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098c9d7-828c-4f90-a2bf-da1504f5338b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:08.062097 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098c9d7-828c-4f90-a2bf-da1504f5338b service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:08.063023 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098c9d7-828c-4f90-a2bf-da1504f5338b service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:08.063607 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098c9d7-828c-4f90-a2bf-da1504f5338b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:08.065851 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4098c9d7-828c-4f90-a2bf-da1504f5338b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:08.168182 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed42d7a-6b19-40c1-803d-7963baf835bf admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:08.168441 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098c9d7-828c-4f90-a2bf-da1504f5338b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:08.186778 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234c6ae-2ef4-4638-a37a-6ac983fcb5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:08.187742 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234c6ae-2ef4-4638-a37a-6ac983fcb5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:08.188110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234c6ae-2ef4-4638-a37a-6ac983fcb5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:08.188739 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234c6ae-2ef4-4638-a37a-6ac983fcb5d8 admin admin] PATH_INFO: `/v3/users/312825f8524a4ee6bb1e4781ea61265e` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:08.190382 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234c6ae-2ef4-4638-a37a-6ac983fcb5d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=312825f8524a4ee6bb1e4781ea61265e)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:08.199467 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098c9d7-828c-4f90-a2bf-da1504f5338b service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:08.218241 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 866/1731] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:08.236671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098c9d7-828c-4f90-a2bf-da1504f5338b service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:08.240330 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4098c9d7-828c-4f90-a2bf-da1504f5338b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:08.277813 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098c9d7-828c-4f90-a2bf-da1504f5338b service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:08.282534 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234c6ae-2ef4-4638-a37a-6ac983fcb5d8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:08.292974 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20ea6e-98b5-4343-b591-92f5b372740d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:08.293802 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20ea6e-98b5-4343-b591-92f5b372740d admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:08.294116 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20ea6e-98b5-4343-b591-92f5b372740d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:08.294446 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20ea6e-98b5-4343-b591-92f5b372740d admin admin] PATH_INFO: `/v3/users/9b27b81a9fac42b4b9e18471abecd756` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:08.302978 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20ea6e-98b5-4343-b591-92f5b372740d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b27b81a9fac42b4b9e18471abecd756)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:08.383345 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20ea6e-98b5-4343-b591-92f5b372740d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:08.633113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f234c6ae-2ef4-4638-a37a-6ac983fcb5d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '312825f8524a4ee6bb1e4781ea61265e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:08.634117 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f234c6ae-2ef4-4638-a37a-6ac983fcb5d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '312825f8524a4ee6bb1e4781ea61265e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:08.792317 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-dc20ea6e-98b5-4343-b591-92f5b372740d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b27b81a9fac42b4b9e18471abecd756'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:08.838360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f234c6ae-2ef4-4638-a37a-6ac983fcb5d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '312825f8524a4ee6bb1e4781ea61265e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:08.850009 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f234c6ae-2ef4-4638-a37a-6ac983fcb5d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '312825f8524a4ee6bb1e4781ea61265e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:08.850711 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f234c6ae-2ef4-4638-a37a-6ac983fcb5d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '312825f8524a4ee6bb1e4781ea61265e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:08.910842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 866/1732] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:07 2021] DELETE /identity/v3/users/312825f8524a4ee6bb1e4781ea61265e => generated 0 bytes in 897 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:08.910842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234c6ae-2ef4-4638-a37a-6ac983fcb5d8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:08.913651 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f234c6ae-2ef4-4638-a37a-6ac983fcb5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:08.936399 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-dc20ea6e-98b5-4343-b591-92f5b372740d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b27b81a9fac42b4b9e18471abecd756'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:08.937237 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-dc20ea6e-98b5-4343-b591-92f5b372740d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b27b81a9fac42b4b9e18471abecd756'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:08.951022 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-dc20ea6e-98b5-4343-b591-92f5b372740d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b27b81a9fac42b4b9e18471abecd756'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:08.951814 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-dc20ea6e-98b5-4343-b591-92f5b372740d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b27b81a9fac42b4b9e18471abecd756'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:08.995467 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 867/1733] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:08 2021] DELETE /identity/v3/users/9b27b81a9fac42b4b9e18471abecd756 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:08.997580 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc13f5-c78a-43d9-bcb8-f4a1f3ec4c8b None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:08.997888 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc13f5-c78a-43d9-bcb8-f4a1f3ec4c8b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:08.998180 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc13f5-c78a-43d9-bcb8-f4a1f3ec4c8b None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:09.000280 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 868/1734] 10.222.0.20 () {54 vars in 912 bytes} [Mon Aug 23 01:53:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:53:09.006143 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31cb26-489b-45ea-b56e-2ba6d84c45cd None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:09.006421 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31cb26-489b-45ea-b56e-2ba6d84c45cd None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:09.007345 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31cb26-489b-45ea-b56e-2ba6d84c45cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:09.059735 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-fd31cb26-489b-45ea-b56e-2ba6d84c45cd None None] MFA Rules not processed for user `eedaf4b880f24ac48ee6e04b75059ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:09.061711 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-fd31cb26-489b-45ea-b56e-2ba6d84c45cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:09.080312 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234c6ae-2ef4-4638-a37a-6ac983fcb5d8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:09.140051 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 869/1735] 10.222.0.20 () {58 vars in 1010 bytes} [Mon Aug 23 01:53:09 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:53:09.152645 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31cb26-489b-45ea-b56e-2ba6d84c45cd None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:09.154687 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-fd31cb26-489b-45ea-b56e-2ba6d84c45cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:09.166062 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31cb26-489b-45ea-b56e-2ba6d84c45cd None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:09.170707 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a64c53-3cd8-467c-98ad-030b5dafbce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:09.171711 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a64c53-3cd8-467c-98ad-030b5dafbce5 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:09.172144 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a64c53-3cd8-467c-98ad-030b5dafbce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:09.172522 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a64c53-3cd8-467c-98ad-030b5dafbce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:09.181993 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a64c53-3cd8-467c-98ad-030b5dafbce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:09.216433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a64c53-3cd8-467c-98ad-030b5dafbce5 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:09.219409 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfa915-a546-4502-ab77-85781be3471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:09.220234 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfa915-a546-4502-ab77-85781be3471e admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:09.220526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfa915-a546-4502-ab77-85781be3471e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:09.222772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfa915-a546-4502-ab77-85781be3471e admin admin] PATH_INFO: `/v3/projects/b3a30a76732b482cb8196fdac65359ad` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:09.225646 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfa915-a546-4502-ab77-85781be3471e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3a30a76732b482cb8196fdac65359ad)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:09.228264 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 870/1736] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:09 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:53:09.259308 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfa915-a546-4502-ab77-85781be3471e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:09.409783 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a64c53-3cd8-467c-98ad-030b5dafbce5 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:09.413479 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-77a64c53-3cd8-467c-98ad-030b5dafbce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:09.431250 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7bdfa915-a546-4502-ab77-85781be3471e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a30a76732b482cb8196fdac65359ad', 'request_id': 'req-7bdfa915-a546-4502-ab77-85781be3471e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:09.449374 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7bdfa915-a546-4502-ab77-85781be3471e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a30a76732b482cb8196fdac65359ad', 'request_id': 'req-7bdfa915-a546-4502-ab77-85781be3471e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:09.456195 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a64c53-3cd8-467c-98ad-030b5dafbce5 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:09.487524 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7bdfa915-a546-4502-ab77-85781be3471e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a30a76732b482cb8196fdac65359ad', 'request_id': 'req-7bdfa915-a546-4502-ab77-85781be3471e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:09.571754 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7bdfa915-a546-4502-ab77-85781be3471e admin admin] The token cache is being invalidate because project b3a30a76732b482cb8196fdac65359ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:09.572104 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7bdfa915-a546-4502-ab77-85781be3471e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:09.573028 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7bdfa915-a546-4502-ab77-85781be3471e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:09.574912 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 867/1737] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:08 2021] DELETE /identity/v3/projects/b3a30a76732b482cb8196fdac65359ad => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:09.580650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfa915-a546-4502-ab77-85781be3471e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:09.582609 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-7bdfa915-a546-4502-ab77-85781be3471e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:09.612650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa98f2-8c1c-4ea8-bff3-c1eb87399e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:09.613514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa98f2-8c1c-4ea8-bff3-c1eb87399e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:09.613879 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa98f2-8c1c-4ea8-bff3-c1eb87399e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:09.615176 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa98f2-8c1c-4ea8-bff3-c1eb87399e37 admin admin] PATH_INFO: `/v3/projects/231bab5b4a3547539aeb2e5e6c9e8ba1` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:09.617375 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa98f2-8c1c-4ea8-bff3-c1eb87399e37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=231bab5b4a3547539aeb2e5e6c9e8ba1)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:09.672490 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa98f2-8c1c-4ea8-bff3-c1eb87399e37 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:09.730258 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfa915-a546-4502-ab77-85781be3471e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:09.739561 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c0ee1-562b-4657-ba69-642c900e3652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:09.741201 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c0ee1-562b-4657-ba69-642c900e3652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:09.741809 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c0ee1-562b-4657-ba69-642c900e3652 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:09.742684 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c0ee1-562b-4657-ba69-642c900e3652 admin admin] PATH_INFO: `/v3/users/a1f609ffa11d4c8aaf30527dbd5cd631` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:09.751592 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c0ee1-562b-4657-ba69-642c900e3652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f609ffa11d4c8aaf30527dbd5cd631)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:09.800133 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c0ee1-562b-4657-ba69-642c900e3652 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:09.837845 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-27aa98f2-8c1c-4ea8-bff3-c1eb87399e37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '231bab5b4a3547539aeb2e5e6c9e8ba1', 'request_id': 'req-27aa98f2-8c1c-4ea8-bff3-c1eb87399e37'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:09.859601 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-27aa98f2-8c1c-4ea8-bff3-c1eb87399e37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '231bab5b4a3547539aeb2e5e6c9e8ba1', 'request_id': 'req-27aa98f2-8c1c-4ea8-bff3-c1eb87399e37'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:09.875315 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-27aa98f2-8c1c-4ea8-bff3-c1eb87399e37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '231bab5b4a3547539aeb2e5e6c9e8ba1', 'request_id': 'req-27aa98f2-8c1c-4ea8-bff3-c1eb87399e37'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:10.020282 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-27aa98f2-8c1c-4ea8-bff3-c1eb87399e37 admin admin] The token cache is being invalidate because project 231bab5b4a3547539aeb2e5e6c9e8ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:10.020791 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-27aa98f2-8c1c-4ea8-bff3-c1eb87399e37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:10.025444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-27aa98f2-8c1c-4ea8-bff3-c1eb87399e37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:10.029130 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 871/1738] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:09 2021] DELETE /identity/v3/projects/231bab5b4a3547539aeb2e5e6c9e8ba1 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:10.030222 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa98f2-8c1c-4ea8-bff3-c1eb87399e37 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:10.034087 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-27aa98f2-8c1c-4ea8-bff3-c1eb87399e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:10.102578 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-e18c0ee1-562b-4657-ba69-642c900e3652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f609ffa11d4c8aaf30527dbd5cd631'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:10.103218 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-e18c0ee1-562b-4657-ba69-642c900e3652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f609ffa11d4c8aaf30527dbd5cd631'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:10.197504 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-e18c0ee1-562b-4657-ba69-642c900e3652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f609ffa11d4c8aaf30527dbd5cd631'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:10.216686 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-e18c0ee1-562b-4657-ba69-642c900e3652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f609ffa11d4c8aaf30527dbd5cd631'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:10.217634 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-e18c0ee1-562b-4657-ba69-642c900e3652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f609ffa11d4c8aaf30527dbd5cd631'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:10.220973 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa98f2-8c1c-4ea8-bff3-c1eb87399e37 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:10.236931 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdf358-e082-4fb5-9dbd-acfa9b887b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:10.238067 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdf358-e082-4fb5-9dbd-acfa9b887b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:10.238564 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdf358-e082-4fb5-9dbd-acfa9b887b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:10.238915 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdf358-e082-4fb5-9dbd-acfa9b887b40 admin admin] PATH_INFO: `/v3/projects/092f1f0c343b402d92659dda530c3797` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:10.241737 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdf358-e082-4fb5-9dbd-acfa9b887b40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=092f1f0c343b402d92659dda530c3797)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:10.266392 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 868/1739] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:09 2021] DELETE /identity/v3/users/a1f609ffa11d4c8aaf30527dbd5cd631 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:10.267524 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c0ee1-562b-4657-ba69-642c900e3652 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:10.269009 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e18c0ee1-562b-4657-ba69-642c900e3652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:10.365277 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdf358-e082-4fb5-9dbd-acfa9b887b40 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:10.439773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c0ee1-562b-4657-ba69-642c900e3652 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:10.445498 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b6846-72c7-4eb7-9794-286ae3d0d98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:10.446773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b6846-72c7-4eb7-9794-286ae3d0d98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:10.447265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b6846-72c7-4eb7-9794-286ae3d0d98f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:10.447787 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b6846-72c7-4eb7-9794-286ae3d0d98f admin admin] PATH_INFO: `/v3/users/7682b142a5a749f5b501d16d86f35663` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:10.449625 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b6846-72c7-4eb7-9794-286ae3d0d98f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7682b142a5a749f5b501d16d86f35663)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:10.495121 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b6846-72c7-4eb7-9794-286ae3d0d98f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:10.614708 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-cdcdf358-e082-4fb5-9dbd-acfa9b887b40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092f1f0c343b402d92659dda530c3797', 'request_id': 'req-cdcdf358-e082-4fb5-9dbd-acfa9b887b40'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:10.620349 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-cdcdf358-e082-4fb5-9dbd-acfa9b887b40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092f1f0c343b402d92659dda530c3797', 'request_id': 'req-cdcdf358-e082-4fb5-9dbd-acfa9b887b40'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:10.633433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-cdcdf358-e082-4fb5-9dbd-acfa9b887b40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092f1f0c343b402d92659dda530c3797', 'request_id': 'req-cdcdf358-e082-4fb5-9dbd-acfa9b887b40'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:10.735715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-cdcdf358-e082-4fb5-9dbd-acfa9b887b40 admin admin] The token cache is being invalidate because project 092f1f0c343b402d92659dda530c3797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:10.735877 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-cdcdf358-e082-4fb5-9dbd-acfa9b887b40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:10.736602 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-cdcdf358-e082-4fb5-9dbd-acfa9b887b40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:10.738824 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 872/1740] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:10 2021] DELETE /identity/v3/projects/092f1f0c343b402d92659dda530c3797 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:10.739775 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdf358-e082-4fb5-9dbd-acfa9b887b40 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:10.741402 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-cdcdf358-e082-4fb5-9dbd-acfa9b887b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:10.751950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-038b6846-72c7-4eb7-9794-286ae3d0d98f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7682b142a5a749f5b501d16d86f35663'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:10.752955 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-038b6846-72c7-4eb7-9794-286ae3d0d98f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7682b142a5a749f5b501d16d86f35663'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:10.852983 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdf358-e082-4fb5-9dbd-acfa9b887b40 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:10.856392 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69666c-63c2-4c9f-878d-2bca0535d678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:10.857312 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69666c-63c2-4c9f-878d-2bca0535d678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:10.857662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69666c-63c2-4c9f-878d-2bca0535d678 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:10.857898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69666c-63c2-4c9f-878d-2bca0535d678 admin admin] PATH_INFO: `/v3/projects/4c4153c929904b15b8db6badb0cb0bb6` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:10.859308 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69666c-63c2-4c9f-878d-2bca0535d678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4153c929904b15b8db6badb0cb0bb6)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:10.889323 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69666c-63c2-4c9f-878d-2bca0535d678 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:10.892207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-038b6846-72c7-4eb7-9794-286ae3d0d98f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7682b142a5a749f5b501d16d86f35663'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:10.907342 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-038b6846-72c7-4eb7-9794-286ae3d0d98f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7682b142a5a749f5b501d16d86f35663'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:10.908326 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-038b6846-72c7-4eb7-9794-286ae3d0d98f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7682b142a5a749f5b501d16d86f35663'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:10.953379 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 869/1741] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:10 2021] DELETE /identity/v3/users/7682b142a5a749f5b501d16d86f35663 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:10.954849 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139427b4-168e-4f6a-a6be-9523bcc71b4b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:10.955376 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139427b4-168e-4f6a-a6be-9523bcc71b4b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:10.955727 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139427b4-168e-4f6a-a6be-9523bcc71b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:10.981051 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-139427b4-168e-4f6a-a6be-9523bcc71b4b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:10.982335 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-139427b4-168e-4f6a-a6be-9523bcc71b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:11.033338 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ff69666c-63c2-4c9f-878d-2bca0535d678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4153c929904b15b8db6badb0cb0bb6', 'request_id': 'req-ff69666c-63c2-4c9f-878d-2bca0535d678'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:11.039028 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ff69666c-63c2-4c9f-878d-2bca0535d678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4153c929904b15b8db6badb0cb0bb6', 'request_id': 'req-ff69666c-63c2-4c9f-878d-2bca0535d678'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:11.053769 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ff69666c-63c2-4c9f-878d-2bca0535d678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4153c929904b15b8db6badb0cb0bb6', 'request_id': 'req-ff69666c-63c2-4c9f-878d-2bca0535d678'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:11.063396 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 870/1742] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:11.071412 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a0a34-26d7-48e8-8761-a476ccf6175f None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:11.071642 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a0a34-26d7-48e8-8761-a476ccf6175f None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:11.072079 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a0a34-26d7-48e8-8761-a476ccf6175f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:11.098493 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-1a0a0a34-26d7-48e8-8761-a476ccf6175f None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:11.099726 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1a0a0a34-26d7-48e8-8761-a476ccf6175f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:11.171337 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 871/1743] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:53:11.175626 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a0a34-26d7-48e8-8761-a476ccf6175f None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:11.186149 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a0a34-26d7-48e8-8761-a476ccf6175f None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:11.190670 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9f814-cd92-4fa8-8847-ff0a729eef57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:11.191281 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9f814-cd92-4fa8-8847-ff0a729eef57 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:11.191571 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9f814-cd92-4fa8-8847-ff0a729eef57 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:11.191853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9f814-cd92-4fa8-8847-ff0a729eef57 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:11.192644 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9f814-cd92-4fa8-8847-ff0a729eef57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:53:11.192951 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9f814-cd92-4fa8-8847-ff0a729eef57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:11.211097 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ff69666c-63c2-4c9f-878d-2bca0535d678 admin admin] The token cache is being invalidate because project 4c4153c929904b15b8db6badb0cb0bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:11.213409 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ff69666c-63c2-4c9f-878d-2bca0535d678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:11.213409 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ff69666c-63c2-4c9f-878d-2bca0535d678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:11.214140 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 873/1744] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:10 2021] DELETE /identity/v3/projects/4c4153c929904b15b8db6badb0cb0bb6 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:11.219770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6481756-3bee-41de-a844-bd80deb32a01 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:11.219770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6481756-3bee-41de-a844-bd80deb32a01 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:11.220106 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6481756-3bee-41de-a844-bd80deb32a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:11.220587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9f814-cd92-4fa8-8847-ff0a729eef57 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:11.234521 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 872/1745] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:53:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:53:11.239720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9f814-cd92-4fa8-8847-ff0a729eef57 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:11.241558 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-2bc9f814-cd92-4fa8-8847-ff0a729eef57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:11.246636 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-b6481756-3bee-41de-a844-bd80deb32a01 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:11.248390 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-b6481756-3bee-41de-a844-bd80deb32a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:11.255434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9f814-cd92-4fa8-8847-ff0a729eef57 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:11.257426 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 874/1746] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:11.261838 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2e40b-aeeb-4884-ad0c-9b086c5df04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:11.262488 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2e40b-aeeb-4884-ad0c-9b086c5df04c admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:11.263619 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2e40b-aeeb-4884-ad0c-9b086c5df04c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:11.264291 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2e40b-aeeb-4884-ad0c-9b086c5df04c admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:11.265093 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2e40b-aeeb-4884-ad0c-9b086c5df04c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:11.272698 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc64b2-ae0c-4671-80ac-99fad278100c None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:11.273316 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc64b2-ae0c-4671-80ac-99fad278100c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:11.274807 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc64b2-ae0c-4671-80ac-99fad278100c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:11.297125 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2e40b-aeeb-4884-ad0c-9b086c5df04c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:11.303095 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-fadc64b2-ae0c-4671-80ac-99fad278100c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:11.304273 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-fadc64b2-ae0c-4671-80ac-99fad278100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:11.319836 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 875/1747] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:53:11.320808 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc64b2-ae0c-4671-80ac-99fad278100c None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:11.322321 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-fadc64b2-ae0c-4671-80ac-99fad278100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:11.333867 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc64b2-ae0c-4671-80ac-99fad278100c None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:11.338586 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddc72e-5b49-4a22-8881-90529625b7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:11.339937 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddc72e-5b49-4a22-8881-90529625b7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:11.340332 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddc72e-5b49-4a22-8881-90529625b7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:11.340726 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddc72e-5b49-4a22-8881-90529625b7e2 admin admin] PATH_INFO: `/v3/projects/e4658196a2c14a2f8082294e4d2aa7e0` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:11.341933 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddc72e-5b49-4a22-8881-90529625b7e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4658196a2c14a2f8082294e4d2aa7e0)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:11.369386 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddc72e-5b49-4a22-8881-90529625b7e2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:11.443347 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 873/1748] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:11 2021] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:11.443347 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2e40b-aeeb-4884-ad0c-9b086c5df04c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:11.496658 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-32ddc72e-5b49-4a22-8881-90529625b7e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4658196a2c14a2f8082294e4d2aa7e0', 'request_id': 'req-32ddc72e-5b49-4a22-8881-90529625b7e2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:11.503206 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-32ddc72e-5b49-4a22-8881-90529625b7e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4658196a2c14a2f8082294e4d2aa7e0', 'request_id': 'req-32ddc72e-5b49-4a22-8881-90529625b7e2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:11.516635 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-32ddc72e-5b49-4a22-8881-90529625b7e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4658196a2c14a2f8082294e4d2aa7e0', 'request_id': 'req-32ddc72e-5b49-4a22-8881-90529625b7e2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:11.523660 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2e40b-aeeb-4884-ad0c-9b086c5df04c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:11.715941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de81f5a-41ff-4989-8c9f-2635aef12e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:11.715941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de81f5a-41ff-4989-8c9f-2635aef12e48 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:11.715941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de81f5a-41ff-4989-8c9f-2635aef12e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:11.715941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de81f5a-41ff-4989-8c9f-2635aef12e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:11.717005 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de81f5a-41ff-4989-8c9f-2635aef12e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:53:11.717005 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de81f5a-41ff-4989-8c9f-2635aef12e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:11.717005 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de81f5a-41ff-4989-8c9f-2635aef12e48 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:11.717005 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 874/1749] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:53:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:53:11.717005 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de81f5a-41ff-4989-8c9f-2635aef12e48 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:11.717005 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de81f5a-41ff-4989-8c9f-2635aef12e48 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:11.717874 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c97c14-607d-4bb0-8760-9bf1e6103c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:11.717874 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c97c14-607d-4bb0-8760-9bf1e6103c2d admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:11.717874 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c97c14-607d-4bb0-8760-9bf1e6103c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:11.717874 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c97c14-607d-4bb0-8760-9bf1e6103c2d admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:11.718187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c97c14-607d-4bb0-8760-9bf1e6103c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:11.718187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c97c14-607d-4bb0-8760-9bf1e6103c2d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:11.759095 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-32ddc72e-5b49-4a22-8881-90529625b7e2 admin admin] The token cache is being invalidate because project e4658196a2c14a2f8082294e4d2aa7e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:11.771311 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-32ddc72e-5b49-4a22-8881-90529625b7e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:11.771311 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-32ddc72e-5b49-4a22-8881-90529625b7e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:11.771311 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 876/1750] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:11 2021] DELETE /identity/v3/projects/e4658196a2c14a2f8082294e4d2aa7e0 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:11.771311 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddc72e-5b49-4a22-8881-90529625b7e2 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:11.771311 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-32ddc72e-5b49-4a22-8881-90529625b7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:11.775109 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddc72e-5b49-4a22-8881-90529625b7e2 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:11.779162 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91b123-bd34-4154-b4fc-bd09fe71be0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:11.779720 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91b123-bd34-4154-b4fc-bd09fe71be0c admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:11.780003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91b123-bd34-4154-b4fc-bd09fe71be0c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:11.780279 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91b123-bd34-4154-b4fc-bd09fe71be0c admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:11.780930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91b123-bd34-4154-b4fc-bd09fe71be0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:11.807872 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91b123-bd34-4154-b4fc-bd09fe71be0c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:11.920029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 875/1751] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:11 2021] POST /identity/v3/users => generated 284 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:11.920029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c7be4-b650-4e14-943f-65dcccf41f9e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:11.920029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c7be4-b650-4e14-943f-65dcccf41f9e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:11.920029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c7be4-b650-4e14-943f-65dcccf41f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:11.954457 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 877/1752] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:11 2021] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:11.955833 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91b123-bd34-4154-b4fc-bd09fe71be0c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:11.962137 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-8b91b123-bd34-4154-b4fc-bd09fe71be0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:11.971765 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-8b4c7be4-b650-4e14-943f-65dcccf41f9e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:11.973189 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-8b4c7be4-b650-4e14-943f-65dcccf41f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:12.104005 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91b123-bd34-4154-b4fc-bd09fe71be0c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:12.116201 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1f586-2a96-4c84-8829-8c59880284be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:12.116907 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1f586-2a96-4c84-8829-8c59880284be admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:12.117203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1f586-2a96-4c84-8829-8c59880284be admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:12.117646 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1f586-2a96-4c84-8829-8c59880284be admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:12.118523 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1f586-2a96-4c84-8829-8c59880284be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:12.150703 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1f586-2a96-4c84-8829-8c59880284be admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:12.181247 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 878/1753] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:11 2021] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:12.182120 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1f586-2a96-4c84-8829-8c59880284be admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:12.187944 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 876/1754] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:12.189566 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c7be4-b650-4e14-943f-65dcccf41f9e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:12.191019 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-8b4c7be4-b650-4e14-943f-65dcccf41f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:12.205764 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c7be4-b650-4e14-943f-65dcccf41f9e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:12.211076 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c16c2-7556-4ada-b9c5-fb7b75a1be84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:12.212598 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c16c2-7556-4ada-b9c5-fb7b75a1be84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:12.213061 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c16c2-7556-4ada-b9c5-fb7b75a1be84 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:12.213523 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c16c2-7556-4ada-b9c5-fb7b75a1be84 admin admin] PATH_INFO: `/v3/projects/9d7176eecfad460bb8f30e4d92d5c7bc` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:12.214998 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c16c2-7556-4ada-b9c5-fb7b75a1be84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d7176eecfad460bb8f30e4d92d5c7bc)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:12.224954 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1f586-2a96-4c84-8829-8c59880284be admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:12.239597 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285c993-4bb0-46d0-add3-af98c4f3cca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:12.240535 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285c993-4bb0-46d0-add3-af98c4f3cca7 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:12.240914 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285c993-4bb0-46d0-add3-af98c4f3cca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:12.241227 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285c993-4bb0-46d0-add3-af98c4f3cca7 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:12.241989 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285c993-4bb0-46d0-add3-af98c4f3cca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:12.253046 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c16c2-7556-4ada-b9c5-fb7b75a1be84 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:12.298448 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285c993-4bb0-46d0-add3-af98c4f3cca7 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:12.383173 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ba1c16c2-7556-4ada-b9c5-fb7b75a1be84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7176eecfad460bb8f30e4d92d5c7bc', 'request_id': 'req-ba1c16c2-7556-4ada-b9c5-fb7b75a1be84'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:12.395187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ba1c16c2-7556-4ada-b9c5-fb7b75a1be84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7176eecfad460bb8f30e4d92d5c7bc', 'request_id': 'req-ba1c16c2-7556-4ada-b9c5-fb7b75a1be84'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:12.423856 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 879/1755] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:12 2021] POST /identity/v3/users => generated 284 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:12.426124 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285c993-4bb0-46d0-add3-af98c4f3cca7 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:12.430146 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ba1c16c2-7556-4ada-b9c5-fb7b75a1be84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7176eecfad460bb8f30e4d92d5c7bc', 'request_id': 'req-ba1c16c2-7556-4ada-b9c5-fb7b75a1be84'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:12.446394 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285c993-4bb0-46d0-add3-af98c4f3cca7 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:12.520178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ba1c16c2-7556-4ada-b9c5-fb7b75a1be84 admin admin] The token cache is being invalidate because project 9d7176eecfad460bb8f30e4d92d5c7bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:12.528342 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ba1c16c2-7556-4ada-b9c5-fb7b75a1be84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:12.528342 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ba1c16c2-7556-4ada-b9c5-fb7b75a1be84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:12.528342 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 877/1756] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:12 2021] DELETE /identity/v3/projects/9d7176eecfad460bb8f30e4d92d5c7bc => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:12.528342 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b0cfe-e061-4592-ab28-fe4dce86a24e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:12.528342 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b0cfe-e061-4592-ab28-fe4dce86a24e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:12.528342 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b0cfe-e061-4592-ab28-fe4dce86a24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:12.566645 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcf0e1-772f-42bb-b4a9-951555da7ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:12.573304 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcf0e1-772f-42bb-b4a9-951555da7ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:12.573869 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcf0e1-772f-42bb-b4a9-951555da7ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:12.574393 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcf0e1-772f-42bb-b4a9-951555da7ea8 admin admin] PATH_INFO: `/v3/projects/3ce9aa95e51b44baac33d7ccc2611019/users/b04d4546f20a436f8c9c1a4959206bd7/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:12.584906 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-690b0cfe-e061-4592-ab28-fe4dce86a24e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:12.586647 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-690b0cfe-e061-4592-ab28-fe4dce86a24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:12.601799 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 878/1757] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:12.602453 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b0cfe-e061-4592-ab28-fe4dce86a24e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:12.605598 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcf0e1-772f-42bb-b4a9-951555da7ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce9aa95e51b44baac33d7ccc2611019, user_id=b04d4546f20a436f8c9c1a4959206bd7, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:12.605750 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-690b0cfe-e061-4592-ab28-fe4dce86a24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:12.630795 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b0cfe-e061-4592-ab28-fe4dce86a24e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:12.634225 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcf0e1-772f-42bb-b4a9-951555da7ea8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:12.643837 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8693a-e345-438e-8478-1f2c00a7e674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:12.650129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8693a-e345-438e-8478-1f2c00a7e674 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:12.650129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8693a-e345-438e-8478-1f2c00a7e674 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:12.650129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8693a-e345-438e-8478-1f2c00a7e674 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:12.650129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8693a-e345-438e-8478-1f2c00a7e674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:12.676235 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8693a-e345-438e-8478-1f2c00a7e674 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:12.691666 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 879/1758] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:12 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:12.691666 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f320997-b22b-4230-9387-3ad86bf1e01e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:12.691666 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f320997-b22b-4230-9387-3ad86bf1e01e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:12.691666 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f320997-b22b-4230-9387-3ad86bf1e01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:12.711882 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-0f320997-b22b-4230-9387-3ad86bf1e01e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:12.713116 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0f320997-b22b-4230-9387-3ad86bf1e01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:12.723640 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 880/1759] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:12.724460 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f320997-b22b-4230-9387-3ad86bf1e01e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:12.736059 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f320997-b22b-4230-9387-3ad86bf1e01e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:12.742380 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b34c6d-f7aa-49e9-b248-8e60b17ef657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:12.743052 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b34c6d-f7aa-49e9-b248-8e60b17ef657 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:12.743406 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b34c6d-f7aa-49e9-b248-8e60b17ef657 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:12.743748 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b34c6d-f7aa-49e9-b248-8e60b17ef657 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:12.744498 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b34c6d-f7aa-49e9-b248-8e60b17ef657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:53:12.744891 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b34c6d-f7aa-49e9-b248-8e60b17ef657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:12.774927 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b34c6d-f7aa-49e9-b248-8e60b17ef657 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:12.782030 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 880/1760] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:12 2021] PUT /identity/v3/projects/3ce9aa95e51b44baac33d7ccc2611019/users/b04d4546f20a436f8c9c1a4959206bd7/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:12.782999 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcf0e1-772f-42bb-b4a9-951555da7ea8 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:12.799148 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 881/1761] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:53:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:53:12.801662 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651bb19-4a6c-447e-bd20-0dc619082413 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:12.802062 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651bb19-4a6c-447e-bd20-0dc619082413 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:12.802346 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651bb19-4a6c-447e-bd20-0dc619082413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:12.832521 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-e651bb19-4a6c-447e-bd20-0dc619082413 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:12.833705 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e651bb19-4a6c-447e-bd20-0dc619082413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:12.934045 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 882/1762] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:12.936932 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea07623-6399-4a5c-b81f-59bfd639b865 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:12.937537 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea07623-6399-4a5c-b81f-59bfd639b865 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:12.938178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea07623-6399-4a5c-b81f-59bfd639b865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:12.975092 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcf0e1-772f-42bb-b4a9-951555da7ea8 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:12.980348 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db636d-352b-4c8e-9946-8750ecc6f91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:12.981209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db636d-352b-4c8e-9946-8750ecc6f91c admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:12.986722 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db636d-352b-4c8e-9946-8750ecc6f91c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:12.986722 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db636d-352b-4c8e-9946-8750ecc6f91c admin admin] PATH_INFO: `/v3/projects/3a4b672abbee4c61a0b8f5eec01cb459/users/53e722be3f3046c58958ab0cbd486ef6/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:12.986948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-fea07623-6399-4a5c-b81f-59bfd639b865 None None] MFA Rules not processed for user `b04d4546f20a436f8c9c1a4959206bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:12.986948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-fea07623-6399-4a5c-b81f-59bfd639b865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:13.002760 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db636d-352b-4c8e-9946-8750ecc6f91c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4b672abbee4c61a0b8f5eec01cb459, user_id=53e722be3f3046c58958ab0cbd486ef6, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:13.047395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db636d-352b-4c8e-9946-8750ecc6f91c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:13.094092 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 883/1763] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:12 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:13.094092 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea07623-6399-4a5c-b81f-59bfd639b865 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:13.107339 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea07623-6399-4a5c-b81f-59bfd639b865 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:13.112070 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d6d9d-9f40-43ee-b3db-1bd43984898a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:13.112962 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d6d9d-9f40-43ee-b3db-1bd43984898a admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:13.113318 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d6d9d-9f40-43ee-b3db-1bd43984898a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:13.114144 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d6d9d-9f40-43ee-b3db-1bd43984898a admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:13.114366 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d6d9d-9f40-43ee-b3db-1bd43984898a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:13.148595 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 881/1764] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:12 2021] PUT /identity/v3/projects/3a4b672abbee4c61a0b8f5eec01cb459/users/53e722be3f3046c58958ab0cbd486ef6/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:13.148595 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db636d-352b-4c8e-9946-8750ecc6f91c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:13.150756 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d6d9d-9f40-43ee-b3db-1bd43984898a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:13.261218 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db636d-352b-4c8e-9946-8750ecc6f91c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:13.266758 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a64c8-2c15-4794-b988-92c6453ad701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:13.267678 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a64c8-2c15-4794-b988-92c6453ad701 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:13.268069 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a64c8-2c15-4794-b988-92c6453ad701 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:13.268457 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a64c8-2c15-4794-b988-92c6453ad701 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:13.269455 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a64c8-2c15-4794-b988-92c6453ad701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:53:13.269879 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a64c8-2c15-4794-b988-92c6453ad701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:13.290843 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 884/1765] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:13 2021] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:13.294596 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d6d9d-9f40-43ee-b3db-1bd43984898a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:13.296208 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f08d6d9d-9f40-43ee-b3db-1bd43984898a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:13.312009 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a64c8-2c15-4794-b988-92c6453ad701 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:13.337576 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 882/1766] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:53:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:53:13.339934 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0ee8a-771b-44be-9466-e332396dad34 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:13.340414 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0ee8a-771b-44be-9466-e332396dad34 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:13.341115 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0ee8a-771b-44be-9466-e332396dad34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:13.394219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d6d9d-9f40-43ee-b3db-1bd43984898a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:13.404704 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea60dbb-5d09-4bb8-b61a-502ef567b792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:13.405437 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea60dbb-5d09-4bb8-b61a-502ef567b792 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:13.405736 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea60dbb-5d09-4bb8-b61a-502ef567b792 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:13.406023 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea60dbb-5d09-4bb8-b61a-502ef567b792 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:13.406807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea60dbb-5d09-4bb8-b61a-502ef567b792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:13.407123 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-a3d0ee8a-771b-44be-9466-e332396dad34 None None] MFA Rules not processed for user `53e722be3f3046c58958ab0cbd486ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:13.408953 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a3d0ee8a-771b-44be-9466-e332396dad34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:13.450905 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea60dbb-5d09-4bb8-b61a-502ef567b792 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:13.507966 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 883/1767] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:13 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:13.507966 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0ee8a-771b-44be-9466-e332396dad34 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:13.517140 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0ee8a-771b-44be-9466-e332396dad34 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:13.521962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fa6d8-41ff-4c07-b02e-bc2995905874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:13.522637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fa6d8-41ff-4c07-b02e-bc2995905874 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:13.523155 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fa6d8-41ff-4c07-b02e-bc2995905874 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:13.523511 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fa6d8-41ff-4c07-b02e-bc2995905874 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:13.524309 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288fa6d8-41ff-4c07-b02e-bc2995905874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:13.551657 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288fa6d8-41ff-4c07-b02e-bc2995905874 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:13.609707 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 885/1768] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:13 2021] POST /identity/v3/projects => generated 369 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:13.609707 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea60dbb-5d09-4bb8-b61a-502ef567b792 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:13.678285 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea60dbb-5d09-4bb8-b61a-502ef567b792 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:13.682760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505fd58-dcc8-46cd-9820-b3cbf6056db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:13.683762 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505fd58-dcc8-46cd-9820-b3cbf6056db9 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:13.686986 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505fd58-dcc8-46cd-9820-b3cbf6056db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:13.688126 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505fd58-dcc8-46cd-9820-b3cbf6056db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:13.699725 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 884/1769] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:13 2021] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:13.699725 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fa6d8-41ff-4c07-b02e-bc2995905874 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:13.700007 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505fd58-dcc8-46cd-9820-b3cbf6056db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:13.725384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fa6d8-41ff-4c07-b02e-bc2995905874 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:13.736282 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91703e06-ffb3-4665-ad91-8cee2a0cfe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:13.737257 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91703e06-ffb3-4665-ad91-8cee2a0cfe6a admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:13.737827 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91703e06-ffb3-4665-ad91-8cee2a0cfe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:13.738116 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91703e06-ffb3-4665-ad91-8cee2a0cfe6a admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:13.738768 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91703e06-ffb3-4665-ad91-8cee2a0cfe6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:13.739821 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505fd58-dcc8-46cd-9820-b3cbf6056db9 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:13.776807 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91703e06-ffb3-4665-ad91-8cee2a0cfe6a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:13.898855 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 885/1770] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:13 2021] POST /identity/v3/projects => generated 367 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:13.904205 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91703e06-ffb3-4665-ad91-8cee2a0cfe6a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:13.904336 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 886/1771] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:13 2021] POST /identity/v3/projects => generated 409 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:13.904336 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505fd58-dcc8-46cd-9820-b3cbf6056db9 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:14.005828 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91703e06-ffb3-4665-ad91-8cee2a0cfe6a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:14.026428 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505fd58-dcc8-46cd-9820-b3cbf6056db9 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:14.036045 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d51e7-d62f-43b3-94b3-864d05e83678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:14.036045 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d51e7-d62f-43b3-94b3-864d05e83678 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:14.036045 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d51e7-d62f-43b3-94b3-864d05e83678 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:14.036045 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d51e7-d62f-43b3-94b3-864d05e83678 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:14.036667 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d51e7-d62f-43b3-94b3-864d05e83678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:14.066838 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d51e7-d62f-43b3-94b3-864d05e83678 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:14.080341 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 887/1772] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:13 2021] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:14.085770 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d51e7-d62f-43b3-94b3-864d05e83678 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:14.093752 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d51e7-d62f-43b3-94b3-864d05e83678 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:14.098760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e940e-b369-40ee-8aed-1f0060f1ac3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:14.099471 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e940e-b369-40ee-8aed-1f0060f1ac3d admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:14.100338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e940e-b369-40ee-8aed-1f0060f1ac3d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:14.100338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e940e-b369-40ee-8aed-1f0060f1ac3d admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:14.101045 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e940e-b369-40ee-8aed-1f0060f1ac3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:14.147957 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c81eec-bb14-47a7-9854-096603c99d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:14.148478 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c81eec-bb14-47a7-9854-096603c99d5e admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:14.148868 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c81eec-bb14-47a7-9854-096603c99d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:14.149152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c81eec-bb14-47a7-9854-096603c99d5e admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:14.149797 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c81eec-bb14-47a7-9854-096603c99d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:14.155436 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e940e-b369-40ee-8aed-1f0060f1ac3d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:14.178174 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c81eec-bb14-47a7-9854-096603c99d5e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:14.300885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 886/1773] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:13 2021] POST /identity/v3/users => generated 291 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:14.300885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c81eec-bb14-47a7-9854-096603c99d5e admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:14.301164 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 888/1774] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:14 2021] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:14.301633 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e940e-b369-40ee-8aed-1f0060f1ac3d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:14.312151 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c81eec-bb14-47a7-9854-096603c99d5e admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:14.313840 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e940e-b369-40ee-8aed-1f0060f1ac3d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:14.323163 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db6572-ffa9-4f7a-a39a-00aca35f0009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:14.323777 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db6572-ffa9-4f7a-a39a-00aca35f0009 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:14.324065 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db6572-ffa9-4f7a-a39a-00aca35f0009 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:14.324344 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db6572-ffa9-4f7a-a39a-00aca35f0009 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:14.325023 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db6572-ffa9-4f7a-a39a-00aca35f0009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:14.326443 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7d64b-823e-4672-aac3-b7299800563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:14.327524 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7d64b-823e-4672-aac3-b7299800563b admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:14.327891 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7d64b-823e-4672-aac3-b7299800563b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:14.328308 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7d64b-823e-4672-aac3-b7299800563b admin admin] PATH_INFO: `/v3/projects/f723ea2b7fc74fa28f80482b43863998/users/9c27dc8fa7f64391a58232b29d4aae11/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:14.355398 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7d64b-823e-4672-aac3-b7299800563b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f723ea2b7fc74fa28f80482b43863998, user_id=9c27dc8fa7f64391a58232b29d4aae11, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:14.361257 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db6572-ffa9-4f7a-a39a-00aca35f0009 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:14.382801 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7d64b-823e-4672-aac3-b7299800563b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:14.502248 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 887/1775] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:14 2021] POST /identity/v3/users => generated 305 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:14.503081 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db6572-ffa9-4f7a-a39a-00aca35f0009 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:14.506571 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 889/1776] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:14 2021] PUT /identity/v3/projects/f723ea2b7fc74fa28f80482b43863998/users/9c27dc8fa7f64391a58232b29d4aae11/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:14.507364 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7d64b-823e-4672-aac3-b7299800563b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:14.520794 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db6572-ffa9-4f7a-a39a-00aca35f0009 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:14.597744 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624e8bc-674e-4729-9b0e-be94b98792fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:14.598415 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624e8bc-674e-4729-9b0e-be94b98792fb admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:14.598706 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624e8bc-674e-4729-9b0e-be94b98792fb admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:14.599444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624e8bc-674e-4729-9b0e-be94b98792fb admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:14.600213 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624e8bc-674e-4729-9b0e-be94b98792fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:14.627067 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624e8bc-674e-4729-9b0e-be94b98792fb admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:14.629937 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7d64b-823e-4672-aac3-b7299800563b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:14.635616 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b6a0a-e406-450f-8422-86952220dfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:14.636375 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b6a0a-e406-450f-8422-86952220dfe6 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:14.636878 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b6a0a-e406-450f-8422-86952220dfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:14.637280 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b6a0a-e406-450f-8422-86952220dfe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:14.643645 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 888/1777] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:14 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:14.643829 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b6a0a-e406-450f-8422-86952220dfe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:14.644025 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624e8bc-674e-4729-9b0e-be94b98792fb admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:14.653172 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624e8bc-674e-4729-9b0e-be94b98792fb admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:14.657895 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c47346-9e19-4c31-b8b5-67f4ca23d567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:14.658501 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c47346-9e19-4c31-b8b5-67f4ca23d567 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:14.658786 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c47346-9e19-4c31-b8b5-67f4ca23d567 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:14.659096 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c47346-9e19-4c31-b8b5-67f4ca23d567 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:14.659741 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c47346-9e19-4c31-b8b5-67f4ca23d567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:14.665440 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b6a0a-e406-450f-8422-86952220dfe6 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:14.677014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 890/1778] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:14 2021] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:14.689382 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c5ad7-69d9-4993-97a0-b3bb288da938 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:14.689509 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c47346-9e19-4c31-b8b5-67f4ca23d567 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:14.689721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c5ad7-69d9-4993-97a0-b3bb288da938 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:14.689721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c5ad7-69d9-4993-97a0-b3bb288da938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:14.698396 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 889/1779] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:14 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:14.699309 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c47346-9e19-4c31-b8b5-67f4ca23d567 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:14.718688 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c47346-9e19-4c31-b8b5-67f4ca23d567 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:14.736312 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0c73e-5fe0-42a1-9357-e8859eb4c11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:14.736312 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0c73e-5fe0-42a1-9357-e8859eb4c11b admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:14.736312 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0c73e-5fe0-42a1-9357-e8859eb4c11b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:14.736312 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0c73e-5fe0-42a1-9357-e8859eb4c11b admin admin] PATH_INFO: `/v3/projects/16bf6bca846249838efaa82be2fbc87c/users/801fcc8eb3524c7f8f0f1cd1c64156f3/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:14.744597 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-179c5ad7-69d9-4993-97a0-b3bb288da938 None None] MFA Rules not processed for user `9c27dc8fa7f64391a58232b29d4aae11`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:14.745844 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-179c5ad7-69d9-4993-97a0-b3bb288da938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:14.761385 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0c73e-5fe0-42a1-9357-e8859eb4c11b admin admin] RBAC: Authorizing `identity:create_grant(project_id=16bf6bca846249838efaa82be2fbc87c, user_id=801fcc8eb3524c7f8f0f1cd1c64156f3, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:14.797417 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0c73e-5fe0-42a1-9357-e8859eb4c11b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:14.824690 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 891/1780] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:14 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:14.825657 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c5ad7-69d9-4993-97a0-b3bb288da938 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:14.837464 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c5ad7-69d9-4993-97a0-b3bb288da938 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:14.842546 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f7e67-0416-4629-9e96-d2966f6e9f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:14.843363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f7e67-0416-4629-9e96-d2966f6e9f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:14.843830 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f7e67-0416-4629-9e96-d2966f6e9f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:14.844003 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f7e67-0416-4629-9e96-d2966f6e9f92 admin admin] PATH_INFO: `/v3/projects/e61b6ea4c8574aecba465c16f63c82a5/users/ee76b46e5fab4b57b0be20eac1cfe079/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:14.864152 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f7e67-0416-4629-9e96-d2966f6e9f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61b6ea4c8574aecba465c16f63c82a5, user_id=ee76b46e5fab4b57b0be20eac1cfe079, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:14.890575 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f7e67-0416-4629-9e96-d2966f6e9f92 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:14.980470 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 890/1781] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:14 2021] PUT /identity/v3/projects/16bf6bca846249838efaa82be2fbc87c/users/801fcc8eb3524c7f8f0f1cd1c64156f3/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:14.980470 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0c73e-5fe0-42a1-9357-e8859eb4c11b admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:15.007960 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 892/1782] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:14 2021] PUT /identity/v3/projects/e61b6ea4c8574aecba465c16f63c82a5/users/ee76b46e5fab4b57b0be20eac1cfe079/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:15.008919 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f7e67-0416-4629-9e96-d2966f6e9f92 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:15.066184 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0c73e-5fe0-42a1-9357-e8859eb4c11b admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:15.085558 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f7e67-0416-4629-9e96-d2966f6e9f92 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:15.093819 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cfc28-6213-4eb7-8de9-b7ee7f3b7a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:15.094422 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cfc28-6213-4eb7-8de9-b7ee7f3b7a22 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:15.094709 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cfc28-6213-4eb7-8de9-b7ee7f3b7a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:15.094988 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cfc28-6213-4eb7-8de9-b7ee7f3b7a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:15.095744 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cfc28-6213-4eb7-8de9-b7ee7f3b7a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:15.125763 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cfc28-6213-4eb7-8de9-b7ee7f3b7a22 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:15.132221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c2294-bc94-496a-b904-c0f99292fb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:15.133248 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c2294-bc94-496a-b904-c0f99292fb03 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:15.135010 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c2294-bc94-496a-b904-c0f99292fb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:15.135010 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c2294-bc94-496a-b904-c0f99292fb03 admin admin] PATH_INFO: `/v3/projects/b661dbaa0a054de4983a591be16a820f/users/6510aa52ff6b450ba8a7e1bf78f06d55/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:15.173259 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c2294-bc94-496a-b904-c0f99292fb03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b661dbaa0a054de4983a591be16a820f, user_id=6510aa52ff6b450ba8a7e1bf78f06d55, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:15.202398 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c2294-bc94-496a-b904-c0f99292fb03 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:15.237346 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 893/1783] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:15 2021] POST /identity/v3/projects => generated 377 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:15.239267 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cfc28-6213-4eb7-8de9-b7ee7f3b7a22 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:15.314427 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 891/1784] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:14 2021] PUT /identity/v3/projects/b661dbaa0a054de4983a591be16a820f/users/6510aa52ff6b450ba8a7e1bf78f06d55/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:15.325723 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c2294-bc94-496a-b904-c0f99292fb03 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:15.359631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cfc28-6213-4eb7-8de9-b7ee7f3b7a22 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:15.477564 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c2e0a-7c0c-442b-b760-0bf2949938fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:15.478514 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c2e0a-7c0c-442b-b760-0bf2949938fb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:15.479597 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c2e0a-7c0c-442b-b760-0bf2949938fb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:15.479883 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c2e0a-7c0c-442b-b760-0bf2949938fb admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:15.480837 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c2e0a-7c0c-442b-b760-0bf2949938fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:15.508033 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c2e0a-7c0c-442b-b760-0bf2949938fb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:15.525062 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 894/1785] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:15 2021] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:15.526005 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c2e0a-7c0c-442b-b760-0bf2949938fb admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:15.536462 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c2e0a-7c0c-442b-b760-0bf2949938fb admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:15.543030 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e08f51-64e6-41ed-a970-1a6725d222a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:15.543687 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e08f51-64e6-41ed-a970-1a6725d222a9 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:15.544781 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e08f51-64e6-41ed-a970-1a6725d222a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:15.545071 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e08f51-64e6-41ed-a970-1a6725d222a9 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:15.545713 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e08f51-64e6-41ed-a970-1a6725d222a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:15.552637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c2294-bc94-496a-b904-c0f99292fb03 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:15.563826 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05c2bc-4514-4f2c-a463-b468b109cb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:15.564675 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c2bc-4514-4f2c-a463-b468b109cb80 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:15.565348 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c2bc-4514-4f2c-a463-b468b109cb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:15.565824 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c2bc-4514-4f2c-a463-b468b109cb80 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:15.566696 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05c2bc-4514-4f2c-a463-b468b109cb80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:15.576602 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e08f51-64e6-41ed-a970-1a6725d222a9 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:15.611489 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05c2bc-4514-4f2c-a463-b468b109cb80 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:15.626580 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 892/1786] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:15 2021] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:15.627946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcffc4-7bc3-4014-8d5f-6cd6a96ce9cd None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:15.628238 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcffc4-7bc3-4014-8d5f-6cd6a96ce9cd None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:15.628521 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcffc4-7bc3-4014-8d5f-6cd6a96ce9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:15.663985 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 895/1787] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:15 2021] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:15.664774 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e08f51-64e6-41ed-a970-1a6725d222a9 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:15.686963 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e08f51-64e6-41ed-a970-1a6725d222a9 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:15.698247 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-d9fcffc4-7bc3-4014-8d5f-6cd6a96ce9cd None None] MFA Rules not processed for user `6510aa52ff6b450ba8a7e1bf78f06d55`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:15.699464 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d9fcffc4-7bc3-4014-8d5f-6cd6a96ce9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:15.705642 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a72c4-eac6-4a4e-a2d9-7382a05db609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:15.706486 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a72c4-eac6-4a4e-a2d9-7382a05db609 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:15.706767 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a72c4-eac6-4a4e-a2d9-7382a05db609 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:15.707070 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a72c4-eac6-4a4e-a2d9-7382a05db609 admin admin] PATH_INFO: `/v3/projects/16bf6bca846249838efaa82be2fbc87c/users/801fcc8eb3524c7f8f0f1cd1c64156f3/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:15.708959 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a72c4-eac6-4a4e-a2d9-7382a05db609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16bf6bca846249838efaa82be2fbc87c, user_id=801fcc8eb3524c7f8f0f1cd1c64156f3, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:15.735670 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a72c4-eac6-4a4e-a2d9-7382a05db609 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:15.748523 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 896/1788] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:15 2021] PUT /identity/v3/projects/16bf6bca846249838efaa82be2fbc87c/users/801fcc8eb3524c7f8f0f1cd1c64156f3/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:15.754846 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a72c4-eac6-4a4e-a2d9-7382a05db609 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:15.803891 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 893/1789] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:15 2021] POST /identity/v3/auth/tokens => generated 3716 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:15.805268 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcffc4-7bc3-4014-8d5f-6cd6a96ce9cd None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:15.818965 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcffc4-7bc3-4014-8d5f-6cd6a96ce9cd None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:15.897399 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a72c4-eac6-4a4e-a2d9-7382a05db609 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:15.906458 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd06073-816b-4c4f-bb2f-b3a0b1964a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:15.910069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3c454-3a24-41c8-8952-3d2075bd1e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:15.910910 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3c454-3a24-41c8-8952-3d2075bd1e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:15.911201 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3c454-3a24-41c8-8952-3d2075bd1e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:15.911487 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3c454-3a24-41c8-8952-3d2075bd1e18 admin admin] PATH_INFO: `/v3/projects/e61b6ea4c8574aecba465c16f63c82a5/users/ee76b46e5fab4b57b0be20eac1cfe079/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:15.913337 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3c454-3a24-41c8-8952-3d2075bd1e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61b6ea4c8574aecba465c16f63c82a5, user_id=ee76b46e5fab4b57b0be20eac1cfe079, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:15.918459 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd06073-816b-4c4f-bb2f-b3a0b1964a0f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:15.918767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd06073-816b-4c4f-bb2f-b3a0b1964a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:15.920423 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd06073-816b-4c4f-bb2f-b3a0b1964a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:15.920423 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd06073-816b-4c4f-bb2f-b3a0b1964a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:15.971461 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3c454-3a24-41c8-8952-3d2075bd1e18 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:15.977903 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd06073-816b-4c4f-bb2f-b3a0b1964a0f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:15.995439 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 897/1790] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:15 2021] PUT /identity/v3/projects/e61b6ea4c8574aecba465c16f63c82a5/users/ee76b46e5fab4b57b0be20eac1cfe079/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:15.996075 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3c454-3a24-41c8-8952-3d2075bd1e18 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:16.020934 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 894/1791] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:15 2021] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:16.021903 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd06073-816b-4c4f-bb2f-b3a0b1964a0f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:16.041091 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd06073-816b-4c4f-bb2f-b3a0b1964a0f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:16.122164 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3c454-3a24-41c8-8952-3d2075bd1e18 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:16.139925 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7eeee-7b4a-48fb-8c3e-b551c2c6529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:16.140552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7eeee-7b4a-48fb-8c3e-b551c2c6529e admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:16.140971 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7eeee-7b4a-48fb-8c3e-b551c2c6529e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:16.141257 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7eeee-7b4a-48fb-8c3e-b551c2c6529e admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:16.141970 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7eeee-7b4a-48fb-8c3e-b551c2c6529e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:16.143079 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c5428-f9de-4380-8e53-bf159f193edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:16.143478 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c5428-f9de-4380-8e53-bf159f193edb admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:16.143839 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c5428-f9de-4380-8e53-bf159f193edb admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:16.144197 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c5428-f9de-4380-8e53-bf159f193edb admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:16.144967 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c5428-f9de-4380-8e53-bf159f193edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:16.187495 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c5428-f9de-4380-8e53-bf159f193edb admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:16.198369 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7eeee-7b4a-48fb-8c3e-b551c2c6529e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:16.215519 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 898/1792] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:15 2021] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:16.217882 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7eeee-7b4a-48fb-8c3e-b551c2c6529e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:16.238428 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7eeee-7b4a-48fb-8c3e-b551c2c6529e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:16.253071 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf07ce6-ea66-428e-ac00-b0dff219bea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:16.253842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf07ce6-ea66-428e-ac00-b0dff219bea0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:16.254729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf07ce6-ea66-428e-ac00-b0dff219bea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:16.254729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf07ce6-ea66-428e-ac00-b0dff219bea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:16.255363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf07ce6-ea66-428e-ac00-b0dff219bea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:16.278458 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 895/1793] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:16 2021] POST /identity/v3/projects => generated 409 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:16.282753 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c5428-f9de-4380-8e53-bf159f193edb admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:16.309808 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf07ce6-ea66-428e-ac00-b0dff219bea0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:16.324143 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 899/1794] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:16 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:16.325374 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf07ce6-ea66-428e-ac00-b0dff219bea0 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:16.337432 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf07ce6-ea66-428e-ac00-b0dff219bea0 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:16.414828 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c5428-f9de-4380-8e53-bf159f193edb admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:16.419685 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84865588-7536-433f-9465-0eaafaa7d64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:16.420385 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84865588-7536-433f-9465-0eaafaa7d64c admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:16.420761 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84865588-7536-433f-9465-0eaafaa7d64c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:16.421054 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84865588-7536-433f-9465-0eaafaa7d64c admin admin] PATH_INFO: `/v3/projects/01037685517a409aab4939602944b07e/users/538e9ea069b74451bc4eb6f999657b95/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:16.452470 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84865588-7536-433f-9465-0eaafaa7d64c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01037685517a409aab4939602944b07e, user_id=538e9ea069b74451bc4eb6f999657b95, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:16.483214 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647e933-47e0-4370-bfa8-9ba33d1f75a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:16.483725 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647e933-47e0-4370-bfa8-9ba33d1f75a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:16.484179 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647e933-47e0-4370-bfa8-9ba33d1f75a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:16.484680 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647e933-47e0-4370-bfa8-9ba33d1f75a3 admin admin] PATH_INFO: `/v3/projects/16bf6bca846249838efaa82be2fbc87c/users/801fcc8eb3524c7f8f0f1cd1c64156f3/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:16.488029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647e933-47e0-4370-bfa8-9ba33d1f75a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16bf6bca846249838efaa82be2fbc87c, user_id=801fcc8eb3524c7f8f0f1cd1c64156f3, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:16.506547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84865588-7536-433f-9465-0eaafaa7d64c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:16.543322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647e933-47e0-4370-bfa8-9ba33d1f75a3 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:16.581490 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 896/1795] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:16 2021] PUT /identity/v3/projects/01037685517a409aab4939602944b07e/users/538e9ea069b74451bc4eb6f999657b95/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:16.584958 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84865588-7536-433f-9465-0eaafaa7d64c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:16.639821 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 900/1796] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:16 2021] PUT /identity/v3/projects/16bf6bca846249838efaa82be2fbc87c/users/801fcc8eb3524c7f8f0f1cd1c64156f3/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:16.641037 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647e933-47e0-4370-bfa8-9ba33d1f75a3 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:16.682037 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84865588-7536-433f-9465-0eaafaa7d64c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:16.747707 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647e933-47e0-4370-bfa8-9ba33d1f75a3 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:16.753991 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eba730-ec1b-4ac9-846c-f7d5330440b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:16.755053 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eba730-ec1b-4ac9-846c-f7d5330440b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:16.755364 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eba730-ec1b-4ac9-846c-f7d5330440b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:16.755671 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eba730-ec1b-4ac9-846c-f7d5330440b3 admin admin] PATH_INFO: `/v3/projects/e61b6ea4c8574aecba465c16f63c82a5/users/ee76b46e5fab4b57b0be20eac1cfe079/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:16.757908 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eba730-ec1b-4ac9-846c-f7d5330440b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61b6ea4c8574aecba465c16f63c82a5, user_id=ee76b46e5fab4b57b0be20eac1cfe079, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:16.782427 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a2790-2b30-4d08-8520-23c3c30f99e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:16.783434 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a2790-2b30-4d08-8520-23c3c30f99e2 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:16.784121 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a2790-2b30-4d08-8520-23c3c30f99e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:16.784753 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a2790-2b30-4d08-8520-23c3c30f99e2 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:16.789274 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a2790-2b30-4d08-8520-23c3c30f99e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:16.792647 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eba730-ec1b-4ac9-846c-f7d5330440b3 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:16.865971 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a2790-2b30-4d08-8520-23c3c30f99e2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:18.096517 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 901/1797] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:16 2021] PUT /identity/v3/projects/e61b6ea4c8574aecba465c16f63c82a5/users/ee76b46e5fab4b57b0be20eac1cfe079/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 1456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:18.097480 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eba730-ec1b-4ac9-846c-f7d5330440b3 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:18.161176 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 897/1798] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:16 2021] POST /identity/v3/users => generated 311 bytes in 1579 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:18.162726 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f8c72-e9f6-4e98-a798-97d83b0d8a3a None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:18.163114 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f8c72-e9f6-4e98-a798-97d83b0d8a3a None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:18.163496 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f8c72-e9f6-4e98-a798-97d83b0d8a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:18.198631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eba730-ec1b-4ac9-846c-f7d5330440b3 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:18.207457 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddda2b8-e17b-4295-b13f-9c2261b3aeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:18.208068 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddda2b8-e17b-4295-b13f-9c2261b3aeee admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:18.208355 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddda2b8-e17b-4295-b13f-9c2261b3aeee admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:18.208674 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddda2b8-e17b-4295-b13f-9c2261b3aeee admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:18.209409 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddda2b8-e17b-4295-b13f-9c2261b3aeee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:18.211318 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-627f8c72-e9f6-4e98-a798-97d83b0d8a3a None None] MFA Rules not processed for user `801fcc8eb3524c7f8f0f1cd1c64156f3`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:18.212789 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-627f8c72-e9f6-4e98-a798-97d83b0d8a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:18.260544 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddda2b8-e17b-4295-b13f-9c2261b3aeee admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:18.281681 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 902/1799] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:18 2021] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:18.289056 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737944a-b6bd-4279-bac1-2c1025f6c084 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:18.289238 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737944a-b6bd-4279-bac1-2c1025f6c084 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:18.289560 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737944a-b6bd-4279-bac1-2c1025f6c084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:18.311325 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 898/1800] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:18 2021] POST /identity/v3/auth/tokens => generated 3743 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:18.312683 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f8c72-e9f6-4e98-a798-97d83b0d8a3a None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:18.328751 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f8c72-e9f6-4e98-a798-97d83b0d8a3a None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:18.335320 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ab449-1a5c-4bf0-97f4-c667be82fcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:18.336144 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ab449-1a5c-4bf0-97f4-c667be82fcd0 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:18.336992 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ab449-1a5c-4bf0-97f4-c667be82fcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:18.337496 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ab449-1a5c-4bf0-97f4-c667be82fcd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:18.338279 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ab449-1a5c-4bf0-97f4-c667be82fcd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:18.371527 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-f737944a-b6bd-4279-bac1-2c1025f6c084 None None] MFA Rules not processed for user `ee76b46e5fab4b57b0be20eac1cfe079`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:18.372816 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f737944a-b6bd-4279-bac1-2c1025f6c084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:18.372939 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ab449-1a5c-4bf0-97f4-c667be82fcd0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:18.388696 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 899/1801] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:18 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:18.389850 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ab449-1a5c-4bf0-97f4-c667be82fcd0 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:18.401852 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ab449-1a5c-4bf0-97f4-c667be82fcd0 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:18.408293 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a0960-dab1-48c0-9244-1bba5e80b8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:18.410051 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a0960-dab1-48c0-9244-1bba5e80b8d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:18.410416 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a0960-dab1-48c0-9244-1bba5e80b8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:18.410776 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a0960-dab1-48c0-9244-1bba5e80b8d8 admin admin] PATH_INFO: `/v3/projects/01037685517a409aab4939602944b07e/users/538e9ea069b74451bc4eb6f999657b95/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:18.413737 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a0960-dab1-48c0-9244-1bba5e80b8d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01037685517a409aab4939602944b07e, user_id=538e9ea069b74451bc4eb6f999657b95, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:18.475068 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a0960-dab1-48c0-9244-1bba5e80b8d8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:18.491883 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 900/1802] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:18 2021] PUT /identity/v3/projects/01037685517a409aab4939602944b07e/users/538e9ea069b74451bc4eb6f999657b95/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:18.494072 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a0960-dab1-48c0-9244-1bba5e80b8d8 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:18.499834 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-c73a0960-dab1-48c0-9244-1bba5e80b8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:18.593849 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 903/1803] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:18 2021] POST /identity/v3/auth/tokens => generated 3741 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:18.594845 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737944a-b6bd-4279-bac1-2c1025f6c084 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:18.609462 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a0960-dab1-48c0-9244-1bba5e80b8d8 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:18.619071 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69218e54-9be1-463e-9c3d-ea575e892926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:18.619902 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69218e54-9be1-463e-9c3d-ea575e892926 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:18.620489 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69218e54-9be1-463e-9c3d-ea575e892926 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:18.621004 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69218e54-9be1-463e-9c3d-ea575e892926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:18.621748 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737944a-b6bd-4279-bac1-2c1025f6c084 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:18.757788 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f77a07-60b6-473f-9fec-09fca7a345b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:18.758814 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f77a07-60b6-473f-9fec-09fca7a345b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:18.759141 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f77a07-60b6-473f-9fec-09fca7a345b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:18.759434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f77a07-60b6-473f-9fec-09fca7a345b7 admin admin] PATH_INFO: `/v3/projects/a8cb0521da394ed8915ddf055f1b7421/users/26d811892e1c4794af97ea32fd0fadca/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:18.764778 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69218e54-9be1-463e-9c3d-ea575e892926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:18.791971 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69218e54-9be1-463e-9c3d-ea575e892926 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:18.803020 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 901/1804] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:18 2021] GET /identity/v3/auth/tokens => generated 3743 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:18.803712 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69218e54-9be1-463e-9c3d-ea575e892926 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:18.815565 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69218e54-9be1-463e-9c3d-ea575e892926 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:18.821046 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea1967-d16e-49a7-a0db-0ce6e86828c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:18.821533 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f77a07-60b6-473f-9fec-09fca7a345b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8cb0521da394ed8915ddf055f1b7421, user_id=26d811892e1c4794af97ea32fd0fadca, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:18.821808 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea1967-d16e-49a7-a0db-0ce6e86828c6 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:18.822214 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea1967-d16e-49a7-a0db-0ce6e86828c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:18.822649 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea1967-d16e-49a7-a0db-0ce6e86828c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:18.823589 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea1967-d16e-49a7-a0db-0ce6e86828c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:18.856785 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea1967-d16e-49a7-a0db-0ce6e86828c6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:18.864824 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f77a07-60b6-473f-9fec-09fca7a345b7 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:18.873095 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 902/1805] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:18 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:18.873997 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea1967-d16e-49a7-a0db-0ce6e86828c6 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:18.875666 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4dea1967-d16e-49a7-a0db-0ce6e86828c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:18.889625 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea1967-d16e-49a7-a0db-0ce6e86828c6 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:18.894251 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45ad3d-c277-4a80-8d55-b78fea69ff16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:18.896048 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45ad3d-c277-4a80-8d55-b78fea69ff16 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:18.896379 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45ad3d-c277-4a80-8d55-b78fea69ff16 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:18.897045 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45ad3d-c277-4a80-8d55-b78fea69ff16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:18.976889 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 904/1806] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:18 2021] PUT /identity/v3/projects/a8cb0521da394ed8915ddf055f1b7421/users/26d811892e1c4794af97ea32fd0fadca/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:18.978475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47630fc3-902f-49f7-8c5e-bffb7cd38992 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:18.978961 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47630fc3-902f-49f7-8c5e-bffb7cd38992 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:18.980723 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47630fc3-902f-49f7-8c5e-bffb7cd38992 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:18.989465 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 905/1807] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 23 01:53:18 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:53:18.990563 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47630fc3-902f-49f7-8c5e-bffb7cd38992 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:19.010150 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45ad3d-c277-4a80-8d55-b78fea69ff16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:19.041824 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45ad3d-c277-4a80-8d55-b78fea69ff16 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:19.055946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 903/1808] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:18 2021] GET /identity/v3/auth/tokens => generated 3741 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:19.057425 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45ad3d-c277-4a80-8d55-b78fea69ff16 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:19.069898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45ad3d-c277-4a80-8d55-b78fea69ff16 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:19.154298 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a8281-9fe4-4a03-b75c-b9f91a92360f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:19.155170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a8281-9fe4-4a03-b75c-b9f91a92360f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:19.155567 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a8281-9fe4-4a03-b75c-b9f91a92360f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:19.156153 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a8281-9fe4-4a03-b75c-b9f91a92360f admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:19.157081 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a8281-9fe4-4a03-b75c-b9f91a92360f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:19.188729 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a8281-9fe4-4a03-b75c-b9f91a92360f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:19.206127 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 904/1809] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:19 2021] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:19.206296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47630fc3-902f-49f7-8c5e-bffb7cd38992 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:19.207496 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a8281-9fe4-4a03-b75c-b9f91a92360f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:19.210985 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f406c-29dd-4e2b-9293-3a8a8577fb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:19.211931 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f406c-29dd-4e2b-9293-3a8a8577fb3b admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:19.212231 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f406c-29dd-4e2b-9293-3a8a8577fb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:19.212632 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f406c-29dd-4e2b-9293-3a8a8577fb3b admin admin] PATH_INFO: `/v3/projects/01037685517a409aab4939602944b07e/users/538e9ea069b74451bc4eb6f999657b95/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:19.218449 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f406c-29dd-4e2b-9293-3a8a8577fb3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=01037685517a409aab4939602944b07e, user_id=538e9ea069b74451bc4eb6f999657b95, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:19.226385 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a8281-9fe4-4a03-b75c-b9f91a92360f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:19.232637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0cde7-bfa4-47c8-9cdd-ff968d63c187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:19.234198 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0cde7-bfa4-47c8-9cdd-ff968d63c187 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:19.234571 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0cde7-bfa4-47c8-9cdd-ff968d63c187 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:19.234951 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0cde7-bfa4-47c8-9cdd-ff968d63c187 admin admin] PATH_INFO: `/v3/projects/a8cb0521da394ed8915ddf055f1b7421/users/26d811892e1c4794af97ea32fd0fadca/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:19.237917 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0cde7-bfa4-47c8-9cdd-ff968d63c187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8cb0521da394ed8915ddf055f1b7421, user_id=26d811892e1c4794af97ea32fd0fadca, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:19.268362 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0cde7-bfa4-47c8-9cdd-ff968d63c187 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:19.279950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f406c-29dd-4e2b-9293-3a8a8577fb3b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:19.284303 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 905/1810] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:19 2021] PUT /identity/v3/projects/a8cb0521da394ed8915ddf055f1b7421/users/26d811892e1c4794af97ea32fd0fadca/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:19.284303 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6942be4-8f08-48db-b428-618baac860c7 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:19.284303 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6942be4-8f08-48db-b428-618baac860c7 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:19.284303 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6942be4-8f08-48db-b428-618baac860c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:19.311106 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-a6942be4-8f08-48db-b428-618baac860c7 None None] MFA Rules not processed for user `094c5e571da7480584098ba6ebcb70ed`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:19.312445 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a6942be4-8f08-48db-b428-618baac860c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:19.386279 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 906/1811] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:18 2021] PUT /identity/v3/projects/01037685517a409aab4939602944b07e/users/538e9ea069b74451bc4eb6f999657b95/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:19.386279 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f406c-29dd-4e2b-9293-3a8a8577fb3b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:19.451226 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 906/1812] 10.222.0.20 () {58 vars in 1019 bytes} [Mon Aug 23 01:53:19 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:19.452307 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6942be4-8f08-48db-b428-618baac860c7 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:19.546871 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f406c-29dd-4e2b-9293-3a8a8577fb3b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:19.551944 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c32065-9595-49ac-83ca-c5c0a71c70d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:19.552770 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c32065-9595-49ac-83ca-c5c0a71c70d7 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:19.553067 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c32065-9595-49ac-83ca-c5c0a71c70d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:19.553353 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c32065-9595-49ac-83ca-c5c0a71c70d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:19.554059 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c32065-9595-49ac-83ca-c5c0a71c70d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:19.555819 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6942be4-8f08-48db-b428-618baac860c7 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:19.584330 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c32065-9595-49ac-83ca-c5c0a71c70d7 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:19.599811 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 907/1813] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:19 2021] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:19.605120 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be02f3-3496-4aac-aae3-e48dfed141e6 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:19.605412 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be02f3-3496-4aac-aae3-e48dfed141e6 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:19.605691 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be02f3-3496-4aac-aae3-e48dfed141e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:19.646763 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-30be02f3-3496-4aac-aae3-e48dfed141e6 None None] MFA Rules not processed for user `538e9ea069b74451bc4eb6f999657b95`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:19.647948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-30be02f3-3496-4aac-aae3-e48dfed141e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:19.671020 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5aa0a3-1472-48e9-b05f-e131eafa7d6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:19.673242 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5aa0a3-1472-48e9-b05f-e131eafa7d6c service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:19.673680 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5aa0a3-1472-48e9-b05f-e131eafa7d6c service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:19.674117 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5aa0a3-1472-48e9-b05f-e131eafa7d6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:19.753845 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 908/1814] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:19 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:19.757951 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be02f3-3496-4aac-aae3-e48dfed141e6 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:19.772064 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be02f3-3496-4aac-aae3-e48dfed141e6 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:19.778439 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3438e-d49a-479d-811c-4155960de541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:19.779534 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3438e-d49a-479d-811c-4155960de541 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:19.779857 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5aa0a3-1472-48e9-b05f-e131eafa7d6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:19.780177 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3438e-d49a-479d-811c-4155960de541 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:19.780609 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3438e-d49a-479d-811c-4155960de541 admin admin] PATH_INFO: `/v3/projects/a8cb0521da394ed8915ddf055f1b7421/users/26d811892e1c4794af97ea32fd0fadca/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:19.782800 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3438e-d49a-479d-811c-4155960de541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8cb0521da394ed8915ddf055f1b7421, user_id=26d811892e1c4794af97ea32fd0fadca, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:19.806793 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5aa0a3-1472-48e9-b05f-e131eafa7d6c service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:19.811114 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3438e-d49a-479d-811c-4155960de541 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:19.818307 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 907/1815] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:19 2021] GET /identity/v3/auth/tokens => generated 3674 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:19.819630 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5aa0a3-1472-48e9-b05f-e131eafa7d6c service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:19.821217 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-3f5aa0a3-1472-48e9-b05f-e131eafa7d6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:19.892476 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 909/1816] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:19 2021] PUT /identity/v3/projects/a8cb0521da394ed8915ddf055f1b7421/users/26d811892e1c4794af97ea32fd0fadca/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:19.893586 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3438e-d49a-479d-811c-4155960de541 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:19.966980 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5aa0a3-1472-48e9-b05f-e131eafa7d6c service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:20.066644 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3438e-d49a-479d-811c-4155960de541 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:20.080176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d30d80-1127-465b-bd29-65e966ebf10f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:20.080857 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d30d80-1127-465b-bd29-65e966ebf10f service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:20.081146 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d30d80-1127-465b-bd29-65e966ebf10f service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:20.081433 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d30d80-1127-465b-bd29-65e966ebf10f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:20.134051 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3183f81-21ec-468d-a551-bca2bf1f173b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:20.134692 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3183f81-21ec-468d-a551-bca2bf1f173b service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:20.134979 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3183f81-21ec-468d-a551-bca2bf1f173b service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:20.135257 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3183f81-21ec-468d-a551-bca2bf1f173b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:20.145087 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3183f81-21ec-468d-a551-bca2bf1f173b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:20.174369 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3183f81-21ec-468d-a551-bca2bf1f173b service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:20.194597 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 908/1817] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:19 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:20.196187 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c2a5b-1d60-42df-868f-a0454af4c6a1 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:20.196486 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c2a5b-1d60-42df-868f-a0454af4c6a1 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:20.196944 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c2a5b-1d60-42df-868f-a0454af4c6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:20.197275 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d30d80-1127-465b-bd29-65e966ebf10f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:20.230846 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d30d80-1127-465b-bd29-65e966ebf10f service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:20.248131 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 910/1818] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:19 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:20.277385 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-763c2a5b-1d60-42df-868f-a0454af4c6a1 None None] MFA Rules not processed for user `26d811892e1c4794af97ea32fd0fadca`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:20.281026 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-763c2a5b-1d60-42df-868f-a0454af4c6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:20.532661 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 909/1819] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:20 2021] POST /identity/v3/auth/tokens => generated 3783 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:20.966571 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ae5f2-43be-4228-8fa6-caedec935a7e None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:20.966571 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ae5f2-43be-4228-8fa6-caedec935a7e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:20.967030 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ae5f2-43be-4228-8fa6-caedec935a7e None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:20.969429 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 911/1820] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 23 01:53:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:53:20.986178 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a87147-672a-4ff4-8b4a-9af63f5fd0bd None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:20.986470 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a87147-672a-4ff4-8b4a-9af63f5fd0bd None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:20.986755 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a87147-672a-4ff4-8b4a-9af63f5fd0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:21.030166 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-f7a87147-672a-4ff4-8b4a-9af63f5fd0bd None None] MFA Rules not processed for user `094c5e571da7480584098ba6ebcb70ed`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:21.036314 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-f7a87147-672a-4ff4-8b4a-9af63f5fd0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:21.059827 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 910/1821] 10.222.0.20 () {58 vars in 1019 bytes} [Mon Aug 23 01:53:20 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:21.149775 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ae5f2-43be-4228-8fa6-caedec935a7e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:21.168338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ae5f2-43be-4228-8fa6-caedec935a7e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:21.181321 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437147ef-c4b3-478f-953b-703dbb56be3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:21.182089 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437147ef-c4b3-478f-953b-703dbb56be3e service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:21.182396 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437147ef-c4b3-478f-953b-703dbb56be3e service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:21.182741 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437147ef-c4b3-478f-953b-703dbb56be3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:21.203604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437147ef-c4b3-478f-953b-703dbb56be3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:21.252705 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437147ef-c4b3-478f-953b-703dbb56be3e service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:21.264578 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 912/1822] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:21 2021] GET /identity/v3/auth/tokens => generated 3783 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:21.625646 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a87147-672a-4ff4-8b4a-9af63f5fd0bd None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:21.640603 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a87147-672a-4ff4-8b4a-9af63f5fd0bd None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:21.649083 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd24575-5a35-48c8-90b0-f7cae6b77e4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:21.649671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd24575-5a35-48c8-90b0-f7cae6b77e4f service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:21.650006 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd24575-5a35-48c8-90b0-f7cae6b77e4f service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:21.650336 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd24575-5a35-48c8-90b0-f7cae6b77e4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:21.661284 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd24575-5a35-48c8-90b0-f7cae6b77e4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:21.692787 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd24575-5a35-48c8-90b0-f7cae6b77e4f service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:21.704555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 911/1823] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:21 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:22.115969 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437147ef-c4b3-478f-953b-703dbb56be3e service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:22.134030 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437147ef-c4b3-478f-953b-703dbb56be3e service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:22.141448 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c68282-4d66-4d45-8934-beee2dbea69c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:22.142752 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c68282-4d66-4d45-8934-beee2dbea69c service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:22.143439 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c68282-4d66-4d45-8934-beee2dbea69c service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:22.144417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c68282-4d66-4d45-8934-beee2dbea69c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:22.281764 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c68282-4d66-4d45-8934-beee2dbea69c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:22.318273 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c68282-4d66-4d45-8934-beee2dbea69c service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:22.333109 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 913/1824] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:22 2021] GET /identity/v3/auth/tokens => generated 3716 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:26.160434 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd24575-5a35-48c8-90b0-f7cae6b77e4f service nova] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:26.191282 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c68282-4d66-4d45-8934-beee2dbea69c service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:26.266558 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd24575-5a35-48c8-90b0-f7cae6b77e4f service nova] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:26.271067 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c394f78-14e6-4135-b73a-e440a30a23c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:26.271861 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c394f78-14e6-4135-b73a-e440a30a23c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:26.272145 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c394f78-14e6-4135-b73a-e440a30a23c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:26.272444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c394f78-14e6-4135-b73a-e440a30a23c9 admin admin] PATH_INFO: `/v3/users/53e722be3f3046c58958ab0cbd486ef6` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:26.273669 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c394f78-14e6-4135-b73a-e440a30a23c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53e722be3f3046c58958ab0cbd486ef6)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:26.286126 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c68282-4d66-4d45-8934-beee2dbea69c service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:26.291219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041213c-6e19-41d5-930e-1d595d8fd9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:26.292209 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041213c-6e19-41d5-930e-1d595d8fd9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:26.292927 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041213c-6e19-41d5-930e-1d595d8fd9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:26.293550 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041213c-6e19-41d5-930e-1d595d8fd9b1 admin admin] PATH_INFO: `/v3/users/b04d4546f20a436f8c9c1a4959206bd7` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:26.294816 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041213c-6e19-41d5-930e-1d595d8fd9b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b04d4546f20a436f8c9c1a4959206bd7)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:26.301536 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c394f78-14e6-4135-b73a-e440a30a23c9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:26.322238 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041213c-6e19-41d5-930e-1d595d8fd9b1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:26.503174 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-4c394f78-14e6-4135-b73a-e440a30a23c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53e722be3f3046c58958ab0cbd486ef6'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:26.532069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1041213c-6e19-41d5-930e-1d595d8fd9b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b04d4546f20a436f8c9c1a4959206bd7'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:26.532814 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1041213c-6e19-41d5-930e-1d595d8fd9b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b04d4546f20a436f8c9c1a4959206bd7'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:26.588248 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-4c394f78-14e6-4135-b73a-e440a30a23c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53e722be3f3046c58958ab0cbd486ef6'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:26.588973 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-4c394f78-14e6-4135-b73a-e440a30a23c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53e722be3f3046c58958ab0cbd486ef6'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:26.601072 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-4c394f78-14e6-4135-b73a-e440a30a23c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53e722be3f3046c58958ab0cbd486ef6'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:26.602898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-4c394f78-14e6-4135-b73a-e440a30a23c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53e722be3f3046c58958ab0cbd486ef6'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:26.644118 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 912/1825] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:26 2021] DELETE /identity/v3/users/53e722be3f3046c58958ab0cbd486ef6 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:26.645801 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61f5cd-d786-4e21-9dde-8522fbda2b01 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:26.646340 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61f5cd-d786-4e21-9dde-8522fbda2b01 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:26.646750 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61f5cd-d786-4e21-9dde-8522fbda2b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:26.660224 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1041213c-6e19-41d5-930e-1d595d8fd9b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b04d4546f20a436f8c9c1a4959206bd7'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:26.677226 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1041213c-6e19-41d5-930e-1d595d8fd9b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b04d4546f20a436f8c9c1a4959206bd7'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:26.677941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1041213c-6e19-41d5-930e-1d595d8fd9b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b04d4546f20a436f8c9c1a4959206bd7'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:26.682979 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-4e61f5cd-d786-4e21-9dde-8522fbda2b01 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:26.684590 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4e61f5cd-d786-4e21-9dde-8522fbda2b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:26.707108 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 914/1826] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:26 2021] DELETE /identity/v3/users/b04d4546f20a436f8c9c1a4959206bd7 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:26.712081 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638cc8b-3ebc-47ba-82d2-7223c506ee78 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:26.713784 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638cc8b-3ebc-47ba-82d2-7223c506ee78 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:26.714272 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638cc8b-3ebc-47ba-82d2-7223c506ee78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:26.759000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-f638cc8b-3ebc-47ba-82d2-7223c506ee78 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:26.761110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f638cc8b-3ebc-47ba-82d2-7223c506ee78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:26.817901 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 913/1827] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:26.826226 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61f5cd-d786-4e21-9dde-8522fbda2b01 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:26.827797 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4e61f5cd-d786-4e21-9dde-8522fbda2b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:26.877570 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 915/1828] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:26.888880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638cc8b-3ebc-47ba-82d2-7223c506ee78 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:26.890351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f638cc8b-3ebc-47ba-82d2-7223c506ee78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:26.923282 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61f5cd-d786-4e21-9dde-8522fbda2b01 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:26.981711 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638cc8b-3ebc-47ba-82d2-7223c506ee78 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:26.985229 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0d5b4-87e1-479e-96a6-c79feeb50aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:26.985647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0d5b4-87e1-479e-96a6-c79feeb50aba service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:26.985744 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac7ba5-305f-4ca6-ba0f-7af04f4a85c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:26.986086 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0d5b4-87e1-479e-96a6-c79feeb50aba service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:26.986271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac7ba5-305f-4ca6-ba0f-7af04f4a85c8 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:26.986439 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0d5b4-87e1-479e-96a6-c79feeb50aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:26.986698 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac7ba5-305f-4ca6-ba0f-7af04f4a85c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:26.986985 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac7ba5-305f-4ca6-ba0f-7af04f4a85c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:26.996408 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0d5b4-87e1-479e-96a6-c79feeb50aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:27.010376 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac7ba5-305f-4ca6-ba0f-7af04f4a85c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:27.042053 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac7ba5-305f-4ca6-ba0f-7af04f4a85c8 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:27.055985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0d5b4-87e1-479e-96a6-c79feeb50aba service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:27.061530 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 916/1829] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:26 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:53:27.070472 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 914/1830] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:26 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:53:27.771530 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac7ba5-305f-4ca6-ba0f-7af04f4a85c8 service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:27.773000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-06ac7ba5-305f-4ca6-ba0f-7af04f4a85c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:27.787359 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac7ba5-305f-4ca6-ba0f-7af04f4a85c8 service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:27.793006 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0439403-4f92-4620-9a9f-7d079ccbf46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:27.794415 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0439403-4f92-4620-9a9f-7d079ccbf46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:27.794774 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0439403-4f92-4620-9a9f-7d079ccbf46b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:27.795127 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0439403-4f92-4620-9a9f-7d079ccbf46b admin admin] PATH_INFO: `/v3/projects/3a4b672abbee4c61a0b8f5eec01cb459` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:27.796287 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0439403-4f92-4620-9a9f-7d079ccbf46b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a4b672abbee4c61a0b8f5eec01cb459)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:27.822754 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0439403-4f92-4620-9a9f-7d079ccbf46b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:27.891296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0d5b4-87e1-479e-96a6-c79feeb50aba service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:27.892788 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-88a0d5b4-87e1-479e-96a6-c79feeb50aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:27.906404 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0d5b4-87e1-479e-96a6-c79feeb50aba service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:27.911068 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8f2df-207e-4bd3-85f3-7bbca7e4dad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:27.911930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8f2df-207e-4bd3-85f3-7bbca7e4dad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:27.912292 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8f2df-207e-4bd3-85f3-7bbca7e4dad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:27.912682 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8f2df-207e-4bd3-85f3-7bbca7e4dad9 admin admin] PATH_INFO: `/v3/projects/3ce9aa95e51b44baac33d7ccc2611019` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:27.913829 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8f2df-207e-4bd3-85f3-7bbca7e4dad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce9aa95e51b44baac33d7ccc2611019)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:27.942878 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8f2df-207e-4bd3-85f3-7bbca7e4dad9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:27.967316 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d0439403-4f92-4620-9a9f-7d079ccbf46b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a4b672abbee4c61a0b8f5eec01cb459', 'request_id': 'req-d0439403-4f92-4620-9a9f-7d079ccbf46b'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:27.975176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d0439403-4f92-4620-9a9f-7d079ccbf46b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a4b672abbee4c61a0b8f5eec01cb459', 'request_id': 'req-d0439403-4f92-4620-9a9f-7d079ccbf46b'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:27.988832 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d0439403-4f92-4620-9a9f-7d079ccbf46b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a4b672abbee4c61a0b8f5eec01cb459', 'request_id': 'req-d0439403-4f92-4620-9a9f-7d079ccbf46b'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:28.097700 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d0439403-4f92-4620-9a9f-7d079ccbf46b admin admin] The token cache is being invalidate because project 3a4b672abbee4c61a0b8f5eec01cb459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:28.098183 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d0439403-4f92-4620-9a9f-7d079ccbf46b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:28.099013 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d0439403-4f92-4620-9a9f-7d079ccbf46b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:28.100829 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 917/1831] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:27 2021] DELETE /identity/v3/projects/3a4b672abbee4c61a0b8f5eec01cb459 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:28.104438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0439403-4f92-4620-9a9f-7d079ccbf46b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:28.110538 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-d0439403-4f92-4620-9a9f-7d079ccbf46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:28.113096 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-bad8f2df-207e-4bd3-85f3-7bbca7e4dad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce9aa95e51b44baac33d7ccc2611019', 'request_id': 'req-bad8f2df-207e-4bd3-85f3-7bbca7e4dad9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:28.118617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-bad8f2df-207e-4bd3-85f3-7bbca7e4dad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce9aa95e51b44baac33d7ccc2611019', 'request_id': 'req-bad8f2df-207e-4bd3-85f3-7bbca7e4dad9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:28.130242 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-bad8f2df-207e-4bd3-85f3-7bbca7e4dad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce9aa95e51b44baac33d7ccc2611019', 'request_id': 'req-bad8f2df-207e-4bd3-85f3-7bbca7e4dad9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:28.181805 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0439403-4f92-4620-9a9f-7d079ccbf46b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:28.233559 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-bad8f2df-207e-4bd3-85f3-7bbca7e4dad9 admin admin] The token cache is being invalidate because project 3ce9aa95e51b44baac33d7ccc2611019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:28.233912 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-bad8f2df-207e-4bd3-85f3-7bbca7e4dad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:28.234691 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-bad8f2df-207e-4bd3-85f3-7bbca7e4dad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:28.236198 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 915/1832] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:27 2021] DELETE /identity/v3/projects/3ce9aa95e51b44baac33d7ccc2611019 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:28.240176 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8f2df-207e-4bd3-85f3-7bbca7e4dad9 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:28.241641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-bad8f2df-207e-4bd3-85f3-7bbca7e4dad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:28.255284 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00200855-665d-4e5c-b466-fc926e05d158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:28.260760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00200855-665d-4e5c-b466-fc926e05d158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:28.260760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00200855-665d-4e5c-b466-fc926e05d158 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:28.260760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00200855-665d-4e5c-b466-fc926e05d158 admin admin] PATH_INFO: `/v3/users/ee76b46e5fab4b57b0be20eac1cfe079` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:28.260760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00200855-665d-4e5c-b466-fc926e05d158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee76b46e5fab4b57b0be20eac1cfe079)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:28.289369 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00200855-665d-4e5c-b466-fc926e05d158 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:28.314487 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8f2df-207e-4bd3-85f3-7bbca7e4dad9 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:28.319040 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caec739-b298-4b1a-8aa0-a289dfd63168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:28.319956 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caec739-b298-4b1a-8aa0-a289dfd63168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:28.320340 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caec739-b298-4b1a-8aa0-a289dfd63168 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:28.320675 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caec739-b298-4b1a-8aa0-a289dfd63168 admin admin] PATH_INFO: `/v3/users/801fcc8eb3524c7f8f0f1cd1c64156f3` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:28.321773 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caec739-b298-4b1a-8aa0-a289dfd63168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=801fcc8eb3524c7f8f0f1cd1c64156f3)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:28.348330 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caec739-b298-4b1a-8aa0-a289dfd63168 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:28.507626 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-00200855-665d-4e5c-b466-fc926e05d158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee76b46e5fab4b57b0be20eac1cfe079'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:28.508244 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-00200855-665d-4e5c-b466-fc926e05d158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee76b46e5fab4b57b0be20eac1cfe079'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:28.590255 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0caec739-b298-4b1a-8aa0-a289dfd63168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '801fcc8eb3524c7f8f0f1cd1c64156f3'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:28.602696 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-00200855-665d-4e5c-b466-fc926e05d158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee76b46e5fab4b57b0be20eac1cfe079'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:28.610726 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-00200855-665d-4e5c-b466-fc926e05d158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee76b46e5fab4b57b0be20eac1cfe079'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:28.611332 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-00200855-665d-4e5c-b466-fc926e05d158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee76b46e5fab4b57b0be20eac1cfe079'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:28.628363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 918/1833] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:28 2021] DELETE /identity/v3/users/ee76b46e5fab4b57b0be20eac1cfe079 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:28.631464 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00200855-665d-4e5c-b466-fc926e05d158 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:28.631464 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-00200855-665d-4e5c-b466-fc926e05d158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:28.690697 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0caec739-b298-4b1a-8aa0-a289dfd63168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '801fcc8eb3524c7f8f0f1cd1c64156f3'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:28.691352 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0caec739-b298-4b1a-8aa0-a289dfd63168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '801fcc8eb3524c7f8f0f1cd1c64156f3'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:28.697300 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00200855-665d-4e5c-b466-fc926e05d158 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:28.701095 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503bbcc-f267-459c-8bd2-c0dca4896136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:28.701260 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0caec739-b298-4b1a-8aa0-a289dfd63168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '801fcc8eb3524c7f8f0f1cd1c64156f3'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:28.701875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503bbcc-f267-459c-8bd2-c0dca4896136 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:28.702029 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0caec739-b298-4b1a-8aa0-a289dfd63168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '801fcc8eb3524c7f8f0f1cd1c64156f3'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:28.702293 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503bbcc-f267-459c-8bd2-c0dca4896136 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:28.702640 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503bbcc-f267-459c-8bd2-c0dca4896136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:28.704704 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-2503bbcc-f267-459c-8bd2-c0dca4896136 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:28.749655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 916/1834] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:28 2021] DELETE /identity/v3/users/801fcc8eb3524c7f8f0f1cd1c64156f3 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:28.788881 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503bbcc-f267-459c-8bd2-c0dca4896136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:28.815649 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503bbcc-f267-459c-8bd2-c0dca4896136 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:28.826299 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 919/1835] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:28 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:29.447510 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caec739-b298-4b1a-8aa0-a289dfd63168 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:29.448854 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-0caec739-b298-4b1a-8aa0-a289dfd63168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:29.562259 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503bbcc-f267-459c-8bd2-c0dca4896136 service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:29.563829 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-2503bbcc-f267-459c-8bd2-c0dca4896136 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:29.577864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caec739-b298-4b1a-8aa0-a289dfd63168 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:29.586972 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b50445-cd1c-4b62-8173-cc88e3aae252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:29.587800 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b50445-cd1c-4b62-8173-cc88e3aae252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:29.588090 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b50445-cd1c-4b62-8173-cc88e3aae252 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:29.588378 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b50445-cd1c-4b62-8173-cc88e3aae252 admin admin] PATH_INFO: `/v3/projects/e61b6ea4c8574aecba465c16f63c82a5` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:29.589594 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b50445-cd1c-4b62-8173-cc88e3aae252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e61b6ea4c8574aecba465c16f63c82a5)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:29.618373 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b50445-cd1c-4b62-8173-cc88e3aae252 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:29.648030 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503bbcc-f267-459c-8bd2-c0dca4896136 service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:29.652331 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e096b-7be0-4054-86b3-d6094cbe62ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:29.653181 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e096b-7be0-4054-86b3-d6094cbe62ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:29.653471 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e096b-7be0-4054-86b3-d6094cbe62ff admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:29.653755 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e096b-7be0-4054-86b3-d6094cbe62ff admin admin] PATH_INFO: `/v3/projects/16bf6bca846249838efaa82be2fbc87c` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:29.654852 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e096b-7be0-4054-86b3-d6094cbe62ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=16bf6bca846249838efaa82be2fbc87c)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:29.681999 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e096b-7be0-4054-86b3-d6094cbe62ff admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:29.774036 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-23b50445-cd1c-4b62-8173-cc88e3aae252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e61b6ea4c8574aecba465c16f63c82a5', 'request_id': 'req-23b50445-cd1c-4b62-8173-cc88e3aae252'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:29.783682 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-23b50445-cd1c-4b62-8173-cc88e3aae252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e61b6ea4c8574aecba465c16f63c82a5', 'request_id': 'req-23b50445-cd1c-4b62-8173-cc88e3aae252'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:29.799167 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-23b50445-cd1c-4b62-8173-cc88e3aae252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e61b6ea4c8574aecba465c16f63c82a5', 'request_id': 'req-23b50445-cd1c-4b62-8173-cc88e3aae252'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:29.827885 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-586e096b-7be0-4054-86b3-d6094cbe62ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16bf6bca846249838efaa82be2fbc87c', 'request_id': 'req-586e096b-7be0-4054-86b3-d6094cbe62ff'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:29.832788 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-586e096b-7be0-4054-86b3-d6094cbe62ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16bf6bca846249838efaa82be2fbc87c', 'request_id': 'req-586e096b-7be0-4054-86b3-d6094cbe62ff'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:29.845048 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-586e096b-7be0-4054-86b3-d6094cbe62ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16bf6bca846249838efaa82be2fbc87c', 'request_id': 'req-586e096b-7be0-4054-86b3-d6094cbe62ff'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:29.901600 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-23b50445-cd1c-4b62-8173-cc88e3aae252 admin admin] The token cache is being invalidate because project e61b6ea4c8574aecba465c16f63c82a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:29.901930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-23b50445-cd1c-4b62-8173-cc88e3aae252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:29.904268 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-23b50445-cd1c-4b62-8173-cc88e3aae252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:29.912117 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 917/1836] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:29 2021] DELETE /identity/v3/projects/e61b6ea4c8574aecba465c16f63c82a5 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:29.914028 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbee31-0410-4c19-9f68-0dc38ed19929 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:29.914516 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbee31-0410-4c19-9f68-0dc38ed19929 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:29.914658 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbee31-0410-4c19-9f68-0dc38ed19929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:29.938632 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-9afbee31-0410-4c19-9f68-0dc38ed19929 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:29.939793 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-9afbee31-0410-4c19-9f68-0dc38ed19929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:29.985434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-586e096b-7be0-4054-86b3-d6094cbe62ff admin admin] The token cache is being invalidate because project 16bf6bca846249838efaa82be2fbc87c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:29.987251 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-586e096b-7be0-4054-86b3-d6094cbe62ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:29.988727 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-586e096b-7be0-4054-86b3-d6094cbe62ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:29.992239 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 920/1837] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:29 2021] DELETE /identity/v3/projects/16bf6bca846249838efaa82be2fbc87c => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:29.998059 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019a76b-47bc-47d5-bee4-c7269831bf60 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:29.998783 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019a76b-47bc-47d5-bee4-c7269831bf60 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:29.999313 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019a76b-47bc-47d5-bee4-c7269831bf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:30.022542 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 918/1838] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:30.030840 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d71470-b4d0-438c-b297-2f87a96151fe None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:30.031209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d71470-b4d0-438c-b297-2f87a96151fe None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:30.031571 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d71470-b4d0-438c-b297-2f87a96151fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:30.042003 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-4019a76b-47bc-47d5-bee4-c7269831bf60 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:30.043592 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-4019a76b-47bc-47d5-bee4-c7269831bf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:30.052917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 921/1839] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:53:30.055622 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-84d71470-b4d0-438c-b297-2f87a96151fe None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:30.056899 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-84d71470-b4d0-438c-b297-2f87a96151fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:30.068316 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 919/1840] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:53:30.069053 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565acad-1342-4c63-8b01-90589bb41d5a None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:30.069908 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565acad-1342-4c63-8b01-90589bb41d5a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:30.070369 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565acad-1342-4c63-8b01-90589bb41d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:30.075281 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d71470-b4d0-438c-b297-2f87a96151fe None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:30.103370 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-e565acad-1342-4c63-8b01-90589bb41d5a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:30.103868 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d71470-b4d0-438c-b297-2f87a96151fe None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:30.105724 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e565acad-1342-4c63-8b01-90589bb41d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:30.119354 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa9551-c48a-45bb-a2dd-ffd80e43e742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:30.119972 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa9551-c48a-45bb-a2dd-ffd80e43e742 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:30.120269 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa9551-c48a-45bb-a2dd-ffd80e43e742 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:30.120607 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa9551-c48a-45bb-a2dd-ffd80e43e742 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:30.121324 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa9551-c48a-45bb-a2dd-ffd80e43e742 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:53:30.124946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa9551-c48a-45bb-a2dd-ffd80e43e742 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:30.126541 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 922/1841] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:30.130312 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565acad-1342-4c63-8b01-90589bb41d5a None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:30.148546 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565acad-1342-4c63-8b01-90589bb41d5a None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:30.154551 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcb0ee-fa57-4615-be7b-948998ea6334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:30.155634 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcb0ee-fa57-4615-be7b-948998ea6334 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:30.156168 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcb0ee-fa57-4615-be7b-948998ea6334 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:30.156691 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcb0ee-fa57-4615-be7b-948998ea6334 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:30.157581 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcb0ee-fa57-4615-be7b-948998ea6334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:53:30.158229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcb0ee-fa57-4615-be7b-948998ea6334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:30.172318 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa9551-c48a-45bb-a2dd-ffd80e43e742 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:30.192490 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcb0ee-fa57-4615-be7b-948998ea6334 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:30.212019 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 923/1842] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:53:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:53:30.214542 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 920/1843] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:53:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:53:30.216333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcb0ee-fa57-4615-be7b-948998ea6334 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:30.222513 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa9551-c48a-45bb-a2dd-ffd80e43e742 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:30.226281 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa9551-c48a-45bb-a2dd-ffd80e43e742 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:30.231648 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb6c27-997d-4dc1-a4c8-67c79b08a555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:30.232308 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb6c27-997d-4dc1-a4c8-67c79b08a555 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:30.232621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb6c27-997d-4dc1-a4c8-67c79b08a555 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:30.232909 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb6c27-997d-4dc1-a4c8-67c79b08a555 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:30.233552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb6c27-997d-4dc1-a4c8-67c79b08a555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:30.242824 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcb0ee-fa57-4615-be7b-948998ea6334 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:30.256600 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274c938-5966-4e3d-88ca-b97cd3ad1bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:30.256805 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274c938-5966-4e3d-88ca-b97cd3ad1bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:30.257089 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274c938-5966-4e3d-88ca-b97cd3ad1bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:30.257368 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274c938-5966-4e3d-88ca-b97cd3ad1bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:30.258007 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274c938-5966-4e3d-88ca-b97cd3ad1bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:30.260635 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb6c27-997d-4dc1-a4c8-67c79b08a555 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:30.299244 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274c938-5966-4e3d-88ca-b97cd3ad1bf8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:30.382803 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 921/1844] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:30 2021] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:30.386679 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb6c27-997d-4dc1-a4c8-67c79b08a555 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:30.455642 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 924/1845] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:30 2021] POST /identity/v3/projects => generated 387 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:30.459953 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274c938-5966-4e3d-88ca-b97cd3ad1bf8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:30.620924 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb6c27-997d-4dc1-a4c8-67c79b08a555 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:30.696773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274c938-5966-4e3d-88ca-b97cd3ad1bf8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:30.712720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad4bbd-2a58-4c54-84dc-003577a2dc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:30.713363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad4bbd-2a58-4c54-84dc-003577a2dc60 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:30.713654 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad4bbd-2a58-4c54-84dc-003577a2dc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:30.713941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad4bbd-2a58-4c54-84dc-003577a2dc60 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:30.714620 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad4bbd-2a58-4c54-84dc-003577a2dc60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:30.788179 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceefc7f-fec3-4453-b27d-5ad6dabd7fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:30.789319 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceefc7f-fec3-4453-b27d-5ad6dabd7fbc admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:30.789319 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceefc7f-fec3-4453-b27d-5ad6dabd7fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:30.789495 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad4bbd-2a58-4c54-84dc-003577a2dc60 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:30.789582 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceefc7f-fec3-4453-b27d-5ad6dabd7fbc admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:30.790140 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceefc7f-fec3-4453-b27d-5ad6dabd7fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:30.859211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceefc7f-fec3-4453-b27d-5ad6dabd7fbc admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:30.908468 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 925/1846] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:30 2021] POST /identity/v3/users => generated 294 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:30.912993 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad4bbd-2a58-4c54-84dc-003577a2dc60 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:30.938682 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad4bbd-2a58-4c54-84dc-003577a2dc60 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:30.943757 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531e355-3933-422d-9923-a8af8045459c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:30.945310 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531e355-3933-422d-9923-a8af8045459c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:30.945950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531e355-3933-422d-9923-a8af8045459c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:30.946420 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531e355-3933-422d-9923-a8af8045459c admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:30.947303 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531e355-3933-422d-9923-a8af8045459c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:30.961385 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 922/1847] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:30 2021] POST /identity/v3/users => generated 294 bytes in 575 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:53:30.962521 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceefc7f-fec3-4453-b27d-5ad6dabd7fbc admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:30.974198 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531e355-3933-422d-9923-a8af8045459c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:30.990584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 926/1848] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:30 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:30.996183 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceefc7f-fec3-4453-b27d-5ad6dabd7fbc admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:31.006857 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531e355-3933-422d-9923-a8af8045459c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:31.011434 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7317c-c335-41b0-8bb2-e1923a336df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:31.013534 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7317c-c335-41b0-8bb2-e1923a336df7 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:31.013976 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7317c-c335-41b0-8bb2-e1923a336df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:31.014267 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7317c-c335-41b0-8bb2-e1923a336df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:31.014978 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7317c-c335-41b0-8bb2-e1923a336df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:31.036272 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531e355-3933-422d-9923-a8af8045459c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:31.053996 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430567ab-79c9-429d-962a-be49700f8efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:31.054843 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430567ab-79c9-429d-962a-be49700f8efd admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:31.055134 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430567ab-79c9-429d-962a-be49700f8efd admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:31.055419 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430567ab-79c9-429d-962a-be49700f8efd admin admin] PATH_INFO: `/v3/projects/6e6c9639a9fd4d07832281def5acba23/users/b1ab775238da4de799a392ea7dd59f6e/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:31.069242 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7317c-c335-41b0-8bb2-e1923a336df7 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:31.107266 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 923/1849] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:30 2021] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:31.110983 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7317c-c335-41b0-8bb2-e1923a336df7 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:31.124575 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430567ab-79c9-429d-962a-be49700f8efd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6c9639a9fd4d07832281def5acba23, user_id=b1ab775238da4de799a392ea7dd59f6e, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:31.127674 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7317c-c335-41b0-8bb2-e1923a336df7 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:31.157342 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f0c2c-1ada-408e-a429-9f7f11fc41ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:31.158145 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f0c2c-1ada-408e-a429-9f7f11fc41ac admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:31.158426 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f0c2c-1ada-408e-a429-9f7f11fc41ac admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:31.158707 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f0c2c-1ada-408e-a429-9f7f11fc41ac admin admin] PATH_INFO: `/v3/projects/2fca0755db074e0fa4cd4836bcfc4c9b/users/b65f4ae73121442c851fd7651f8d002e/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:31.179931 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430567ab-79c9-429d-962a-be49700f8efd admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:31.217374 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f0c2c-1ada-408e-a429-9f7f11fc41ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fca0755db074e0fa4cd4836bcfc4c9b, user_id=b65f4ae73121442c851fd7651f8d002e, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:31.269039 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f0c2c-1ada-408e-a429-9f7f11fc41ac admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:31.320616 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 927/1850] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:31 2021] PUT /identity/v3/projects/6e6c9639a9fd4d07832281def5acba23/users/b1ab775238da4de799a392ea7dd59f6e/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:31.330867 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce2cfd-b67b-4445-ba39-4ad4eefd81c3 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:31.331316 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce2cfd-b67b-4445-ba39-4ad4eefd81c3 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:31.331731 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce2cfd-b67b-4445-ba39-4ad4eefd81c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:31.400507 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-b1ce2cfd-b67b-4445-ba39-4ad4eefd81c3 None None] MFA Rules not processed for user `b1ab775238da4de799a392ea7dd59f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:31.402303 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-b1ce2cfd-b67b-4445-ba39-4ad4eefd81c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:31.417596 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 924/1851] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:31 2021] PUT /identity/v3/projects/2fca0755db074e0fa4cd4836bcfc4c9b/users/b65f4ae73121442c851fd7651f8d002e/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:31.427816 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e9e30-84ed-449d-a955-d64b52f1dbd3 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:31.428693 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e9e30-84ed-449d-a955-d64b52f1dbd3 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:31.428693 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e9e30-84ed-449d-a955-d64b52f1dbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:31.502954 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-426e9e30-84ed-449d-a955-d64b52f1dbd3 None None] MFA Rules not processed for user `b65f4ae73121442c851fd7651f8d002e`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:31.504165 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-426e9e30-84ed-449d-a955-d64b52f1dbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:31.514904 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 928/1852] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:31 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:31.530414 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce2cfd-b67b-4445-ba39-4ad4eefd81c3 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:31.637558 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce2cfd-b67b-4445-ba39-4ad4eefd81c3 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:31.638286 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 925/1853] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:31 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:31.639793 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e9e30-84ed-449d-a955-d64b52f1dbd3 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:31.649881 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc3152-74d8-4303-96ae-b5b068477d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:31.651438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc3152-74d8-4303-96ae-b5b068477d5e admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:31.651438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc3152-74d8-4303-96ae-b5b068477d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:31.651438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc3152-74d8-4303-96ae-b5b068477d5e admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:31.651729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc3152-74d8-4303-96ae-b5b068477d5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:31.654411 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e9e30-84ed-449d-a955-d64b52f1dbd3 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:31.660938 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b68247-bcdd-431d-bfa7-85c4ca37f185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:31.662103 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b68247-bcdd-431d-bfa7-85c4ca37f185 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:31.662752 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b68247-bcdd-431d-bfa7-85c4ca37f185 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:31.663196 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b68247-bcdd-431d-bfa7-85c4ca37f185 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:31.664120 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b68247-bcdd-431d-bfa7-85c4ca37f185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:31.698926 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b68247-bcdd-431d-bfa7-85c4ca37f185 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:31.709041 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc3152-74d8-4303-96ae-b5b068477d5e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:31.817189 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 926/1854] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:31 2021] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:31.821445 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b68247-bcdd-431d-bfa7-85c4ca37f185 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:31.852296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 929/1855] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:31 2021] POST /identity/v3/projects => generated 387 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:31.853275 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc3152-74d8-4303-96ae-b5b068477d5e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:31.938806 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b68247-bcdd-431d-bfa7-85c4ca37f185 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:32.004020 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc3152-74d8-4303-96ae-b5b068477d5e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:32.016857 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b92b5b-b116-44eb-a3e9-bd32944a0f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:32.017570 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b92b5b-b116-44eb-a3e9-bd32944a0f9e admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:32.017923 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b92b5b-b116-44eb-a3e9-bd32944a0f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:32.018278 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b92b5b-b116-44eb-a3e9-bd32944a0f9e admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:32.018992 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b92b5b-b116-44eb-a3e9-bd32944a0f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:32.019748 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9d455-b3e6-4f76-8c2b-c16267fe21df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:32.020476 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9d455-b3e6-4f76-8c2b-c16267fe21df admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:32.020996 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9d455-b3e6-4f76-8c2b-c16267fe21df admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:32.021350 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9d455-b3e6-4f76-8c2b-c16267fe21df admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:32.022105 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9d455-b3e6-4f76-8c2b-c16267fe21df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:32.052108 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9d455-b3e6-4f76-8c2b-c16267fe21df admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:32.074849 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b92b5b-b116-44eb-a3e9-bd32944a0f9e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:32.126020 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 927/1856] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:31 2021] POST /identity/v3/users => generated 299 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:53:32.130109 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9d455-b3e6-4f76-8c2b-c16267fe21df admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:32.141148 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9d455-b3e6-4f76-8c2b-c16267fe21df admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:32.146116 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f30bc-8764-4fe3-9297-402d96a98874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:32.146939 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f30bc-8764-4fe3-9297-402d96a98874 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:32.147280 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f30bc-8764-4fe3-9297-402d96a98874 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:32.147619 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f30bc-8764-4fe3-9297-402d96a98874 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:32.148372 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f30bc-8764-4fe3-9297-402d96a98874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:32.187579 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 930/1857] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:31 2021] POST /identity/v3/users => generated 300 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:32.192287 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b92b5b-b116-44eb-a3e9-bd32944a0f9e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:32.197140 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f30bc-8764-4fe3-9297-402d96a98874 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:32.207008 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b92b5b-b116-44eb-a3e9-bd32944a0f9e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:32.213520 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 928/1858] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:32 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:53:32.216176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb1a8b-410d-4046-adba-c9be486b3806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:32.217105 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb1a8b-410d-4046-adba-c9be486b3806 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:32.218470 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f30bc-8764-4fe3-9297-402d96a98874 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:32.219629 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb1a8b-410d-4046-adba-c9be486b3806 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:32.222610 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb1a8b-410d-4046-adba-c9be486b3806 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:32.223491 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb1a8b-410d-4046-adba-c9be486b3806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:32.239207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f30bc-8764-4fe3-9297-402d96a98874 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:32.249292 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae05ff-d9f5-4c7b-a20b-29ca2f775b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:32.250110 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae05ff-d9f5-4c7b-a20b-29ca2f775b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:32.250390 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae05ff-d9f5-4c7b-a20b-29ca2f775b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:32.250671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae05ff-d9f5-4c7b-a20b-29ca2f775b0f admin admin] PATH_INFO: `/v3/projects/a18d557b75e94dabb67f1c7e188ed931/users/29db0bdf09ab472fadd2174741860747/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:32.281993 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb1a8b-410d-4046-adba-c9be486b3806 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:32.299149 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 931/1859] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:32 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:32.302951 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb1a8b-410d-4046-adba-c9be486b3806 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:32.304742 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae05ff-d9f5-4c7b-a20b-29ca2f775b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18d557b75e94dabb67f1c7e188ed931, user_id=29db0bdf09ab472fadd2174741860747, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:32.314959 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb1a8b-410d-4046-adba-c9be486b3806 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:32.325482 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a23c3-2f89-4f85-b464-9f9aedf1da4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:32.326347 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a23c3-2f89-4f85-b464-9f9aedf1da4d admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:32.326631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a23c3-2f89-4f85-b464-9f9aedf1da4d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:32.326908 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a23c3-2f89-4f85-b464-9f9aedf1da4d admin admin] PATH_INFO: `/v3/projects/92a2b234e5e7450c9f0a3b4ed3f46ef4/users/16c4c2cb29614044a0b08399351afae2/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:32.348770 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae05ff-d9f5-4c7b-a20b-29ca2f775b0f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:32.402386 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a23c3-2f89-4f85-b464-9f9aedf1da4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a2b234e5e7450c9f0a3b4ed3f46ef4, user_id=16c4c2cb29614044a0b08399351afae2, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:32.450976 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a23c3-2f89-4f85-b464-9f9aedf1da4d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:32.469433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 929/1860] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:32 2021] PUT /identity/v3/projects/a18d557b75e94dabb67f1c7e188ed931/users/29db0bdf09ab472fadd2174741860747/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:32.472256 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae05ff-d9f5-4c7b-a20b-29ca2f775b0f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:32.549734 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 932/1861] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:32 2021] PUT /identity/v3/projects/92a2b234e5e7450c9f0a3b4ed3f46ef4/users/16c4c2cb29614044a0b08399351afae2/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:32.555571 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a23c3-2f89-4f85-b464-9f9aedf1da4d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:32.571266 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae05ff-d9f5-4c7b-a20b-29ca2f775b0f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:32.649005 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a23c3-2f89-4f85-b464-9f9aedf1da4d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:32.653691 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060ffef-3d0c-4ee8-8bf3-033b01e2594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:32.654368 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060ffef-3d0c-4ee8-8bf3-033b01e2594a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:32.654665 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060ffef-3d0c-4ee8-8bf3-033b01e2594a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:32.654947 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060ffef-3d0c-4ee8-8bf3-033b01e2594a admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:32.655642 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060ffef-3d0c-4ee8-8bf3-033b01e2594a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:32.663884 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d72be3-f16b-41a0-a164-13749070a0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:32.664664 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d72be3-f16b-41a0-a164-13749070a0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:32.665270 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d72be3-f16b-41a0-a164-13749070a0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:32.665886 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d72be3-f16b-41a0-a164-13749070a0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:32.666688 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d72be3-f16b-41a0-a164-13749070a0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:32.698659 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d72be3-f16b-41a0-a164-13749070a0b0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:32.707157 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060ffef-3d0c-4ee8-8bf3-033b01e2594a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:32.718090 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 930/1862] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:32 2021] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:53:32.720592 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 933/1863] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:32 2021] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:32.722208 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d72be3-f16b-41a0-a164-13749070a0b0 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:32.722498 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060ffef-3d0c-4ee8-8bf3-033b01e2594a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:32.733718 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060ffef-3d0c-4ee8-8bf3-033b01e2594a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:32.736549 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d72be3-f16b-41a0-a164-13749070a0b0 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:32.739281 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8f9d7-1026-4c81-9656-72dbf78443f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:32.740135 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8f9d7-1026-4c81-9656-72dbf78443f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:32.740434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8f9d7-1026-4c81-9656-72dbf78443f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:32.740746 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8f9d7-1026-4c81-9656-72dbf78443f0 admin admin] PATH_INFO: `/v3/projects/92a2b234e5e7450c9f0a3b4ed3f46ef4/users/16c4c2cb29614044a0b08399351afae2/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:32.742698 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8f9d7-1026-4c81-9656-72dbf78443f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a2b234e5e7450c9f0a3b4ed3f46ef4, user_id=16c4c2cb29614044a0b08399351afae2, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:32.742922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c9f62-e4d1-4b79-8ec0-82558942393c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:32.743747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c9f62-e4d1-4b79-8ec0-82558942393c admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:32.744259 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c9f62-e4d1-4b79-8ec0-82558942393c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:32.744431 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c9f62-e4d1-4b79-8ec0-82558942393c admin admin] PATH_INFO: `/v3/projects/a18d557b75e94dabb67f1c7e188ed931/users/29db0bdf09ab472fadd2174741860747/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:32.746314 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c9f62-e4d1-4b79-8ec0-82558942393c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18d557b75e94dabb67f1c7e188ed931, user_id=29db0bdf09ab472fadd2174741860747, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:32.778534 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c9f62-e4d1-4b79-8ec0-82558942393c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:32.790540 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 931/1864] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:32 2021] PUT /identity/v3/projects/a18d557b75e94dabb67f1c7e188ed931/users/29db0bdf09ab472fadd2174741860747/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:32.795228 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c9f62-e4d1-4b79-8ec0-82558942393c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:32.820112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8f9d7-1026-4c81-9656-72dbf78443f0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:32.843798 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 934/1865] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:32 2021] PUT /identity/v3/projects/92a2b234e5e7450c9f0a3b4ed3f46ef4/users/16c4c2cb29614044a0b08399351afae2/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:32.846426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8f9d7-1026-4c81-9656-72dbf78443f0 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:32.914316 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c9f62-e4d1-4b79-8ec0-82558942393c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:32.990488 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8f9d7-1026-4c81-9656-72dbf78443f0 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:32.993772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cf8b9-27cf-4f4c-bc25-2a774f1e026b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:32.994544 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cf8b9-27cf-4f4c-bc25-2a774f1e026b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:32.994833 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cf8b9-27cf-4f4c-bc25-2a774f1e026b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:32.995123 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cf8b9-27cf-4f4c-bc25-2a774f1e026b admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:32.995810 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89cf8b9-27cf-4f4c-bc25-2a774f1e026b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:33.023365 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89cf8b9-27cf-4f4c-bc25-2a774f1e026b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:33.034351 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848c7ff-d84a-4d51-ba53-a249c87ff7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:33.035262 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848c7ff-d84a-4d51-ba53-a249c87ff7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:33.035713 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848c7ff-d84a-4d51-ba53-a249c87ff7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:33.036000 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848c7ff-d84a-4d51-ba53-a249c87ff7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:33.037119 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848c7ff-d84a-4d51-ba53-a249c87ff7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:33.037228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 935/1866] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:32 2021] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:33.041311 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cf8b9-27cf-4f4c-bc25-2a774f1e026b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:33.053479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cf8b9-27cf-4f4c-bc25-2a774f1e026b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:33.059876 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69496e8-4ebe-4579-91a1-9e0582466640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:33.061233 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69496e8-4ebe-4579-91a1-9e0582466640 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:33.061525 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69496e8-4ebe-4579-91a1-9e0582466640 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:33.061807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69496e8-4ebe-4579-91a1-9e0582466640 admin admin] PATH_INFO: `/v3/projects/92a2b234e5e7450c9f0a3b4ed3f46ef4/users/16c4c2cb29614044a0b08399351afae2/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:33.065424 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848c7ff-d84a-4d51-ba53-a249c87ff7b1 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:33.068406 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69496e8-4ebe-4579-91a1-9e0582466640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a2b234e5e7450c9f0a3b4ed3f46ef4, user_id=16c4c2cb29614044a0b08399351afae2, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:33.076384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 932/1867] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:32 2021] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:33.080535 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848c7ff-d84a-4d51-ba53-a249c87ff7b1 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:33.093014 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848c7ff-d84a-4d51-ba53-a249c87ff7b1 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:33.103745 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6eb60-6f44-4397-badb-5be50e683e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:33.104589 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6eb60-6f44-4397-badb-5be50e683e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:33.104891 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6eb60-6f44-4397-badb-5be50e683e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:33.105180 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6eb60-6f44-4397-badb-5be50e683e0d admin admin] PATH_INFO: `/v3/projects/a18d557b75e94dabb67f1c7e188ed931/users/29db0bdf09ab472fadd2174741860747/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:33.106832 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69496e8-4ebe-4579-91a1-9e0582466640 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:33.112008 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6eb60-6f44-4397-badb-5be50e683e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18d557b75e94dabb67f1c7e188ed931, user_id=29db0bdf09ab472fadd2174741860747, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:33.159546 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6eb60-6f44-4397-badb-5be50e683e0d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:33.206359 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 936/1868] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:33 2021] PUT /identity/v3/projects/92a2b234e5e7450c9f0a3b4ed3f46ef4/users/16c4c2cb29614044a0b08399351afae2/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:33.222020 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318210bb-642d-429a-b60d-9b692e81bd8e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:33.222445 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318210bb-642d-429a-b60d-9b692e81bd8e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:33.224791 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318210bb-642d-429a-b60d-9b692e81bd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:33.241499 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 933/1869] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:33 2021] PUT /identity/v3/projects/a18d557b75e94dabb67f1c7e188ed931/users/29db0bdf09ab472fadd2174741860747/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:33.254569 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bb747-2197-433c-92eb-8e978c6c6833 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:33.255144 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bb747-2197-433c-92eb-8e978c6c6833 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:33.255472 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bb747-2197-433c-92eb-8e978c6c6833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:33.285388 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-318210bb-642d-429a-b60d-9b692e81bd8e None None] MFA Rules not processed for user `16c4c2cb29614044a0b08399351afae2`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:33.286832 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-318210bb-642d-429a-b60d-9b692e81bd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:33.388310 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-cb2bb747-2197-433c-92eb-8e978c6c6833 None None] MFA Rules not processed for user `29db0bdf09ab472fadd2174741860747`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:33.393952 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-cb2bb747-2197-433c-92eb-8e978c6c6833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:33.485300 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 937/1870] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:33 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:33.497657 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318210bb-642d-429a-b60d-9b692e81bd8e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:33.501440 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-318210bb-642d-429a-b60d-9b692e81bd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:33.591938 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 934/1871] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:33 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:33.598864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bb747-2197-433c-92eb-8e978c6c6833 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:33.600767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-cb2bb747-2197-433c-92eb-8e978c6c6833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:33.602795 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318210bb-642d-429a-b60d-9b692e81bd8e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:33.611821 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89915fd-741f-4576-a706-0419ce5722a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:33.612937 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89915fd-741f-4576-a706-0419ce5722a2 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:33.614852 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89915fd-741f-4576-a706-0419ce5722a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:33.614852 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89915fd-741f-4576-a706-0419ce5722a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:33.615853 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bb747-2197-433c-92eb-8e978c6c6833 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:33.619788 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c517e-ab63-4b73-85a4-d19ed5adb706 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:33.620669 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c517e-ab63-4b73-85a4-d19ed5adb706 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:33.621106 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c517e-ab63-4b73-85a4-d19ed5adb706 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:33.622120 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c517e-ab63-4b73-85a4-d19ed5adb706 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:33.633326 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c517e-ab63-4b73-85a4-d19ed5adb706 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:33.636207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89915fd-741f-4576-a706-0419ce5722a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:33.665021 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c517e-ab63-4b73-85a4-d19ed5adb706 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:33.678994 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 935/1872] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:33 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:33.681535 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89915fd-741f-4576-a706-0419ce5722a2 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:33.694768 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 938/1873] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:33 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:33.721016 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c517e-ab63-4b73-85a4-d19ed5adb706 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:33.829600 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89915fd-741f-4576-a706-0419ce5722a2 service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:33.869599 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c517e-ab63-4b73-85a4-d19ed5adb706 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:33.876279 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4446e-7a0d-43c4-a52c-a70a7ab76076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:33.877278 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4446e-7a0d-43c4-a52c-a70a7ab76076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:33.877810 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4446e-7a0d-43c4-a52c-a70a7ab76076 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:33.878099 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4446e-7a0d-43c4-a52c-a70a7ab76076 admin admin] PATH_INFO: `/v3/users/b1ab775238da4de799a392ea7dd59f6e` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:33.883367 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4446e-7a0d-43c4-a52c-a70a7ab76076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1ab775238da4de799a392ea7dd59f6e)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:33.932925 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4446e-7a0d-43c4-a52c-a70a7ab76076 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:33.954365 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89915fd-741f-4576-a706-0419ce5722a2 service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:33.966486 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6154daa-9111-4b18-8e0f-9a6b87258337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:33.968385 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6154daa-9111-4b18-8e0f-9a6b87258337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:33.968713 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6154daa-9111-4b18-8e0f-9a6b87258337 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:33.969001 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6154daa-9111-4b18-8e0f-9a6b87258337 admin admin] PATH_INFO: `/v3/users/b65f4ae73121442c851fd7651f8d002e` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:33.971416 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6154daa-9111-4b18-8e0f-9a6b87258337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b65f4ae73121442c851fd7651f8d002e)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:34.013869 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6154daa-9111-4b18-8e0f-9a6b87258337 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:34.331637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-70a4446e-7a0d-43c4-a52c-a70a7ab76076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1ab775238da4de799a392ea7dd59f6e'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:34.385047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-c6154daa-9111-4b18-8e0f-9a6b87258337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b65f4ae73121442c851fd7651f8d002e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:34.387021 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-c6154daa-9111-4b18-8e0f-9a6b87258337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b65f4ae73121442c851fd7651f8d002e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:34.439771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-70a4446e-7a0d-43c4-a52c-a70a7ab76076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1ab775238da4de799a392ea7dd59f6e'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:34.440555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-70a4446e-7a0d-43c4-a52c-a70a7ab76076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1ab775238da4de799a392ea7dd59f6e'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:34.452324 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-70a4446e-7a0d-43c4-a52c-a70a7ab76076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1ab775238da4de799a392ea7dd59f6e'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:34.453290 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-70a4446e-7a0d-43c4-a52c-a70a7ab76076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1ab775238da4de799a392ea7dd59f6e'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:34.498046 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 936/1874] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:33 2021] DELETE /identity/v3/users/b1ab775238da4de799a392ea7dd59f6e => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:34.502902 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddefc1-af8b-4841-9401-5ddefddfacfb None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:34.503473 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddefc1-af8b-4841-9401-5ddefddfacfb None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:34.504140 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddefc1-af8b-4841-9401-5ddefddfacfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:34.537634 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-c6154daa-9111-4b18-8e0f-9a6b87258337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b65f4ae73121442c851fd7651f8d002e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:34.554920 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-c6154daa-9111-4b18-8e0f-9a6b87258337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b65f4ae73121442c851fd7651f8d002e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:34.560977 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-c6154daa-9111-4b18-8e0f-9a6b87258337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b65f4ae73121442c851fd7651f8d002e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:34.574120 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-bdddefc1-af8b-4841-9401-5ddefddfacfb None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:34.581832 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-bdddefc1-af8b-4841-9401-5ddefddfacfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:34.622678 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 939/1875] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:33 2021] DELETE /identity/v3/users/b65f4ae73121442c851fd7651f8d002e => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:34.626944 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391372ed-4454-428c-80e2-d6c7319033d0 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:34.627237 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391372ed-4454-428c-80e2-d6c7319033d0 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:34.630683 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391372ed-4454-428c-80e2-d6c7319033d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:34.683607 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-391372ed-4454-428c-80e2-d6c7319033d0 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:34.684918 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-391372ed-4454-428c-80e2-d6c7319033d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:34.716863 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 937/1876] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:34.734500 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddefc1-af8b-4841-9401-5ddefddfacfb None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:34.736251 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-bdddefc1-af8b-4841-9401-5ddefddfacfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:34.841747 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 940/1877] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:53:34.848717 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391372ed-4454-428c-80e2-d6c7319033d0 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:34.850291 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-391372ed-4454-428c-80e2-d6c7319033d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:34.887902 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddefc1-af8b-4841-9401-5ddefddfacfb None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:34.949057 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391372ed-4454-428c-80e2-d6c7319033d0 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:34.960282 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21736f3b-2f95-44f3-a124-35f2cf0f6cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:34.961103 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21736f3b-2f95-44f3-a124-35f2cf0f6cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:34.961544 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21736f3b-2f95-44f3-a124-35f2cf0f6cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:34.961827 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21736f3b-2f95-44f3-a124-35f2cf0f6cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:34.972960 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21736f3b-2f95-44f3-a124-35f2cf0f6cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:34.979236 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b0a40-f94f-4266-b79c-878e6ba6c4e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:34.979977 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b0a40-f94f-4266-b79c-878e6ba6c4e5 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:34.980266 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b0a40-f94f-4266-b79c-878e6ba6c4e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:34.980759 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b0a40-f94f-4266-b79c-878e6ba6c4e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:34.990143 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b0a40-f94f-4266-b79c-878e6ba6c4e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:34.997418 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21736f3b-2f95-44f3-a124-35f2cf0f6cd5 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:35.008023 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 941/1878] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:34 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:35.019402 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b0a40-f94f-4266-b79c-878e6ba6c4e5 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:35.033435 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 938/1879] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:34 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:35.800995 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21736f3b-2f95-44f3-a124-35f2cf0f6cd5 service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:35.802826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-21736f3b-2f95-44f3-a124-35f2cf0f6cd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:35.830712 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21736f3b-2f95-44f3-a124-35f2cf0f6cd5 service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:35.842647 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bce1c-f2b9-4a34-a492-f6c4ee26c85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:35.843989 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bce1c-f2b9-4a34-a492-f6c4ee26c85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:35.844407 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bce1c-f2b9-4a34-a492-f6c4ee26c85f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:35.844871 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bce1c-f2b9-4a34-a492-f6c4ee26c85f admin admin] PATH_INFO: `/v3/projects/2fca0755db074e0fa4cd4836bcfc4c9b` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:35.846681 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bce1c-f2b9-4a34-a492-f6c4ee26c85f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fca0755db074e0fa4cd4836bcfc4c9b)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:35.910625 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bce1c-f2b9-4a34-a492-f6c4ee26c85f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:36.006328 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b0a40-f94f-4266-b79c-878e6ba6c4e5 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:36.007554 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-425b0a40-f94f-4266-b79c-878e6ba6c4e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:36.020148 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b0a40-f94f-4266-b79c-878e6ba6c4e5 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:36.026768 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f937b0b-0ee3-4297-bdce-60b3b70944b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:36.028425 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f937b0b-0ee3-4297-bdce-60b3b70944b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:36.028885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f937b0b-0ee3-4297-bdce-60b3b70944b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:36.029309 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f937b0b-0ee3-4297-bdce-60b3b70944b2 admin admin] PATH_INFO: `/v3/projects/6e6c9639a9fd4d07832281def5acba23` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:36.031222 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f937b0b-0ee3-4297-bdce-60b3b70944b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e6c9639a9fd4d07832281def5acba23)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:36.073658 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f937b0b-0ee3-4297-bdce-60b3b70944b2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:36.081162 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7c3bce1c-f2b9-4a34-a492-f6c4ee26c85f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fca0755db074e0fa4cd4836bcfc4c9b', 'request_id': 'req-7c3bce1c-f2b9-4a34-a492-f6c4ee26c85f'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:36.091128 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7c3bce1c-f2b9-4a34-a492-f6c4ee26c85f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fca0755db074e0fa4cd4836bcfc4c9b', 'request_id': 'req-7c3bce1c-f2b9-4a34-a492-f6c4ee26c85f'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:36.104017 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7c3bce1c-f2b9-4a34-a492-f6c4ee26c85f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fca0755db074e0fa4cd4836bcfc4c9b', 'request_id': 'req-7c3bce1c-f2b9-4a34-a492-f6c4ee26c85f'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:36.200442 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7c3bce1c-f2b9-4a34-a492-f6c4ee26c85f admin admin] The token cache is being invalidate because project 2fca0755db074e0fa4cd4836bcfc4c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:36.201021 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7c3bce1c-f2b9-4a34-a492-f6c4ee26c85f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:36.202294 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7c3bce1c-f2b9-4a34-a492-f6c4ee26c85f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:36.204439 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 942/1880] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:35 2021] DELETE /identity/v3/projects/2fca0755db074e0fa4cd4836bcfc4c9b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:36.208065 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bce1c-f2b9-4a34-a492-f6c4ee26c85f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:36.209682 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-7c3bce1c-f2b9-4a34-a492-f6c4ee26c85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:36.286371 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5f937b0b-0ee3-4297-bdce-60b3b70944b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e6c9639a9fd4d07832281def5acba23', 'request_id': 'req-5f937b0b-0ee3-4297-bdce-60b3b70944b2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:36.297147 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bce1c-f2b9-4a34-a492-f6c4ee26c85f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:36.301069 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5f937b0b-0ee3-4297-bdce-60b3b70944b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e6c9639a9fd4d07832281def5acba23', 'request_id': 'req-5f937b0b-0ee3-4297-bdce-60b3b70944b2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:36.313148 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5f937b0b-0ee3-4297-bdce-60b3b70944b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e6c9639a9fd4d07832281def5acba23', 'request_id': 'req-5f937b0b-0ee3-4297-bdce-60b3b70944b2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:36.385718 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465567f-7e21-4ca2-a3e1-bdf519908a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:36.386540 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465567f-7e21-4ca2-a3e1-bdf519908a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:36.387363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465567f-7e21-4ca2-a3e1-bdf519908a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:36.389581 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465567f-7e21-4ca2-a3e1-bdf519908a02 admin admin] PATH_INFO: `/v3/users/29db0bdf09ab472fadd2174741860747` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:36.393188 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465567f-7e21-4ca2-a3e1-bdf519908a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29db0bdf09ab472fadd2174741860747)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:36.426920 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5f937b0b-0ee3-4297-bdce-60b3b70944b2 admin admin] The token cache is being invalidate because project 6e6c9639a9fd4d07832281def5acba23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:36.427256 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5f937b0b-0ee3-4297-bdce-60b3b70944b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:36.427876 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5f937b0b-0ee3-4297-bdce-60b3b70944b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:36.430066 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 939/1881] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:36 2021] DELETE /identity/v3/projects/6e6c9639a9fd4d07832281def5acba23 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:36.437152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f937b0b-0ee3-4297-bdce-60b3b70944b2 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:36.438336 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5f937b0b-0ee3-4297-bdce-60b3b70944b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:36.470563 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f937b0b-0ee3-4297-bdce-60b3b70944b2 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:36.483597 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465567f-7e21-4ca2-a3e1-bdf519908a02 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:36.483863 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9ff0c-6e2e-4cca-903c-df455829ff99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:36.484855 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9ff0c-6e2e-4cca-903c-df455829ff99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:36.485303 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9ff0c-6e2e-4cca-903c-df455829ff99 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:36.485590 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9ff0c-6e2e-4cca-903c-df455829ff99 admin admin] PATH_INFO: `/v3/users/16c4c2cb29614044a0b08399351afae2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:36.486724 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9ff0c-6e2e-4cca-903c-df455829ff99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16c4c2cb29614044a0b08399351afae2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:36.537705 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9ff0c-6e2e-4cca-903c-df455829ff99 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:36.763853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0465567f-7e21-4ca2-a3e1-bdf519908a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29db0bdf09ab472fadd2174741860747'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:36.764711 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0465567f-7e21-4ca2-a3e1-bdf519908a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29db0bdf09ab472fadd2174741860747'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:36.836611 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d1a9ff0c-6e2e-4cca-903c-df455829ff99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16c4c2cb29614044a0b08399351afae2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:36.872692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0465567f-7e21-4ca2-a3e1-bdf519908a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29db0bdf09ab472fadd2174741860747'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:36.872692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0465567f-7e21-4ca2-a3e1-bdf519908a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29db0bdf09ab472fadd2174741860747'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:36.872692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0465567f-7e21-4ca2-a3e1-bdf519908a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29db0bdf09ab472fadd2174741860747'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:36.889981 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 943/1882] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:36 2021] DELETE /identity/v3/users/29db0bdf09ab472fadd2174741860747 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:36.891008 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465567f-7e21-4ca2-a3e1-bdf519908a02 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:36.892593 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0465567f-7e21-4ca2-a3e1-bdf519908a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:36.973684 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465567f-7e21-4ca2-a3e1-bdf519908a02 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:36.978804 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb09c0a-aae8-4063-a071-5d3f5ebf8a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:36.979832 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb09c0a-aae8-4063-a071-5d3f5ebf8a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:36.980325 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb09c0a-aae8-4063-a071-5d3f5ebf8a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:36.980903 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb09c0a-aae8-4063-a071-5d3f5ebf8a42 admin admin] PATH_INFO: `/v3/users/6510aa52ff6b450ba8a7e1bf78f06d55` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:36.982254 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb09c0a-aae8-4063-a071-5d3f5ebf8a42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6510aa52ff6b450ba8a7e1bf78f06d55)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:36.994369 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d1a9ff0c-6e2e-4cca-903c-df455829ff99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16c4c2cb29614044a0b08399351afae2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:36.995462 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d1a9ff0c-6e2e-4cca-903c-df455829ff99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16c4c2cb29614044a0b08399351afae2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:37.007298 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d1a9ff0c-6e2e-4cca-903c-df455829ff99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16c4c2cb29614044a0b08399351afae2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:37.012986 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d1a9ff0c-6e2e-4cca-903c-df455829ff99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16c4c2cb29614044a0b08399351afae2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:37.021527 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb09c0a-aae8-4063-a071-5d3f5ebf8a42 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:37.051798 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 940/1883] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:36 2021] DELETE /identity/v3/users/16c4c2cb29614044a0b08399351afae2 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:37.419769 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ddb09c0a-aae8-4063-a071-5d3f5ebf8a42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6510aa52ff6b450ba8a7e1bf78f06d55'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:37.420934 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ddb09c0a-aae8-4063-a071-5d3f5ebf8a42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6510aa52ff6b450ba8a7e1bf78f06d55'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:37.557298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ddb09c0a-aae8-4063-a071-5d3f5ebf8a42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6510aa52ff6b450ba8a7e1bf78f06d55'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:37.571135 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ddb09c0a-aae8-4063-a071-5d3f5ebf8a42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6510aa52ff6b450ba8a7e1bf78f06d55'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:37.572098 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ddb09c0a-aae8-4063-a071-5d3f5ebf8a42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6510aa52ff6b450ba8a7e1bf78f06d55'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:37.623632 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 944/1884] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:36 2021] DELETE /identity/v3/users/6510aa52ff6b450ba8a7e1bf78f06d55 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:37.625386 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf6424-7ad2-47f4-9ddc-a095832f2201 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:37.625689 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf6424-7ad2-47f4-9ddc-a095832f2201 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:37.625975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf6424-7ad2-47f4-9ddc-a095832f2201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:37.654493 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-8bcf6424-7ad2-47f4-9ddc-a095832f2201 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:37.655653 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-8bcf6424-7ad2-47f4-9ddc-a095832f2201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:37.728962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 941/1885] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:37.739176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb09c0a-aae8-4063-a071-5d3f5ebf8a42 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:37.740522 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ddb09c0a-aae8-4063-a071-5d3f5ebf8a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:37.816089 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb09c0a-aae8-4063-a071-5d3f5ebf8a42 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:37.819626 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876acc7-ec3c-4c56-9b8c-ee5cd870d768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:37.820408 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876acc7-ec3c-4c56-9b8c-ee5cd870d768 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:37.820729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876acc7-ec3c-4c56-9b8c-ee5cd870d768 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:37.821003 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876acc7-ec3c-4c56-9b8c-ee5cd870d768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:37.831153 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876acc7-ec3c-4c56-9b8c-ee5cd870d768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:37.856921 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876acc7-ec3c-4c56-9b8c-ee5cd870d768 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:37.866724 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 945/1886] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:37 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:37.937353 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf6424-7ad2-47f4-9ddc-a095832f2201 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:37.937353 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-8bcf6424-7ad2-47f4-9ddc-a095832f2201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:37.948948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876acc7-ec3c-4c56-9b8c-ee5cd870d768 service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:37.950735 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf6424-7ad2-47f4-9ddc-a095832f2201 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:37.953333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-b876acc7-ec3c-4c56-9b8c-ee5cd870d768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:37.955189 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa44ec-0668-47a8-a70f-9ab9be590db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:37.956884 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa44ec-0668-47a8-a70f-9ab9be590db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:37.957496 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa44ec-0668-47a8-a70f-9ab9be590db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:37.958162 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa44ec-0668-47a8-a70f-9ab9be590db3 admin admin] PATH_INFO: `/v3/projects/92a2b234e5e7450c9f0a3b4ed3f46ef4` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:37.960990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa44ec-0668-47a8-a70f-9ab9be590db3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92a2b234e5e7450c9f0a3b4ed3f46ef4)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:37.975724 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876acc7-ec3c-4c56-9b8c-ee5cd870d768 service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:37.982427 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcc122-921e-482c-a468-9c95d4547b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:37.984179 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcc122-921e-482c-a468-9c95d4547b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:37.985529 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcc122-921e-482c-a468-9c95d4547b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:37.986009 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcc122-921e-482c-a468-9c95d4547b05 admin admin] PATH_INFO: `/v3/projects/a18d557b75e94dabb67f1c7e188ed931` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:37.992279 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcc122-921e-482c-a468-9c95d4547b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18d557b75e94dabb67f1c7e188ed931)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:37.992526 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa44ec-0668-47a8-a70f-9ab9be590db3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:38.021058 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcc122-921e-482c-a468-9c95d4547b05 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:38.127709 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-80aa44ec-0668-47a8-a70f-9ab9be590db3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92a2b234e5e7450c9f0a3b4ed3f46ef4', 'request_id': 'req-80aa44ec-0668-47a8-a70f-9ab9be590db3'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:38.134356 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-80aa44ec-0668-47a8-a70f-9ab9be590db3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92a2b234e5e7450c9f0a3b4ed3f46ef4', 'request_id': 'req-80aa44ec-0668-47a8-a70f-9ab9be590db3'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:38.147571 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-80aa44ec-0668-47a8-a70f-9ab9be590db3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92a2b234e5e7450c9f0a3b4ed3f46ef4', 'request_id': 'req-80aa44ec-0668-47a8-a70f-9ab9be590db3'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:38.161135 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7cdcc122-921e-482c-a468-9c95d4547b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18d557b75e94dabb67f1c7e188ed931', 'request_id': 'req-7cdcc122-921e-482c-a468-9c95d4547b05'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:38.166399 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7cdcc122-921e-482c-a468-9c95d4547b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18d557b75e94dabb67f1c7e188ed931', 'request_id': 'req-7cdcc122-921e-482c-a468-9c95d4547b05'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:38.179405 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7cdcc122-921e-482c-a468-9c95d4547b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18d557b75e94dabb67f1c7e188ed931', 'request_id': 'req-7cdcc122-921e-482c-a468-9c95d4547b05'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:38.246651 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-80aa44ec-0668-47a8-a70f-9ab9be590db3 admin admin] The token cache is being invalidate because project 92a2b234e5e7450c9f0a3b4ed3f46ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:38.247345 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-80aa44ec-0668-47a8-a70f-9ab9be590db3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:38.265368 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-80aa44ec-0668-47a8-a70f-9ab9be590db3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:38.265368 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 942/1887] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:37 2021] DELETE /identity/v3/projects/92a2b234e5e7450c9f0a3b4ed3f46ef4 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:38.273428 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d670ab-cba1-4535-967e-2a3486d13bc9 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:38.274150 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d670ab-cba1-4535-967e-2a3486d13bc9 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:38.274928 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d670ab-cba1-4535-967e-2a3486d13bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:38.325732 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-d7d670ab-cba1-4535-967e-2a3486d13bc9 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:38.325732 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d7d670ab-cba1-4535-967e-2a3486d13bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:38.381076 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7cdcc122-921e-482c-a468-9c95d4547b05 admin admin] The token cache is being invalidate because project a18d557b75e94dabb67f1c7e188ed931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:38.381371 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7cdcc122-921e-482c-a468-9c95d4547b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:38.383228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7cdcc122-921e-482c-a468-9c95d4547b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:38.385393 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 946/1888] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:37 2021] DELETE /identity/v3/projects/a18d557b75e94dabb67f1c7e188ed931 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:38.390756 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3135c-b835-4db5-bd94-d4bbc22f0ff1 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:38.391169 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3135c-b835-4db5-bd94-d4bbc22f0ff1 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:38.391827 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3135c-b835-4db5-bd94-d4bbc22f0ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:38.401220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 943/1889] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:53:38.408866 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d6067-3afe-4015-aea9-ce2bd4c45235 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:38.408866 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d6067-3afe-4015-aea9-ce2bd4c45235 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:38.408866 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d6067-3afe-4015-aea9-ce2bd4c45235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:38.419362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-78b3135c-b835-4db5-bd94-d4bbc22f0ff1 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:38.420772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-78b3135c-b835-4db5-bd94-d4bbc22f0ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:38.429777 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 947/1890] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:38.438876 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae2f65-5beb-4b05-a005-827099e46a82 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:38.439167 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae2f65-5beb-4b05-a005-827099e46a82 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:38.439444 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae2f65-5beb-4b05-a005-827099e46a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:38.444050 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-fe0d6067-3afe-4015-aea9-ce2bd4c45235 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:38.445694 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-fe0d6067-3afe-4015-aea9-ce2bd4c45235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:38.457741 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 944/1891] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:38.461933 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d6067-3afe-4015-aea9-ce2bd4c45235 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:38.462787 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-1cae2f65-5beb-4b05-a005-827099e46a82 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:38.463911 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1cae2f65-5beb-4b05-a005-827099e46a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:38.471149 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d6067-3afe-4015-aea9-ce2bd4c45235 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:38.474669 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 948/1892] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:38.475581 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae2f65-5beb-4b05-a005-827099e46a82 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:38.478720 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b2f83-02f5-4ba8-b11a-39e8adecbfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:38.479315 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b2f83-02f5-4ba8-b11a-39e8adecbfc5 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:38.479767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b2f83-02f5-4ba8-b11a-39e8adecbfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:38.480052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b2f83-02f5-4ba8-b11a-39e8adecbfc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:38.481395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b2f83-02f5-4ba8-b11a-39e8adecbfc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:53:38.481727 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b2f83-02f5-4ba8-b11a-39e8adecbfc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:38.485287 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae2f65-5beb-4b05-a005-827099e46a82 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:38.490002 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadd71a-442f-4e46-965a-e4a3e1bd6848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:38.490959 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadd71a-442f-4e46-965a-e4a3e1bd6848 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:38.490959 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadd71a-442f-4e46-965a-e4a3e1bd6848 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:38.492734 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadd71a-442f-4e46-965a-e4a3e1bd6848 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:38.492734 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadd71a-442f-4e46-965a-e4a3e1bd6848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:53:38.492734 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadd71a-442f-4e46-965a-e4a3e1bd6848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:38.508248 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b2f83-02f5-4ba8-b11a-39e8adecbfc5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:38.523586 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 945/1893] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:53:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:53:38.526389 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadd71a-442f-4e46-965a-e4a3e1bd6848 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:38.540188 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b2f83-02f5-4ba8-b11a-39e8adecbfc5 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:38.544850 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 949/1894] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:53:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:53:38.547684 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadd71a-442f-4e46-965a-e4a3e1bd6848 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:38.557278 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadd71a-442f-4e46-965a-e4a3e1bd6848 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:38.558563 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b2f83-02f5-4ba8-b11a-39e8adecbfc5 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:38.563008 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bebaff-ebf7-4638-8e85-2fb840feda30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:38.563700 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bebaff-ebf7-4638-8e85-2fb840feda30 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:38.564319 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bebaff-ebf7-4638-8e85-2fb840feda30 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:38.566123 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86327177-c060-4755-91dc-5f08705a8e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:38.566794 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86327177-c060-4755-91dc-5f08705a8e46 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:38.566995 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86327177-c060-4755-91dc-5f08705a8e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:38.567280 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86327177-c060-4755-91dc-5f08705a8e46 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:38.567954 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86327177-c060-4755-91dc-5f08705a8e46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:38.568662 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bebaff-ebf7-4638-8e85-2fb840feda30 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:38.569626 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bebaff-ebf7-4638-8e85-2fb840feda30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:38.593875 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86327177-c060-4755-91dc-5f08705a8e46 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:38.595608 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bebaff-ebf7-4638-8e85-2fb840feda30 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:38.683373 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 946/1895] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:38 2021] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:38.685022 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86327177-c060-4755-91dc-5f08705a8e46 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:38.686740 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-86327177-c060-4755-91dc-5f08705a8e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:38.721632 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 950/1896] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:38 2021] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:38.721632 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bebaff-ebf7-4638-8e85-2fb840feda30 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:38.759164 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86327177-c060-4755-91dc-5f08705a8e46 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:38.800590 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bebaff-ebf7-4638-8e85-2fb840feda30 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:38.804918 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a578c-3e76-41ca-9672-efdde86c7c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:38.805529 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a578c-3e76-41ca-9672-efdde86c7c21 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:38.806122 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a578c-3e76-41ca-9672-efdde86c7c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:38.806122 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a578c-3e76-41ca-9672-efdde86c7c21 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:38.806720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a578c-3e76-41ca-9672-efdde86c7c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:38.821944 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66466c96-0ed3-42dd-98cf-795a81ff7ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:38.822743 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66466c96-0ed3-42dd-98cf-795a81ff7ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:38.823031 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66466c96-0ed3-42dd-98cf-795a81ff7ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:38.823310 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66466c96-0ed3-42dd-98cf-795a81ff7ce3 admin admin] PATH_INFO: `/v3/projects/b661dbaa0a054de4983a591be16a820f` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:38.824458 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66466c96-0ed3-42dd-98cf-795a81ff7ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b661dbaa0a054de4983a591be16a820f)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:38.832858 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a578c-3e76-41ca-9672-efdde86c7c21 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:38.851025 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66466c96-0ed3-42dd-98cf-795a81ff7ce3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:38.911773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 951/1897] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:38 2021] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:38.912629 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a578c-3e76-41ca-9672-efdde86c7c21 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:38.922440 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a578c-3e76-41ca-9672-efdde86c7c21 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:38.927082 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fbf93-a950-4bfd-ac65-2b184e09fe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:38.927722 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fbf93-a950-4bfd-ac65-2b184e09fe4b admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:38.928064 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fbf93-a950-4bfd-ac65-2b184e09fe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:38.928350 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fbf93-a950-4bfd-ac65-2b184e09fe4b admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:38.929027 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fbf93-a950-4bfd-ac65-2b184e09fe4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:38.955328 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fbf93-a950-4bfd-ac65-2b184e09fe4b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:38.991762 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-66466c96-0ed3-42dd-98cf-795a81ff7ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b661dbaa0a054de4983a591be16a820f', 'request_id': 'req-66466c96-0ed3-42dd-98cf-795a81ff7ce3'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:38.996901 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-66466c96-0ed3-42dd-98cf-795a81ff7ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b661dbaa0a054de4983a591be16a820f', 'request_id': 'req-66466c96-0ed3-42dd-98cf-795a81ff7ce3'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:39.008328 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-66466c96-0ed3-42dd-98cf-795a81ff7ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b661dbaa0a054de4983a591be16a820f', 'request_id': 'req-66466c96-0ed3-42dd-98cf-795a81ff7ce3'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:39.055621 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 952/1898] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:38 2021] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:39.056677 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fbf93-a950-4bfd-ac65-2b184e09fe4b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:39.065974 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fbf93-a950-4bfd-ac65-2b184e09fe4b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:39.081966 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-66466c96-0ed3-42dd-98cf-795a81ff7ce3 admin admin] The token cache is being invalidate because project b661dbaa0a054de4983a591be16a820f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:39.082365 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-66466c96-0ed3-42dd-98cf-795a81ff7ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:39.082971 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-66466c96-0ed3-42dd-98cf-795a81ff7ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:39.084400 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 947/1899] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:38 2021] DELETE /identity/v3/projects/b661dbaa0a054de4983a591be16a820f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:39.085671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66466c96-0ed3-42dd-98cf-795a81ff7ce3 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:39.087700 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-66466c96-0ed3-42dd-98cf-795a81ff7ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:39.129541 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bc76e-f860-429b-83ca-ae66694c4d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:39.130066 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bc76e-f860-429b-83ca-ae66694c4d88 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:39.130354 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bc76e-f860-429b-83ca-ae66694c4d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:39.130641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bc76e-f860-429b-83ca-ae66694c4d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:39.131363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876bc76e-f860-429b-83ca-ae66694c4d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:39.156898 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876bc76e-f860-429b-83ca-ae66694c4d88 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:39.157822 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66466c96-0ed3-42dd-98cf-795a81ff7ce3 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:39.162197 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d3384-a322-4597-a42a-a75dcb7e3991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:39.162799 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d3384-a322-4597-a42a-a75dcb7e3991 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:39.163108 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d3384-a322-4597-a42a-a75dcb7e3991 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:39.163408 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d3384-a322-4597-a42a-a75dcb7e3991 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:39.164106 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d3384-a322-4597-a42a-a75dcb7e3991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:39.167161 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 953/1900] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:39 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:39.168135 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bc76e-f860-429b-83ca-ae66694c4d88 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:39.170155 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-876bc76e-f860-429b-83ca-ae66694c4d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:39.181715 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bc76e-f860-429b-83ca-ae66694c4d88 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:39.186393 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c052a6e-c65f-4d49-bed3-165466c7279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:39.187171 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c052a6e-c65f-4d49-bed3-165466c7279d admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:39.187514 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c052a6e-c65f-4d49-bed3-165466c7279d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:39.188236 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c052a6e-c65f-4d49-bed3-165466c7279d admin admin] PATH_INFO: `/v3/users/26d811892e1c4794af97ea32fd0fadca` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:39.188903 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c052a6e-c65f-4d49-bed3-165466c7279d admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d811892e1c4794af97ea32fd0fadca)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:39.190631 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d3384-a322-4597-a42a-a75dcb7e3991 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:39.201579 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 948/1901] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:39 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:39.206373 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d3384-a322-4597-a42a-a75dcb7e3991 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:39.206373 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-fd8d3384-a322-4597-a42a-a75dcb7e3991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:39.215827 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d3384-a322-4597-a42a-a75dcb7e3991 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:39.215960 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c052a6e-c65f-4d49-bed3-165466c7279d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:39.220053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24bcf7-1721-4a12-9d62-bf34c6e237f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:39.220887 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24bcf7-1721-4a12-9d62-bf34c6e237f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:39.221180 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24bcf7-1721-4a12-9d62-bf34c6e237f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:39.221468 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24bcf7-1721-4a12-9d62-bf34c6e237f9 admin admin] PATH_INFO: `/v3/projects/998794aae31f4d29a34c033bf6c5c8a6/users/355055386297402dbf7228c078fe71cc/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:39.241258 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24bcf7-1721-4a12-9d62-bf34c6e237f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=998794aae31f4d29a34c033bf6c5c8a6, user_id=355055386297402dbf7228c078fe71cc, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:39.269275 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24bcf7-1721-4a12-9d62-bf34c6e237f9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:39.383158 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 949/1902] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:39 2021] PUT /identity/v3/projects/998794aae31f4d29a34c033bf6c5c8a6/users/355055386297402dbf7228c078fe71cc/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:39.384125 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24bcf7-1721-4a12-9d62-bf34c6e237f9 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:39.469325 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24bcf7-1721-4a12-9d62-bf34c6e237f9 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:39.471679 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5c052a6e-c65f-4d49-bed3-165466c7279d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d811892e1c4794af97ea32fd0fadca'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:39.473019 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5c052a6e-c65f-4d49-bed3-165466c7279d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d811892e1c4794af97ea32fd0fadca'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:39.474885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73321d2-7eed-450f-a157-f90333722f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:39.475430 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73321d2-7eed-450f-a157-f90333722f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:39.475786 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73321d2-7eed-450f-a157-f90333722f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:39.476104 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73321d2-7eed-450f-a157-f90333722f9f admin admin] PATH_INFO: `/v3/projects/501d22939721426ba0c8f73521556b40/users/42dc06cfe5bc42078b4c8f9a2afc0d78/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:39.495444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73321d2-7eed-450f-a157-f90333722f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=501d22939721426ba0c8f73521556b40, user_id=42dc06cfe5bc42078b4c8f9a2afc0d78, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:39.522529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73321d2-7eed-450f-a157-f90333722f9f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:39.536572 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5c052a6e-c65f-4d49-bed3-165466c7279d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d811892e1c4794af97ea32fd0fadca'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:39.547113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5c052a6e-c65f-4d49-bed3-165466c7279d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d811892e1c4794af97ea32fd0fadca'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:39.548116 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5c052a6e-c65f-4d49-bed3-165466c7279d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d811892e1c4794af97ea32fd0fadca'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:39.570212 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 954/1903] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:39 2021] DELETE /identity/v3/users/26d811892e1c4794af97ea32fd0fadca => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:39.571620 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d135f-4ee5-482d-b6b0-21f09fa0218b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:39.571809 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d135f-4ee5-482d-b6b0-21f09fa0218b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:39.572097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d135f-4ee5-482d-b6b0-21f09fa0218b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:39.593458 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 950/1904] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:39 2021] PUT /identity/v3/projects/501d22939721426ba0c8f73521556b40/users/42dc06cfe5bc42078b4c8f9a2afc0d78/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:39.606844 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7635a-99db-4003-9170-3920a4212028 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:39.607138 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7635a-99db-4003-9170-3920a4212028 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:39.607421 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7635a-99db-4003-9170-3920a4212028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:39.617969 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-bc5d135f-4ee5-482d-b6b0-21f09fa0218b None None] MFA Rules not processed for user `355055386297402dbf7228c078fe71cc`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:39.619232 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-bc5d135f-4ee5-482d-b6b0-21f09fa0218b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:39.674596 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-1de7635a-99db-4003-9170-3920a4212028 None None] MFA Rules not processed for user `42dc06cfe5bc42078b4c8f9a2afc0d78`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:39.676365 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1de7635a-99db-4003-9170-3920a4212028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:39.699961 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 955/1905] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:39 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:39.706024 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d135f-4ee5-482d-b6b0-21f09fa0218b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:39.707557 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-bc5d135f-4ee5-482d-b6b0-21f09fa0218b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:39.766925 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 951/1906] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:39 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:39.771265 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7635a-99db-4003-9170-3920a4212028 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:39.772624 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1de7635a-99db-4003-9170-3920a4212028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:39.792827 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d135f-4ee5-482d-b6b0-21f09fa0218b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:39.798917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93baab-5f51-477d-b437-09531578a42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:39.798917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93baab-5f51-477d-b437-09531578a42a admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:39.798917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93baab-5f51-477d-b437-09531578a42a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:39.798917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93baab-5f51-477d-b437-09531578a42a admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:39.799720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93baab-5f51-477d-b437-09531578a42a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:39.826771 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93baab-5f51-477d-b437-09531578a42a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:39.845823 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7635a-99db-4003-9170-3920a4212028 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:39.850467 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b66f8-b193-419c-86b3-72cf87d125b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:39.851060 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b66f8-b193-419c-86b3-72cf87d125b9 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:39.851370 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b66f8-b193-419c-86b3-72cf87d125b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:39.851633 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b66f8-b193-419c-86b3-72cf87d125b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:39.852270 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b66f8-b193-419c-86b3-72cf87d125b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:39.879130 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b66f8-b193-419c-86b3-72cf87d125b9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:39.924271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 956/1907] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:39 2021] POST /identity/v3/projects => generated 379 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:53:39.925280 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93baab-5f51-477d-b437-09531578a42a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:39.996095 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 952/1908] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:39 2021] POST /identity/v3/projects => generated 387 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:53:40.000327 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b66f8-b193-419c-86b3-72cf87d125b9 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:40.001520 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93baab-5f51-477d-b437-09531578a42a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:40.066630 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c869b-8c88-4207-898e-1c171cf4bbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:40.067262 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c869b-8c88-4207-898e-1c171cf4bbf6 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:40.067592 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c869b-8c88-4207-898e-1c171cf4bbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:40.067874 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c869b-8c88-4207-898e-1c171cf4bbf6 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:40.068836 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c869b-8c88-4207-898e-1c171cf4bbf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:40.092914 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b66f8-b193-419c-86b3-72cf87d125b9 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:40.095611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c869b-8c88-4207-898e-1c171cf4bbf6 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:40.097123 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af29d1-fd65-4286-81fc-9ab7f8f3a662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:40.097730 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af29d1-fd65-4286-81fc-9ab7f8f3a662 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:40.098029 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af29d1-fd65-4286-81fc-9ab7f8f3a662 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:40.098534 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af29d1-fd65-4286-81fc-9ab7f8f3a662 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:40.099182 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af29d1-fd65-4286-81fc-9ab7f8f3a662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:40.125704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af29d1-fd65-4286-81fc-9ab7f8f3a662 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:40.210854 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 957/1909] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:39 2021] POST /identity/v3/users => generated 296 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:53:40.211773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c869b-8c88-4207-898e-1c171cf4bbf6 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:40.213408 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ed1c869b-8c88-4207-898e-1c171cf4bbf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:40.224412 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c869b-8c88-4207-898e-1c171cf4bbf6 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:40.228650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338c241-21f6-4d89-b589-6d49a2b9c942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:40.229409 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338c241-21f6-4d89-b589-6d49a2b9c942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:40.229694 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338c241-21f6-4d89-b589-6d49a2b9c942 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:40.229998 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338c241-21f6-4d89-b589-6d49a2b9c942 admin admin] PATH_INFO: `/v3/projects/a8cb0521da394ed8915ddf055f1b7421` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:40.231048 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338c241-21f6-4d89-b589-6d49a2b9c942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8cb0521da394ed8915ddf055f1b7421)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:40.248016 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 953/1910] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:39 2021] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:40.248016 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af29d1-fd65-4286-81fc-9ab7f8f3a662 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:40.255339 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af29d1-fd65-4286-81fc-9ab7f8f3a662 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:40.258885 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338c241-21f6-4d89-b589-6d49a2b9c942 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:40.259712 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df7ce5-0c13-402d-bb5d-94359969d615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:40.260298 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df7ce5-0c13-402d-bb5d-94359969d615 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:40.260614 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df7ce5-0c13-402d-bb5d-94359969d615 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:40.260904 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df7ce5-0c13-402d-bb5d-94359969d615 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:40.261597 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df7ce5-0c13-402d-bb5d-94359969d615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:40.288232 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df7ce5-0c13-402d-bb5d-94359969d615 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:40.298397 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 954/1911] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:40 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:40.299182 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df7ce5-0c13-402d-bb5d-94359969d615 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:40.308070 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df7ce5-0c13-402d-bb5d-94359969d615 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:40.313152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dff6a3-f71c-4213-8c2c-458675b6a981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:40.313708 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dff6a3-f71c-4213-8c2c-458675b6a981 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:40.316227 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dff6a3-f71c-4213-8c2c-458675b6a981 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:40.316227 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dff6a3-f71c-4213-8c2c-458675b6a981 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:40.316227 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dff6a3-f71c-4213-8c2c-458675b6a981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:40.340976 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dff6a3-f71c-4213-8c2c-458675b6a981 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:40.351744 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 955/1912] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:40 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:40.352582 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dff6a3-f71c-4213-8c2c-458675b6a981 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:40.361615 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dff6a3-f71c-4213-8c2c-458675b6a981 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:40.365913 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905a1ec-c8c6-4f33-a177-fd87ba5c1c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:40.366690 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905a1ec-c8c6-4f33-a177-fd87ba5c1c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:40.366983 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905a1ec-c8c6-4f33-a177-fd87ba5c1c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:40.367699 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905a1ec-c8c6-4f33-a177-fd87ba5c1c96 admin admin] PATH_INFO: `/v3/projects/4385ea0d47f044c2ac5b59d97f0aedab/users/f62727b8afb44796940abb823373b859/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:40.389999 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905a1ec-c8c6-4f33-a177-fd87ba5c1c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4385ea0d47f044c2ac5b59d97f0aedab, user_id=f62727b8afb44796940abb823373b859, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:40.413798 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1338c241-21f6-4d89-b589-6d49a2b9c942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8cb0521da394ed8915ddf055f1b7421', 'request_id': 'req-1338c241-21f6-4d89-b589-6d49a2b9c942'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:40.418507 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905a1ec-c8c6-4f33-a177-fd87ba5c1c96 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:40.419360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1338c241-21f6-4d89-b589-6d49a2b9c942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8cb0521da394ed8915ddf055f1b7421', 'request_id': 'req-1338c241-21f6-4d89-b589-6d49a2b9c942'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:40.448033 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1338c241-21f6-4d89-b589-6d49a2b9c942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8cb0521da394ed8915ddf055f1b7421', 'request_id': 'req-1338c241-21f6-4d89-b589-6d49a2b9c942'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:40.550923 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 956/1913] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:40 2021] PUT /identity/v3/projects/4385ea0d47f044c2ac5b59d97f0aedab/users/f62727b8afb44796940abb823373b859/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:40.551846 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905a1ec-c8c6-4f33-a177-fd87ba5c1c96 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:40.564753 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1338c241-21f6-4d89-b589-6d49a2b9c942 admin admin] The token cache is being invalidate because project a8cb0521da394ed8915ddf055f1b7421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:40.565043 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1338c241-21f6-4d89-b589-6d49a2b9c942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:40.565667 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1338c241-21f6-4d89-b589-6d49a2b9c942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:40.567085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 958/1914] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:40 2021] DELETE /identity/v3/projects/a8cb0521da394ed8915ddf055f1b7421 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:40.567837 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338c241-21f6-4d89-b589-6d49a2b9c942 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:40.570285 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1338c241-21f6-4d89-b589-6d49a2b9c942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:40.625307 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905a1ec-c8c6-4f33-a177-fd87ba5c1c96 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:40.630417 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed0102-c8bb-4111-a71a-eea03dc0f391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:40.631304 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed0102-c8bb-4111-a71a-eea03dc0f391 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:40.631669 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed0102-c8bb-4111-a71a-eea03dc0f391 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:40.631954 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed0102-c8bb-4111-a71a-eea03dc0f391 admin admin] PATH_INFO: `/v3/projects/eddeb96503bb49b581879d5d8081f747/users/d10c4664ff3f4c3490691eb295320730/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:40.661318 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338c241-21f6-4d89-b589-6d49a2b9c942 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:40.661939 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed0102-c8bb-4111-a71a-eea03dc0f391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eddeb96503bb49b581879d5d8081f747, user_id=d10c4664ff3f4c3490691eb295320730, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:40.666304 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9aa9ab-52bb-41b2-a668-087a0a42b157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:40.666937 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aa9ab-52bb-41b2-a668-087a0a42b157 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:40.667228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aa9ab-52bb-41b2-a668-087a0a42b157 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:40.667513 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aa9ab-52bb-41b2-a668-087a0a42b157 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:40.673538 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9aa9ab-52bb-41b2-a668-087a0a42b157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:40.697322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9aa9ab-52bb-41b2-a668-087a0a42b157 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:40.702374 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed0102-c8bb-4111-a71a-eea03dc0f391 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:40.713500 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 959/1915] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:40 2021] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:40.715134 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ee726-93b2-4d61-9ca6-d4b8a029cca5 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:40.715480 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ee726-93b2-4d61-9ca6-d4b8a029cca5 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:40.715769 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ee726-93b2-4d61-9ca6-d4b8a029cca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:40.747625 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-af1ee726-93b2-4d61-9ca6-d4b8a029cca5 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:40.748885 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-af1ee726-93b2-4d61-9ca6-d4b8a029cca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:40.762857 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 960/1916] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:40.763691 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ee726-93b2-4d61-9ca6-d4b8a029cca5 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:40.773286 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ee726-93b2-4d61-9ca6-d4b8a029cca5 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:40.777801 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad803a7b-230d-452d-9b07-154e4be80e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:40.778613 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad803a7b-230d-452d-9b07-154e4be80e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:40.778901 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad803a7b-230d-452d-9b07-154e4be80e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:40.779189 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad803a7b-230d-452d-9b07-154e4be80e0a admin admin] PATH_INFO: `/v3/projects/4385ea0d47f044c2ac5b59d97f0aedab/users/f62727b8afb44796940abb823373b859/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:40.781008 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad803a7b-230d-452d-9b07-154e4be80e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4385ea0d47f044c2ac5b59d97f0aedab, user_id=f62727b8afb44796940abb823373b859, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:40.794460 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 957/1917] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:40 2021] PUT /identity/v3/projects/eddeb96503bb49b581879d5d8081f747/users/d10c4664ff3f4c3490691eb295320730/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:40.794460 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4a1c2-99a8-4014-aae8-ef6c3a705198 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:40.794460 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4a1c2-99a8-4014-aae8-ef6c3a705198 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:40.794460 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4a1c2-99a8-4014-aae8-ef6c3a705198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:40.821352 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-b7a4a1c2-99a8-4014-aae8-ef6c3a705198 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:40.822544 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad803a7b-230d-452d-9b07-154e4be80e0a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:40.823332 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-b7a4a1c2-99a8-4014-aae8-ef6c3a705198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:40.834786 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 961/1918] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:40 2021] PUT /identity/v3/projects/4385ea0d47f044c2ac5b59d97f0aedab/users/f62727b8afb44796940abb823373b859/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:40.842682 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad803a7b-230d-452d-9b07-154e4be80e0a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:40.843669 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ad803a7b-230d-452d-9b07-154e4be80e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:40.924714 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 958/1919] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:40.925722 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4a1c2-99a8-4014-aae8-ef6c3a705198 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:40.937863 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4a1c2-99a8-4014-aae8-ef6c3a705198 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:40.954412 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad803a7b-230d-452d-9b07-154e4be80e0a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:40.978874 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f645ee3-5800-4691-af2c-99139067ff39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:40.979841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f645ee3-5800-4691-af2c-99139067ff39 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:40.980143 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f645ee3-5800-4691-af2c-99139067ff39 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:40.981157 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f645ee3-5800-4691-af2c-99139067ff39 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:40.984221 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f645ee3-5800-4691-af2c-99139067ff39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:41.021379 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70f0c5-22fc-47a1-a541-af24d42c1795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:41.021989 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70f0c5-22fc-47a1-a541-af24d42c1795 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:41.022646 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70f0c5-22fc-47a1-a541-af24d42c1795 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:41.023071 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70f0c5-22fc-47a1-a541-af24d42c1795 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:41.023821 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70f0c5-22fc-47a1-a541-af24d42c1795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:41.024402 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f645ee3-5800-4691-af2c-99139067ff39 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:41.036642 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 962/1920] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:40 2021] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:41.036642 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f645ee3-5800-4691-af2c-99139067ff39 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:41.047413 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f645ee3-5800-4691-af2c-99139067ff39 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:41.052484 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94740e-524f-4a08-8d75-88c3d49ffda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:41.053367 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94740e-524f-4a08-8d75-88c3d49ffda7 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:41.063611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94740e-524f-4a08-8d75-88c3d49ffda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:41.063611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94740e-524f-4a08-8d75-88c3d49ffda7 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:41.063611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94740e-524f-4a08-8d75-88c3d49ffda7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:53:41.063611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94740e-524f-4a08-8d75-88c3d49ffda7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:41.064211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70f0c5-22fc-47a1-a541-af24d42c1795 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:41.078022 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 959/1921] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:40 2021] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:41.078022 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70f0c5-22fc-47a1-a541-af24d42c1795 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:41.079877 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70f0c5-22fc-47a1-a541-af24d42c1795 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:41.085601 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94740e-524f-4a08-8d75-88c3d49ffda7 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:41.088628 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e308ba-785a-435c-936b-bda7b5fa5e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:41.089518 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e308ba-785a-435c-936b-bda7b5fa5e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:41.092479 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e308ba-785a-435c-936b-bda7b5fa5e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:41.092479 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e308ba-785a-435c-936b-bda7b5fa5e15 admin admin] PATH_INFO: `/v3/projects/eddeb96503bb49b581879d5d8081f747/users/d10c4664ff3f4c3490691eb295320730/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:41.093110 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e308ba-785a-435c-936b-bda7b5fa5e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eddeb96503bb49b581879d5d8081f747, user_id=d10c4664ff3f4c3490691eb295320730, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:41.100074 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 963/1922] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:53:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:53:41.100960 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94740e-524f-4a08-8d75-88c3d49ffda7 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:41.122319 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e308ba-785a-435c-936b-bda7b5fa5e15 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:41.122707 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94740e-524f-4a08-8d75-88c3d49ffda7 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:41.129068 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73d552-304e-4c7c-a95d-6a304c8caa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:41.129980 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73d552-304e-4c7c-a95d-6a304c8caa45 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:41.133012 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73d552-304e-4c7c-a95d-6a304c8caa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:41.133565 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73d552-304e-4c7c-a95d-6a304c8caa45 admin admin] PATH_INFO: `/v3/projects/4385ea0d47f044c2ac5b59d97f0aedab/users/f62727b8afb44796940abb823373b859/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:41.134446 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 960/1923] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:41 2021] PUT /identity/v3/projects/eddeb96503bb49b581879d5d8081f747/users/d10c4664ff3f4c3490691eb295320730/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:41.135335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e308ba-785a-435c-936b-bda7b5fa5e15 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:41.135983 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73d552-304e-4c7c-a95d-6a304c8caa45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4385ea0d47f044c2ac5b59d97f0aedab, user_id=f62727b8afb44796940abb823373b859, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:41.172478 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73d552-304e-4c7c-a95d-6a304c8caa45 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:41.287008 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e308ba-785a-435c-936b-bda7b5fa5e15 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:41.300264 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 964/1924] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:41 2021] PUT /identity/v3/projects/4385ea0d47f044c2ac5b59d97f0aedab/users/f62727b8afb44796940abb823373b859/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:41.300264 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73d552-304e-4c7c-a95d-6a304c8caa45 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:41.506029 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530027f-be83-4831-ace6-553ef63e8575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:41.507206 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530027f-be83-4831-ace6-553ef63e8575 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:41.507499 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530027f-be83-4831-ace6-553ef63e8575 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:41.507935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530027f-be83-4831-ace6-553ef63e8575 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:41.508746 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530027f-be83-4831-ace6-553ef63e8575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:41.548191 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73d552-304e-4c7c-a95d-6a304c8caa45 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:41.553057 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a4a63-26e6-40a5-aca5-77ff301b76f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:41.553794 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a4a63-26e6-40a5-aca5-77ff301b76f2 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:41.554095 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a4a63-26e6-40a5-aca5-77ff301b76f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:41.554378 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a4a63-26e6-40a5-aca5-77ff301b76f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:41.555077 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a4a63-26e6-40a5-aca5-77ff301b76f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:41.567791 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530027f-be83-4831-ace6-553ef63e8575 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:41.594589 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a4a63-26e6-40a5-aca5-77ff301b76f2 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:41.611098 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 965/1925] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:41 2021] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:41.612489 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc161b7-2106-4b05-a4df-12513c06f646 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:41.620896 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc161b7-2106-4b05-a4df-12513c06f646 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:41.620896 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc161b7-2106-4b05-a4df-12513c06f646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:41.656181 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-cdc161b7-2106-4b05-a4df-12513c06f646 None None] MFA Rules not processed for user `f62727b8afb44796940abb823373b859`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:41.657351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-cdc161b7-2106-4b05-a4df-12513c06f646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:41.680624 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 961/1926] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:41 2021] POST /identity/v3/projects => generated 385 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:41.685520 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530027f-be83-4831-ace6-553ef63e8575 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:41.731913 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 966/1927] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:41 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:41.732788 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc161b7-2106-4b05-a4df-12513c06f646 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:41.746648 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc161b7-2106-4b05-a4df-12513c06f646 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:41.751153 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852deb1-af4f-4325-ae87-ff53f492b99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:41.751824 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852deb1-af4f-4325-ae87-ff53f492b99d admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:41.752177 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852deb1-af4f-4325-ae87-ff53f492b99d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:41.752521 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852deb1-af4f-4325-ae87-ff53f492b99d admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:41.753242 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852deb1-af4f-4325-ae87-ff53f492b99d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:41.754566 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530027f-be83-4831-ace6-553ef63e8575 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:41.758752 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6b828-a8a2-4db4-a546-1cb671e16f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:41.759653 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6b828-a8a2-4db4-a546-1cb671e16f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:41.762796 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6b828-a8a2-4db4-a546-1cb671e16f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:41.762796 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6b828-a8a2-4db4-a546-1cb671e16f5f admin admin] PATH_INFO: `/v3/projects/eddeb96503bb49b581879d5d8081f747/users/d10c4664ff3f4c3490691eb295320730/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:41.762796 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6b828-a8a2-4db4-a546-1cb671e16f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eddeb96503bb49b581879d5d8081f747, user_id=d10c4664ff3f4c3490691eb295320730, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:41.778797 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852deb1-af4f-4325-ae87-ff53f492b99d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:41.789376 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6b828-a8a2-4db4-a546-1cb671e16f5f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:41.876402 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 967/1928] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:41 2021] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:41.876402 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852deb1-af4f-4325-ae87-ff53f492b99d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:41.876402 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-8852deb1-af4f-4325-ae87-ff53f492b99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:41.904223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 962/1929] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:41 2021] PUT /identity/v3/projects/eddeb96503bb49b581879d5d8081f747/users/d10c4664ff3f4c3490691eb295320730/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:41.905823 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6b828-a8a2-4db4-a546-1cb671e16f5f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:41.959741 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852deb1-af4f-4325-ae87-ff53f492b99d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:41.990550 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6b828-a8a2-4db4-a546-1cb671e16f5f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:41.994788 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1c96f-2591-4910-b055-048573731029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:41.995428 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1c96f-2591-4910-b055-048573731029 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:41.995715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1c96f-2591-4910-b055-048573731029 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:41.996517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1c96f-2591-4910-b055-048573731029 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:41.997245 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1c96f-2591-4910-b055-048573731029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:42.017321 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc9546-6089-4758-a7de-8a426270017a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:42.017940 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc9546-6089-4758-a7de-8a426270017a service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:42.018200 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc9546-6089-4758-a7de-8a426270017a service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:42.018479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc9546-6089-4758-a7de-8a426270017a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:42.023296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1c96f-2591-4910-b055-048573731029 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:42.039785 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 963/1930] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:41 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:42.041175 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394acaca-3092-4b94-8a35-d61087a0b0d3 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:42.041477 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394acaca-3092-4b94-8a35-d61087a0b0d3 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:42.041767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394acaca-3092-4b94-8a35-d61087a0b0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:42.085671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-394acaca-3092-4b94-8a35-d61087a0b0d3 None None] MFA Rules not processed for user `d10c4664ff3f4c3490691eb295320730`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:42.087286 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-394acaca-3092-4b94-8a35-d61087a0b0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:42.090945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc9546-6089-4758-a7de-8a426270017a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:42.125742 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc9546-6089-4758-a7de-8a426270017a service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:42.148885 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 968/1931] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:41 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:42.149913 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc9546-6089-4758-a7de-8a426270017a service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:42.162948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc9546-6089-4758-a7de-8a426270017a service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:42.174207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0bd1c-8376-4c29-a730-c09b2120da09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:42.175276 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0bd1c-8376-4c29-a730-c09b2120da09 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:42.175691 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0bd1c-8376-4c29-a730-c09b2120da09 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:42.175974 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0bd1c-8376-4c29-a730-c09b2120da09 admin admin] PATH_INFO: `/v3/projects/1528d90b31c4400abab581112cb504e8/users/6bc33b3ae5804b50ad785903edf560f9/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:42.200061 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 964/1932] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:42 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:42.207338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0bd1c-8376-4c29-a730-c09b2120da09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1528d90b31c4400abab581112cb504e8, user_id=6bc33b3ae5804b50ad785903edf560f9, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:42.214071 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394acaca-3092-4b94-8a35-d61087a0b0d3 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:42.228969 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394acaca-3092-4b94-8a35-d61087a0b0d3 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:42.232704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f2d56-40ee-495f-b482-19e022533600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:42.233434 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f2d56-40ee-495f-b482-19e022533600 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:42.233743 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f2d56-40ee-495f-b482-19e022533600 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:42.234035 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f2d56-40ee-495f-b482-19e022533600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:42.243555 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0bd1c-8376-4c29-a730-c09b2120da09 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:42.245859 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f2d56-40ee-495f-b482-19e022533600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:42.273207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f2d56-40ee-495f-b482-19e022533600 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:42.284008 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 965/1933] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:42 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:53:42.392475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 969/1934] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:42 2021] PUT /identity/v3/projects/1528d90b31c4400abab581112cb504e8/users/6bc33b3ae5804b50ad785903edf560f9/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:42.404273 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b169ed-01c6-4c72-bae4-5c122c34d845 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:42.404813 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b169ed-01c6-4c72-bae4-5c122c34d845 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:42.404903 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b169ed-01c6-4c72-bae4-5c122c34d845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:42.415745 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0bd1c-8376-4c29-a730-c09b2120da09 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:42.445947 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-d0b169ed-01c6-4c72-bae4-5c122c34d845 None None] MFA Rules not processed for user `6bc33b3ae5804b50ad785903edf560f9`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:42.447500 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d0b169ed-01c6-4c72-bae4-5c122c34d845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:42.491610 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0bd1c-8376-4c29-a730-c09b2120da09 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:42.496650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca27062-d128-410e-b458-3c068760c71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:42.497386 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca27062-d128-410e-b458-3c068760c71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:42.497672 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca27062-d128-410e-b458-3c068760c71e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:42.498266 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca27062-d128-410e-b458-3c068760c71e admin admin] PATH_INFO: `/v3/users/42dc06cfe5bc42078b4c8f9a2afc0d78` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:42.499449 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca27062-d128-410e-b458-3c068760c71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=42dc06cfe5bc42078b4c8f9a2afc0d78)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:42.529051 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca27062-d128-410e-b458-3c068760c71e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:42.543755 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 966/1935] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:42 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:42.544807 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b169ed-01c6-4c72-bae4-5c122c34d845 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:42.561241 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b169ed-01c6-4c72-bae4-5c122c34d845 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:42.571529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6288b3-e254-4dd7-a9a2-585452782bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:42.572128 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6288b3-e254-4dd7-a9a2-585452782bed admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:42.572413 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6288b3-e254-4dd7-a9a2-585452782bed admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:42.572913 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6288b3-e254-4dd7-a9a2-585452782bed admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:42.573567 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6288b3-e254-4dd7-a9a2-585452782bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:42.601586 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6288b3-e254-4dd7-a9a2-585452782bed admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:42.756526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8ca27062-d128-410e-b458-3c068760c71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42dc06cfe5bc42078b4c8f9a2afc0d78'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:42.757177 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8ca27062-d128-410e-b458-3c068760c71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42dc06cfe5bc42078b4c8f9a2afc0d78'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:42.759140 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 967/1936] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:42 2021] POST /identity/v3/projects => generated 387 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:42.763764 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6288b3-e254-4dd7-a9a2-585452782bed admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:42.766798 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1d6288b3-e254-4dd7-a9a2-585452782bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:42.837271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8ca27062-d128-410e-b458-3c068760c71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42dc06cfe5bc42078b4c8f9a2afc0d78'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:42.847240 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8ca27062-d128-410e-b458-3c068760c71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42dc06cfe5bc42078b4c8f9a2afc0d78'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:42.848083 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8ca27062-d128-410e-b458-3c068760c71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42dc06cfe5bc42078b4c8f9a2afc0d78'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:42.867363 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6288b3-e254-4dd7-a9a2-585452782bed admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:42.872823 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadad3ef-db66-4402-a39f-7dfcf3c2a040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:42.873545 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadad3ef-db66-4402-a39f-7dfcf3c2a040 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:42.873725 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadad3ef-db66-4402-a39f-7dfcf3c2a040 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:42.874177 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadad3ef-db66-4402-a39f-7dfcf3c2a040 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:42.874965 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadad3ef-db66-4402-a39f-7dfcf3c2a040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:42.877178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 970/1937] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:42 2021] DELETE /identity/v3/users/42dc06cfe5bc42078b4c8f9a2afc0d78 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:42.881089 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae056d9b-3abb-4c3d-bdc6-527310eff37b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:42.881583 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae056d9b-3abb-4c3d-bdc6-527310eff37b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:42.882014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae056d9b-3abb-4c3d-bdc6-527310eff37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:42.931180 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadad3ef-db66-4402-a39f-7dfcf3c2a040 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:42.958830 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-ae056d9b-3abb-4c3d-bdc6-527310eff37b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:42.958830 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ae056d9b-3abb-4c3d-bdc6-527310eff37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:43.034197 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 968/1938] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:42 2021] POST /identity/v3/users => generated 300 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:43.038550 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadad3ef-db66-4402-a39f-7dfcf3c2a040 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:43.041189 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 971/1939] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:43.051707 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae056d9b-3abb-4c3d-bdc6-527310eff37b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:43.053209 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ae056d9b-3abb-4c3d-bdc6-527310eff37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:43.056612 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadad3ef-db66-4402-a39f-7dfcf3c2a040 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:43.067585 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a35adf-2d46-4d9f-ba19-8564143b07e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:43.068244 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a35adf-2d46-4d9f-ba19-8564143b07e4 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:43.074655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a35adf-2d46-4d9f-ba19-8564143b07e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:43.074655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a35adf-2d46-4d9f-ba19-8564143b07e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:43.074655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a35adf-2d46-4d9f-ba19-8564143b07e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:43.101603 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a35adf-2d46-4d9f-ba19-8564143b07e4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:43.114929 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 969/1940] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:43 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:43.119030 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a35adf-2d46-4d9f-ba19-8564143b07e4 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:43.123721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae056d9b-3abb-4c3d-bdc6-527310eff37b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:43.127210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9831bb3-980d-42d0-91fd-2a76a78ab3be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:43.127799 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9831bb3-980d-42d0-91fd-2a76a78ab3be service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:43.128087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9831bb3-980d-42d0-91fd-2a76a78ab3be service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:43.128772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9831bb3-980d-42d0-91fd-2a76a78ab3be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:43.130008 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a35adf-2d46-4d9f-ba19-8564143b07e4 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:43.135461 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9ece2-c4b0-4a4c-a6d5-a4d390afdc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:43.136364 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9ece2-c4b0-4a4c-a6d5-a4d390afdc4a admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:43.142735 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9ece2-c4b0-4a4c-a6d5-a4d390afdc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:43.142735 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9ece2-c4b0-4a4c-a6d5-a4d390afdc4a admin admin] PATH_INFO: `/v3/projects/6bd0af951f0d4a16bb5e9923ed1aa8ae/users/fd596ff0391444e288dc76f57a449daf/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:43.142943 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9831bb3-980d-42d0-91fd-2a76a78ab3be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:43.159755 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9ece2-c4b0-4a4c-a6d5-a4d390afdc4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd0af951f0d4a16bb5e9923ed1aa8ae, user_id=fd596ff0391444e288dc76f57a449daf, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:43.164693 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9831bb3-980d-42d0-91fd-2a76a78ab3be service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:43.176745 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 972/1941] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:43 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:43.189152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9ece2-c4b0-4a4c-a6d5-a4d390afdc4a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:43.296215 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 970/1942] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:43 2021] PUT /identity/v3/projects/6bd0af951f0d4a16bb5e9923ed1aa8ae/users/fd596ff0391444e288dc76f57a449daf/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:43.297103 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9831bb3-980d-42d0-91fd-2a76a78ab3be service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:43.311102 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9831bb3-980d-42d0-91fd-2a76a78ab3be service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:43.461228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3f5cc-7b7f-444b-8296-e902624a47ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:43.462048 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3f5cc-7b7f-444b-8296-e902624a47ca admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:43.462348 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3f5cc-7b7f-444b-8296-e902624a47ca admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:43.462635 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3f5cc-7b7f-444b-8296-e902624a47ca admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:43.463342 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3f5cc-7b7f-444b-8296-e902624a47ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:43.500488 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3f5cc-7b7f-444b-8296-e902624a47ca admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:43.515963 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 973/1943] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:43 2021] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:53:43.516665 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9ece2-c4b0-4a4c-a6d5-a4d390afdc4a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:43.526765 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9ece2-c4b0-4a4c-a6d5-a4d390afdc4a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:43.531384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caac7ce-3fd7-4443-bfab-85775a5be038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:43.532228 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caac7ce-3fd7-4443-bfab-85775a5be038 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:43.532520 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caac7ce-3fd7-4443-bfab-85775a5be038 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:43.533065 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caac7ce-3fd7-4443-bfab-85775a5be038 admin admin] PATH_INFO: `/v3/projects/6bd0af951f0d4a16bb5e9923ed1aa8ae/users/fd596ff0391444e288dc76f57a449daf/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:43.534933 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caac7ce-3fd7-4443-bfab-85775a5be038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd0af951f0d4a16bb5e9923ed1aa8ae, user_id=fd596ff0391444e288dc76f57a449daf, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:43.590394 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caac7ce-3fd7-4443-bfab-85775a5be038 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:43.590394 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 971/1944] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:43 2021] PUT /identity/v3/projects/6bd0af951f0d4a16bb5e9923ed1aa8ae/users/fd596ff0391444e288dc76f57a449daf/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:43.590901 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3f5cc-7b7f-444b-8296-e902624a47ca admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:43.601588 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3f5cc-7b7f-444b-8296-e902624a47ca admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:43.674171 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbeeb3-f02c-41b6-a8ac-77180301f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:43.675609 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbeeb3-f02c-41b6-a8ac-77180301f473 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:43.676522 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbeeb3-f02c-41b6-a8ac-77180301f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:43.677235 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbeeb3-f02c-41b6-a8ac-77180301f473 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:43.678478 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbeeb3-f02c-41b6-a8ac-77180301f473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:43.707474 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbeeb3-f02c-41b6-a8ac-77180301f473 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:43.719763 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 974/1945] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:43 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:43.723965 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caac7ce-3fd7-4443-bfab-85775a5be038 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:43.735463 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caac7ce-3fd7-4443-bfab-85775a5be038 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:43.739994 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaef78b-fa08-4853-aa33-f60b7e879bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:43.744984 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaef78b-fa08-4853-aa33-f60b7e879bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:43.744984 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaef78b-fa08-4853-aa33-f60b7e879bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:43.744984 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaef78b-fa08-4853-aa33-f60b7e879bf8 admin admin] PATH_INFO: `/v3/projects/6bd0af951f0d4a16bb5e9923ed1aa8ae/users/fd596ff0391444e288dc76f57a449daf/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:43.744984 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaef78b-fa08-4853-aa33-f60b7e879bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd0af951f0d4a16bb5e9923ed1aa8ae, user_id=fd596ff0391444e288dc76f57a449daf, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:43.765611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbeeb3-f02c-41b6-a8ac-77180301f473 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:43.767948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-93bbeeb3-f02c-41b6-a8ac-77180301f473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:43.770609 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaef78b-fa08-4853-aa33-f60b7e879bf8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:44.020772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbeeb3-f02c-41b6-a8ac-77180301f473 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:44.020772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18e35f-b0f8-45ff-bc6e-39bc26d28bf6 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f62727b8afb44796940abb823373b859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4385ea0d47f044c2ac5b59d97f0aedab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:44.020772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18e35f-b0f8-45ff-bc6e-39bc26d28bf6 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:44.022087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18e35f-b0f8-45ff-bc6e-39bc26d28bf6 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:44.022087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18e35f-b0f8-45ff-bc6e-39bc26d28bf6 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:44.022087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18e35f-b0f8-45ff-bc6e-39bc26d28bf6 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:53:44.022087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18e35f-b0f8-45ff-bc6e-39bc26d28bf6 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:44.022087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18e35f-b0f8-45ff-bc6e-39bc26d28bf6 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:44.023723 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 975/1946] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:53:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:53:44.033252 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18e35f-b0f8-45ff-bc6e-39bc26d28bf6 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:44.046205 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18e35f-b0f8-45ff-bc6e-39bc26d28bf6 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:44.052848 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051551c-375f-4447-abdd-c8d17201721d tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f62727b8afb44796940abb823373b859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4385ea0d47f044c2ac5b59d97f0aedab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:44.053700 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051551c-375f-4447-abdd-c8d17201721d tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:44.054145 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051551c-375f-4447-abdd-c8d17201721d tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:44.054831 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051551c-375f-4447-abdd-c8d17201721d tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:44.055790 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051551c-375f-4447-abdd-c8d17201721d tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:44.088893 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051551c-375f-4447-abdd-c8d17201721d tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:44.096096 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 972/1947] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:43 2021] PUT /identity/v3/projects/6bd0af951f0d4a16bb5e9923ed1aa8ae/users/fd596ff0391444e288dc76f57a449daf/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:44.106993 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ce7a7-2269-4efb-b79a-ceaf45d99e28 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:44.107293 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ce7a7-2269-4efb-b79a-ceaf45d99e28 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:44.107580 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ce7a7-2269-4efb-b79a-ceaf45d99e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:44.161544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-9c4ce7a7-2269-4efb-b79a-ceaf45d99e28 None None] MFA Rules not processed for user `fd596ff0391444e288dc76f57a449daf`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:44.168122 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-9c4ce7a7-2269-4efb-b79a-ceaf45d99e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:44.271271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 976/1948] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:44 2021] POST /identity/v3/projects => generated 354 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:44.272667 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051551c-375f-4447-abdd-c8d17201721d tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:44.282564 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 973/1949] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:44 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:53:44.351029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051551c-375f-4447-abdd-c8d17201721d tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:44.355623 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66437c69-c72f-4424-8a5f-c313d2354505 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f62727b8afb44796940abb823373b859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4385ea0d47f044c2ac5b59d97f0aedab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:44.356221 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66437c69-c72f-4424-8a5f-c313d2354505 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:44.356650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66437c69-c72f-4424-8a5f-c313d2354505 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:44.356940 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66437c69-c72f-4424-8a5f-c313d2354505 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:44.357629 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66437c69-c72f-4424-8a5f-c313d2354505 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:53:44.357929 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66437c69-c72f-4424-8a5f-c313d2354505 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:44.384507 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66437c69-c72f-4424-8a5f-c313d2354505 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:44.400483 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 977/1950] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:53:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:53:44.426052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ce7a7-2269-4efb-b79a-ceaf45d99e28 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:44.427881 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-9c4ce7a7-2269-4efb-b79a-ceaf45d99e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:44.498275 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ce7a7-2269-4efb-b79a-ceaf45d99e28 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:44.554635 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708120e0-35e7-4127-9408-0a71037d5816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:44.555295 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708120e0-35e7-4127-9408-0a71037d5816 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:44.555399 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708120e0-35e7-4127-9408-0a71037d5816 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:44.555668 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708120e0-35e7-4127-9408-0a71037d5816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:44.621435 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708120e0-35e7-4127-9408-0a71037d5816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:44.646704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708120e0-35e7-4127-9408-0a71037d5816 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:44.656519 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 974/1951] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:44 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:44.959842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66437c69-c72f-4424-8a5f-c313d2354505 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:44.973112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66437c69-c72f-4424-8a5f-c313d2354505 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:44.980047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50743cf1-74d6-4b2c-994c-bc0d7a52bde3 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f62727b8afb44796940abb823373b859', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4385ea0d47f044c2ac5b59d97f0aedab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:44.981185 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50743cf1-74d6-4b2c-994c-bc0d7a52bde3 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:44.981695 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50743cf1-74d6-4b2c-994c-bc0d7a52bde3 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:44.982137 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50743cf1-74d6-4b2c-994c-bc0d7a52bde3 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] PATH_INFO: `/v3/projects/97fccc0b404748a3b8ac6b09ed8e3f9c` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:44.983500 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50743cf1-74d6-4b2c-994c-bc0d7a52bde3 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] RBAC: Authorizing `identity:delete_project(project_id=97fccc0b404748a3b8ac6b09ed8e3f9c)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:45.027762 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50743cf1-74d6-4b2c-994c-bc0d7a52bde3 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:45.032653 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708120e0-35e7-4127-9408-0a71037d5816 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:45.034207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-708120e0-35e7-4127-9408-0a71037d5816 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:45.137504 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708120e0-35e7-4127-9408-0a71037d5816 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:45.142288 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d5a30-4a65-42a1-ac72-28f6d794fd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:45.143444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d5a30-4a65-42a1-ac72-28f6d794fd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:45.144014 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d5a30-4a65-42a1-ac72-28f6d794fd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:45.144460 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d5a30-4a65-42a1-ac72-28f6d794fd40 admin admin] PATH_INFO: `/v3/projects/501d22939721426ba0c8f73521556b40` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:45.145744 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d5a30-4a65-42a1-ac72-28f6d794fd40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=501d22939721426ba0c8f73521556b40)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:45.202244 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d5a30-4a65-42a1-ac72-28f6d794fd40 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:45.327319 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-50743cf1-74d6-4b2c-994c-bc0d7a52bde3 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97fccc0b404748a3b8ac6b09ed8e3f9c', 'request_id': 'req-50743cf1-74d6-4b2c-994c-bc0d7a52bde3'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:45.332963 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-50743cf1-74d6-4b2c-994c-bc0d7a52bde3 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97fccc0b404748a3b8ac6b09ed8e3f9c', 'request_id': 'req-50743cf1-74d6-4b2c-994c-bc0d7a52bde3'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:45.354552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-50743cf1-74d6-4b2c-994c-bc0d7a52bde3 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97fccc0b404748a3b8ac6b09ed8e3f9c', 'request_id': 'req-50743cf1-74d6-4b2c-994c-bc0d7a52bde3'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:45.468178 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ce0d5a30-4a65-42a1-ac72-28f6d794fd40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '501d22939721426ba0c8f73521556b40', 'request_id': 'req-ce0d5a30-4a65-42a1-ac72-28f6d794fd40'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:45.477071 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ce0d5a30-4a65-42a1-ac72-28f6d794fd40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '501d22939721426ba0c8f73521556b40', 'request_id': 'req-ce0d5a30-4a65-42a1-ac72-28f6d794fd40'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:45.498760 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ce0d5a30-4a65-42a1-ac72-28f6d794fd40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '501d22939721426ba0c8f73521556b40', 'request_id': 'req-ce0d5a30-4a65-42a1-ac72-28f6d794fd40'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:45.506980 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-50743cf1-74d6-4b2c-994c-bc0d7a52bde3 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] The token cache is being invalidate because project 97fccc0b404748a3b8ac6b09ed8e3f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:45.507271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-50743cf1-74d6-4b2c-994c-bc0d7a52bde3 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:45.507883 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-50743cf1-74d6-4b2c-994c-bc0d7a52bde3 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:45.514548 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 978/1952] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:44 2021] DELETE /identity/v3/projects/97fccc0b404748a3b8ac6b09ed8e3f9c => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:45.591273 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ce0d5a30-4a65-42a1-ac72-28f6d794fd40 admin admin] The token cache is being invalidate because project 501d22939721426ba0c8f73521556b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:45.591876 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ce0d5a30-4a65-42a1-ac72-28f6d794fd40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:45.592354 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ce0d5a30-4a65-42a1-ac72-28f6d794fd40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:45.593897 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 975/1953] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:45 2021] DELETE /identity/v3/projects/501d22939721426ba0c8f73521556b40 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:45.598098 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50743cf1-74d6-4b2c-994c-bc0d7a52bde3 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:45.599915 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-50743cf1-74d6-4b2c-994c-bc0d7a52bde3 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:45.686921 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50743cf1-74d6-4b2c-994c-bc0d7a52bde3 tempest-VolumeQuotaClassesTest-540840254 tempest-VolumeQuotaClassesTest-540840254-project-admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:45.776694 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5e208-0897-4eac-b1dd-f534429404f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:45.776694 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5e208-0897-4eac-b1dd-f534429404f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:45.776694 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5e208-0897-4eac-b1dd-f534429404f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:45.776694 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5e208-0897-4eac-b1dd-f534429404f5 admin admin] PATH_INFO: `/v3/users/d10c4664ff3f4c3490691eb295320730` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:45.777175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5e208-0897-4eac-b1dd-f534429404f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d10c4664ff3f4c3490691eb295320730)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:45.799424 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5e208-0897-4eac-b1dd-f534429404f5 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:46.034392 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d8c5e208-0897-4eac-b1dd-f534429404f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd10c4664ff3f4c3490691eb295320730'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:46.035729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d8c5e208-0897-4eac-b1dd-f534429404f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd10c4664ff3f4c3490691eb295320730'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:46.117885 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d8c5e208-0897-4eac-b1dd-f534429404f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd10c4664ff3f4c3490691eb295320730'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:46.129465 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d8c5e208-0897-4eac-b1dd-f534429404f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd10c4664ff3f4c3490691eb295320730'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:46.131739 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d8c5e208-0897-4eac-b1dd-f534429404f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd10c4664ff3f4c3490691eb295320730'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:46.174759 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 979/1954] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:45 2021] DELETE /identity/v3/users/d10c4664ff3f4c3490691eb295320730 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:46.473466 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d5a30-4a65-42a1-ac72-28f6d794fd40 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:46.474829 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-ce0d5a30-4a65-42a1-ac72-28f6d794fd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:46.487333 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d5a30-4a65-42a1-ac72-28f6d794fd40 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:46.586803 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425ee36-9362-40e4-aee4-06d38a495fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:46.588171 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425ee36-9362-40e4-aee4-06d38a495fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:46.588467 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425ee36-9362-40e4-aee4-06d38a495fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:46.588794 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425ee36-9362-40e4-aee4-06d38a495fdb admin admin] PATH_INFO: `/v3/users/355055386297402dbf7228c078fe71cc` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:46.590736 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425ee36-9362-40e4-aee4-06d38a495fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=355055386297402dbf7228c078fe71cc)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:46.626175 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425ee36-9362-40e4-aee4-06d38a495fdb admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:46.832053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-c425ee36-9362-40e4-aee4-06d38a495fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '355055386297402dbf7228c078fe71cc'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:46.905544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-c425ee36-9362-40e4-aee4-06d38a495fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '355055386297402dbf7228c078fe71cc'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:46.906132 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-c425ee36-9362-40e4-aee4-06d38a495fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '355055386297402dbf7228c078fe71cc'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:46.917089 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-c425ee36-9362-40e4-aee4-06d38a495fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '355055386297402dbf7228c078fe71cc'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:46.919344 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-c425ee36-9362-40e4-aee4-06d38a495fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '355055386297402dbf7228c078fe71cc'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:46.949956 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 976/1955] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:46 2021] DELETE /identity/v3/users/355055386297402dbf7228c078fe71cc => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:46.954486 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18897b23-247f-404d-bcc6-0881890d4a2e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:46.954994 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18897b23-247f-404d-bcc6-0881890d4a2e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:46.955085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18897b23-247f-404d-bcc6-0881890d4a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:46.994347 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-18897b23-247f-404d-bcc6-0881890d4a2e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:47.003270 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-18897b23-247f-404d-bcc6-0881890d4a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:47.049717 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425ee36-9362-40e4-aee4-06d38a495fdb admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:47.051496 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-c425ee36-9362-40e4-aee4-06d38a495fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:47.119137 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 980/1956] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:47.128223 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18897b23-247f-404d-bcc6-0881890d4a2e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:47.129578 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-18897b23-247f-404d-bcc6-0881890d4a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:47.161112 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425ee36-9362-40e4-aee4-06d38a495fdb admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:47.168817 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31633cc2-64de-4baa-a264-55735345d3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:47.169878 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31633cc2-64de-4baa-a264-55735345d3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:47.170334 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31633cc2-64de-4baa-a264-55735345d3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:47.170904 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31633cc2-64de-4baa-a264-55735345d3c2 admin admin] PATH_INFO: `/v3/users/6bc33b3ae5804b50ad785903edf560f9` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:47.172766 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31633cc2-64de-4baa-a264-55735345d3c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bc33b3ae5804b50ad785903edf560f9)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:47.203737 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18897b23-247f-404d-bcc6-0881890d4a2e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:47.206979 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31633cc2-64de-4baa-a264-55735345d3c2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:47.207353 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe80e9-9d13-42b8-b0b1-5940b3709992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:47.207961 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe80e9-9d13-42b8-b0b1-5940b3709992 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:47.208232 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe80e9-9d13-42b8-b0b1-5940b3709992 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:47.209028 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe80e9-9d13-42b8-b0b1-5940b3709992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:47.256505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe80e9-9d13-42b8-b0b1-5940b3709992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:47.293325 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe80e9-9d13-42b8-b0b1-5940b3709992 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:47.314305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 981/1957] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:47 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:53:47.463937 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-31633cc2-64de-4baa-a264-55735345d3c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bc33b3ae5804b50ad785903edf560f9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:47.498552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe80e9-9d13-42b8-b0b1-5940b3709992 service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:47.500090 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-27fe80e9-9d13-42b8-b0b1-5940b3709992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:47.515161 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe80e9-9d13-42b8-b0b1-5940b3709992 service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:47.520258 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38223ae-ffbb-4c57-b4e8-138dd59dd528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:47.521466 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38223ae-ffbb-4c57-b4e8-138dd59dd528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:47.521902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38223ae-ffbb-4c57-b4e8-138dd59dd528 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:47.522286 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38223ae-ffbb-4c57-b4e8-138dd59dd528 admin admin] PATH_INFO: `/v3/projects/eddeb96503bb49b581879d5d8081f747` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:47.523556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38223ae-ffbb-4c57-b4e8-138dd59dd528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eddeb96503bb49b581879d5d8081f747)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:47.530084 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-31633cc2-64de-4baa-a264-55735345d3c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bc33b3ae5804b50ad785903edf560f9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:47.534863 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-31633cc2-64de-4baa-a264-55735345d3c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bc33b3ae5804b50ad785903edf560f9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:47.541086 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-31633cc2-64de-4baa-a264-55735345d3c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bc33b3ae5804b50ad785903edf560f9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:47.541970 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-31633cc2-64de-4baa-a264-55735345d3c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bc33b3ae5804b50ad785903edf560f9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:47.557774 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38223ae-ffbb-4c57-b4e8-138dd59dd528 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:47.577069 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 977/1958] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:47 2021] DELETE /identity/v3/users/6bc33b3ae5804b50ad785903edf560f9 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:47.587783 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58350f4-1431-4f0d-a12d-d0712e5e8f65 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:47.588249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58350f4-1431-4f0d-a12d-d0712e5e8f65 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:47.588730 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58350f4-1431-4f0d-a12d-d0712e5e8f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:47.616394 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-d58350f4-1431-4f0d-a12d-d0712e5e8f65 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:47.617624 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d58350f4-1431-4f0d-a12d-d0712e5e8f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:47.682263 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 978/1959] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:47.698396 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-b38223ae-ffbb-4c57-b4e8-138dd59dd528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eddeb96503bb49b581879d5d8081f747', 'request_id': 'req-b38223ae-ffbb-4c57-b4e8-138dd59dd528'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:47.702620 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58350f4-1431-4f0d-a12d-d0712e5e8f65 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:47.703990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d58350f4-1431-4f0d-a12d-d0712e5e8f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:47.716641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-b38223ae-ffbb-4c57-b4e8-138dd59dd528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eddeb96503bb49b581879d5d8081f747', 'request_id': 'req-b38223ae-ffbb-4c57-b4e8-138dd59dd528'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:47.743579 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-b38223ae-ffbb-4c57-b4e8-138dd59dd528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eddeb96503bb49b581879d5d8081f747', 'request_id': 'req-b38223ae-ffbb-4c57-b4e8-138dd59dd528'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:47.775698 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58350f4-1431-4f0d-a12d-d0712e5e8f65 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:47.816362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-b38223ae-ffbb-4c57-b4e8-138dd59dd528 admin admin] The token cache is being invalidate because project eddeb96503bb49b581879d5d8081f747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:47.816851 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-b38223ae-ffbb-4c57-b4e8-138dd59dd528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:47.817707 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-b38223ae-ffbb-4c57-b4e8-138dd59dd528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:47.819209 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 982/1960] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:47 2021] DELETE /identity/v3/projects/eddeb96503bb49b581879d5d8081f747 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:47.825367 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a60d3-3ba1-4843-8baf-039a3af46ff5 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:47.825656 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a60d3-3ba1-4843-8baf-039a3af46ff5 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:47.826785 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a60d3-3ba1-4843-8baf-039a3af46ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:47.836120 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8720407-a117-4e05-80c4-ecc737aa3bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:47.836781 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8720407-a117-4e05-80c4-ecc737aa3bdd service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:47.837101 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8720407-a117-4e05-80c4-ecc737aa3bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:47.837393 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8720407-a117-4e05-80c4-ecc737aa3bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:47.839164 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-c8720407-a117-4e05-80c4-ecc737aa3bdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:47.848704 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-083a60d3-3ba1-4843-8baf-039a3af46ff5 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:47.849818 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-083a60d3-3ba1-4843-8baf-039a3af46ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:47.913392 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8720407-a117-4e05-80c4-ecc737aa3bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:47.922059 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 983/1961] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:47.924445 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fbf98-86d7-428d-86e5-bf23b9133c9c None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:47.924777 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fbf98-86d7-428d-86e5-bf23b9133c9c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:47.925051 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fbf98-86d7-428d-86e5-bf23b9133c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:47.939088 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8720407-a117-4e05-80c4-ecc737aa3bdd service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:47.949845 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-549fbf98-86d7-428d-86e5-bf23b9133c9c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:47.950081 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 979/1962] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:47 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:53:47.954147 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-549fbf98-86d7-428d-86e5-bf23b9133c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:47.975139 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 984/1963] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:47.976362 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8720407-a117-4e05-80c4-ecc737aa3bdd service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:47.985867 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8720407-a117-4e05-80c4-ecc737aa3bdd service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:47.990348 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1e61e-9c82-407c-9a81-9ca86df84bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:47.990943 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1e61e-9c82-407c-9a81-9ca86df84bea admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:47.991234 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1e61e-9c82-407c-9a81-9ca86df84bea admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:47.991518 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1e61e-9c82-407c-9a81-9ca86df84bea admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:47.992201 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1e61e-9c82-407c-9a81-9ca86df84bea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:53:47.992501 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1e61e-9c82-407c-9a81-9ca86df84bea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:48.018870 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1e61e-9c82-407c-9a81-9ca86df84bea admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:48.032060 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 980/1964] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:53:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:53:48.036534 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fbf98-86d7-428d-86e5-bf23b9133c9c None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:48.046146 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fbf98-86d7-428d-86e5-bf23b9133c9c None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:48.050697 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768e947-f762-4a15-b847-c2bf0e537670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:48.051287 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768e947-f762-4a15-b847-c2bf0e537670 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:48.051655 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768e947-f762-4a15-b847-c2bf0e537670 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:48.051940 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768e947-f762-4a15-b847-c2bf0e537670 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:48.052608 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768e947-f762-4a15-b847-c2bf0e537670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:48.079682 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768e947-f762-4a15-b847-c2bf0e537670 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:48.189048 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1e61e-9c82-407c-9a81-9ca86df84bea admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:48.191467 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-dfe1e61e-9c82-407c-9a81-9ca86df84bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:48.211257 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1e61e-9c82-407c-9a81-9ca86df84bea admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:48.215818 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 985/1965] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:48 2021] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:48.217149 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe89d9-7a58-4734-bc3b-48ea4952d82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:48.218169 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe89d9-7a58-4734-bc3b-48ea4952d82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:48.218619 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe89d9-7a58-4734-bc3b-48ea4952d82e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:48.218909 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe89d9-7a58-4734-bc3b-48ea4952d82e admin admin] PATH_INFO: `/v3/projects/998794aae31f4d29a34c033bf6c5c8a6` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:48.219721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768e947-f762-4a15-b847-c2bf0e537670 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:48.220176 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe89d9-7a58-4734-bc3b-48ea4952d82e admin admin] RBAC: Authorizing `identity:delete_project(project_id=998794aae31f4d29a34c033bf6c5c8a6)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:48.252163 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe89d9-7a58-4734-bc3b-48ea4952d82e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:48.326972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768e947-f762-4a15-b847-c2bf0e537670 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:48.338659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e8ae6-4472-46f9-bae9-5497f5dc4557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:48.345720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e8ae6-4472-46f9-bae9-5497f5dc4557 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:48.345720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e8ae6-4472-46f9-bae9-5497f5dc4557 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:48.345720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e8ae6-4472-46f9-bae9-5497f5dc4557 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:48.345720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e8ae6-4472-46f9-bae9-5497f5dc4557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:48.368759 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e8ae6-4472-46f9-bae9-5497f5dc4557 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:48.425094 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7ebe89d9-7a58-4734-bc3b-48ea4952d82e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '998794aae31f4d29a34c033bf6c5c8a6', 'request_id': 'req-7ebe89d9-7a58-4734-bc3b-48ea4952d82e'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:48.431615 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7ebe89d9-7a58-4734-bc3b-48ea4952d82e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '998794aae31f4d29a34c033bf6c5c8a6', 'request_id': 'req-7ebe89d9-7a58-4734-bc3b-48ea4952d82e'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:48.455588 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7ebe89d9-7a58-4734-bc3b-48ea4952d82e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '998794aae31f4d29a34c033bf6c5c8a6', 'request_id': 'req-7ebe89d9-7a58-4734-bc3b-48ea4952d82e'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:48.515339 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 986/1966] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:48 2021] POST /identity/v3/users => generated 289 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:48.529089 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e8ae6-4472-46f9-bae9-5497f5dc4557 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:48.544993 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e8ae6-4472-46f9-bae9-5497f5dc4557 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:48.554574 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7ebe89d9-7a58-4734-bc3b-48ea4952d82e admin admin] The token cache is being invalidate because project 998794aae31f4d29a34c033bf6c5c8a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:48.554860 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7ebe89d9-7a58-4734-bc3b-48ea4952d82e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:48.556991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7ebe89d9-7a58-4734-bc3b-48ea4952d82e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:48.560772 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 981/1967] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:48 2021] DELETE /identity/v3/projects/998794aae31f4d29a34c033bf6c5c8a6 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:48.563375 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe89d9-7a58-4734-bc3b-48ea4952d82e admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:48.564739 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-7ebe89d9-7a58-4734-bc3b-48ea4952d82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:48.637243 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a35b48-e30d-4ebb-b861-b400a5c89055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:48.637962 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a35b48-e30d-4ebb-b861-b400a5c89055 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:48.638336 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a35b48-e30d-4ebb-b861-b400a5c89055 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:48.638708 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a35b48-e30d-4ebb-b861-b400a5c89055 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:48.639753 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a35b48-e30d-4ebb-b861-b400a5c89055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:48.677549 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a35b48-e30d-4ebb-b861-b400a5c89055 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:48.698200 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 987/1968] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:48 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:48.707525 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a35b48-e30d-4ebb-b861-b400a5c89055 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:48.710613 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-40a35b48-e30d-4ebb-b861-b400a5c89055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:48.712193 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe89d9-7a58-4734-bc3b-48ea4952d82e admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:48.727548 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a6673-b6f8-46ed-8cf7-6eaef0e13104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:48.728888 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a6673-b6f8-46ed-8cf7-6eaef0e13104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:48.729180 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a6673-b6f8-46ed-8cf7-6eaef0e13104 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:48.729466 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a6673-b6f8-46ed-8cf7-6eaef0e13104 admin admin] PATH_INFO: `/v3/users/f62727b8afb44796940abb823373b859` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:48.731734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a6673-b6f8-46ed-8cf7-6eaef0e13104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f62727b8afb44796940abb823373b859)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:48.749137 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a35b48-e30d-4ebb-b861-b400a5c89055 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:48.756392 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f21750-2794-4a06-9dcb-b067b5677f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:48.757909 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f21750-2794-4a06-9dcb-b067b5677f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:48.758294 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f21750-2794-4a06-9dcb-b067b5677f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:48.758686 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f21750-2794-4a06-9dcb-b067b5677f2a admin admin] PATH_INFO: `/v3/projects/1e3841f6616343dcbaec88b9c030cacc/users/11d6579f401a4ba7bb91bc7db1fdeae9/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:48.767345 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a6673-b6f8-46ed-8cf7-6eaef0e13104 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:48.782668 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f21750-2794-4a06-9dcb-b067b5677f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3841f6616343dcbaec88b9c030cacc, user_id=11d6579f401a4ba7bb91bc7db1fdeae9, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:48.814112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f21750-2794-4a06-9dcb-b067b5677f2a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:48.949698 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 988/1969] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:48 2021] PUT /identity/v3/projects/1e3841f6616343dcbaec88b9c030cacc/users/11d6579f401a4ba7bb91bc7db1fdeae9/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:48.960434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa5305-b720-4b0a-b752-ee9ea696435c None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:48.960759 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa5305-b720-4b0a-b752-ee9ea696435c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:48.961046 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa5305-b720-4b0a-b752-ee9ea696435c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:48.998723 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-2b4a6673-b6f8-46ed-8cf7-6eaef0e13104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f62727b8afb44796940abb823373b859'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:49.002340 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-1bfa5305-b720-4b0a-b752-ee9ea696435c None None] MFA Rules not processed for user `11d6579f401a4ba7bb91bc7db1fdeae9`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:49.003801 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1bfa5305-b720-4b0a-b752-ee9ea696435c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:49.094256 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 989/1970] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:48 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:49.099477 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa5305-b720-4b0a-b752-ee9ea696435c None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:49.099677 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-2b4a6673-b6f8-46ed-8cf7-6eaef0e13104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f62727b8afb44796940abb823373b859'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:49.100356 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-2b4a6673-b6f8-46ed-8cf7-6eaef0e13104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f62727b8afb44796940abb823373b859'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:49.123134 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-2b4a6673-b6f8-46ed-8cf7-6eaef0e13104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f62727b8afb44796940abb823373b859'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:49.124512 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-2b4a6673-b6f8-46ed-8cf7-6eaef0e13104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f62727b8afb44796940abb823373b859'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:49.156651 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 982/1971] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:48 2021] DELETE /identity/v3/users/f62727b8afb44796940abb823373b859 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:49.206451 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa5305-b720-4b0a-b752-ee9ea696435c None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:49.282526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1361981-f732-48f6-aaed-ea065ec29312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:49.283298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1361981-f732-48f6-aaed-ea065ec29312 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:49.283683 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1361981-f732-48f6-aaed-ea065ec29312 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:49.284591 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1361981-f732-48f6-aaed-ea065ec29312 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:49.285042 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1361981-f732-48f6-aaed-ea065ec29312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:49.319380 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1361981-f732-48f6-aaed-ea065ec29312 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:49.466822 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 990/1972] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:49 2021] POST /identity/v3/projects => generated 379 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:49.467990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a6673-b6f8-46ed-8cf7-6eaef0e13104 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:49.471935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2b4a6673-b6f8-46ed-8cf7-6eaef0e13104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:49.496879 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a6673-b6f8-46ed-8cf7-6eaef0e13104 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:49.584769 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656f8ed-2482-4dfa-bfea-301bd8051bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:49.585631 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656f8ed-2482-4dfa-bfea-301bd8051bce admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:49.586074 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656f8ed-2482-4dfa-bfea-301bd8051bce admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:49.586508 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656f8ed-2482-4dfa-bfea-301bd8051bce admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:49.587300 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656f8ed-2482-4dfa-bfea-301bd8051bce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:49.619340 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656f8ed-2482-4dfa-bfea-301bd8051bce admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:49.748426 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 983/1973] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:49 2021] POST /identity/v3/users => generated 290 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:49.751474 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1361981-f732-48f6-aaed-ea065ec29312 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:49.770711 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1361981-f732-48f6-aaed-ea065ec29312 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:49.787302 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24082985-3d41-4972-b8e8-3f0552352dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:49.787641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24082985-3d41-4972-b8e8-3f0552352dec admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:49.787932 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24082985-3d41-4972-b8e8-3f0552352dec admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:49.788215 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24082985-3d41-4972-b8e8-3f0552352dec admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:49.788949 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24082985-3d41-4972-b8e8-3f0552352dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:49.841843 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24082985-3d41-4972-b8e8-3f0552352dec admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:49.868717 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 991/1974] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:49 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:49.872750 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656f8ed-2482-4dfa-bfea-301bd8051bce admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:49.890395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656f8ed-2482-4dfa-bfea-301bd8051bce admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:49.903629 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7a3d0-d6df-4ab8-8bbf-403f88bd1c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:49.904491 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7a3d0-d6df-4ab8-8bbf-403f88bd1c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:49.904831 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7a3d0-d6df-4ab8-8bbf-403f88bd1c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:49.905116 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7a3d0-d6df-4ab8-8bbf-403f88bd1c3f admin admin] PATH_INFO: `/v3/projects/8715d3def5ae4d9d92289cf3defe31f2/users/7819cb00f45f4a1db34e3015ca2fda8b/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:49.944518 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7a3d0-d6df-4ab8-8bbf-403f88bd1c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8715d3def5ae4d9d92289cf3defe31f2, user_id=7819cb00f45f4a1db34e3015ca2fda8b, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:49.982936 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7a3d0-d6df-4ab8-8bbf-403f88bd1c3f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:50.015042 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24082985-3d41-4972-b8e8-3f0552352dec admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:50.017315 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-24082985-3d41-4972-b8e8-3f0552352dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:50.033003 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24082985-3d41-4972-b8e8-3f0552352dec admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:50.037727 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf09ef-6779-41b1-a57a-55dbb4f09cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:50.038517 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf09ef-6779-41b1-a57a-55dbb4f09cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:50.038879 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf09ef-6779-41b1-a57a-55dbb4f09cde admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:50.039377 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf09ef-6779-41b1-a57a-55dbb4f09cde admin admin] PATH_INFO: `/v3/projects/4385ea0d47f044c2ac5b59d97f0aedab` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:50.040479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf09ef-6779-41b1-a57a-55dbb4f09cde admin admin] RBAC: Authorizing `identity:delete_project(project_id=4385ea0d47f044c2ac5b59d97f0aedab)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:50.069842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf09ef-6779-41b1-a57a-55dbb4f09cde admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:50.091012 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 984/1975] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:49 2021] PUT /identity/v3/projects/8715d3def5ae4d9d92289cf3defe31f2/users/7819cb00f45f4a1db34e3015ca2fda8b/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:50.099537 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bda5f-c600-4a2e-9f2b-a0b6c161cf00 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:50.099836 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bda5f-c600-4a2e-9f2b-a0b6c161cf00 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:50.100120 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bda5f-c600-4a2e-9f2b-a0b6c161cf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:50.151765 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-395bda5f-c600-4a2e-9f2b-a0b6c161cf00 None None] MFA Rules not processed for user `7819cb00f45f4a1db34e3015ca2fda8b`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:50.153178 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-395bda5f-c600-4a2e-9f2b-a0b6c161cf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:50.232651 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 985/1976] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:50 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:50.232651 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bda5f-c600-4a2e-9f2b-a0b6c161cf00 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:50.232651 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-395bda5f-c600-4a2e-9f2b-a0b6c161cf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:50.252329 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-cfdf09ef-6779-41b1-a57a-55dbb4f09cde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4385ea0d47f044c2ac5b59d97f0aedab', 'request_id': 'req-cfdf09ef-6779-41b1-a57a-55dbb4f09cde'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:50.258221 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-cfdf09ef-6779-41b1-a57a-55dbb4f09cde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4385ea0d47f044c2ac5b59d97f0aedab', 'request_id': 'req-cfdf09ef-6779-41b1-a57a-55dbb4f09cde'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:50.271602 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-cfdf09ef-6779-41b1-a57a-55dbb4f09cde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4385ea0d47f044c2ac5b59d97f0aedab', 'request_id': 'req-cfdf09ef-6779-41b1-a57a-55dbb4f09cde'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:50.309487 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bda5f-c600-4a2e-9f2b-a0b6c161cf00 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:50.372318 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67b6ad-925e-4311-b4d8-c403a06c14be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:50.373581 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67b6ad-925e-4311-b4d8-c403a06c14be admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:50.374022 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67b6ad-925e-4311-b4d8-c403a06c14be admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:50.374450 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67b6ad-925e-4311-b4d8-c403a06c14be admin admin] PATH_INFO: `/v3/projects/1528d90b31c4400abab581112cb504e8` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:50.375617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67b6ad-925e-4311-b4d8-c403a06c14be admin admin] RBAC: Authorizing `identity:delete_project(project_id=1528d90b31c4400abab581112cb504e8)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:50.381535 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-cfdf09ef-6779-41b1-a57a-55dbb4f09cde admin admin] The token cache is being invalidate because project 4385ea0d47f044c2ac5b59d97f0aedab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:50.382085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-cfdf09ef-6779-41b1-a57a-55dbb4f09cde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:50.383007 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-cfdf09ef-6779-41b1-a57a-55dbb4f09cde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:50.391548 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 992/1977] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:50 2021] DELETE /identity/v3/projects/4385ea0d47f044c2ac5b59d97f0aedab => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:50.392758 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf09ef-6779-41b1-a57a-55dbb4f09cde admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:50.394334 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-cfdf09ef-6779-41b1-a57a-55dbb4f09cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:50.404418 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67b6ad-925e-4311-b4d8-c403a06c14be admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:50.409252 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf09ef-6779-41b1-a57a-55dbb4f09cde admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:50.416024 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41197fe8-8721-494b-ba13-0d72fcf7b663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:50.416871 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41197fe8-8721-494b-ba13-0d72fcf7b663 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:50.417317 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41197fe8-8721-494b-ba13-0d72fcf7b663 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:50.418240 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41197fe8-8721-494b-ba13-0d72fcf7b663 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:50.419592 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41197fe8-8721-494b-ba13-0d72fcf7b663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:50.451710 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41197fe8-8721-494b-ba13-0d72fcf7b663 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:50.562118 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 993/1978] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:50 2021] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:50.566248 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7ec86-2185-44aa-b762-bee519d27c1d None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:50.566696 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7ec86-2185-44aa-b762-bee519d27c1d None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:50.567085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7ec86-2185-44aa-b762-bee519d27c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:50.573777 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6e67b6ad-925e-4311-b4d8-c403a06c14be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1528d90b31c4400abab581112cb504e8', 'request_id': 'req-6e67b6ad-925e-4311-b4d8-c403a06c14be'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:50.579736 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6e67b6ad-925e-4311-b4d8-c403a06c14be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1528d90b31c4400abab581112cb504e8', 'request_id': 'req-6e67b6ad-925e-4311-b4d8-c403a06c14be'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:50.591310 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-dfe7ec86-2185-44aa-b762-bee519d27c1d None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:50.592452 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-dfe7ec86-2185-44aa-b762-bee519d27c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:50.592598 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6e67b6ad-925e-4311-b4d8-c403a06c14be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1528d90b31c4400abab581112cb504e8', 'request_id': 'req-6e67b6ad-925e-4311-b4d8-c403a06c14be'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:50.662467 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 994/1979] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:50.663655 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7ec86-2185-44aa-b762-bee519d27c1d None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:50.675437 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7ec86-2185-44aa-b762-bee519d27c1d None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:50.679729 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6e67b6ad-925e-4311-b4d8-c403a06c14be admin admin] The token cache is being invalidate because project 1528d90b31c4400abab581112cb504e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:50.680120 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6e67b6ad-925e-4311-b4d8-c403a06c14be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:50.680786 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6e67b6ad-925e-4311-b4d8-c403a06c14be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:50.681134 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581d11e-6313-4225-bd22-ab1ebb42038f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:50.681680 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581d11e-6313-4225-bd22-ab1ebb42038f admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:50.681966 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581d11e-6313-4225-bd22-ab1ebb42038f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:50.682302 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581d11e-6313-4225-bd22-ab1ebb42038f admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:50.682891 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581d11e-6313-4225-bd22-ab1ebb42038f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:50.683356 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 986/1980] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:50 2021] DELETE /identity/v3/projects/1528d90b31c4400abab581112cb504e8 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:50.684442 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11099c2e-3d76-4b03-822f-06cd654dbe7a None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:50.685260 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11099c2e-3d76-4b03-822f-06cd654dbe7a None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:50.685644 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11099c2e-3d76-4b03-822f-06cd654dbe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:50.712310 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-11099c2e-3d76-4b03-822f-06cd654dbe7a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:50.713982 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-11099c2e-3d76-4b03-822f-06cd654dbe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:50.728219 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 987/1981] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:50.729841 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11099c2e-3d76-4b03-822f-06cd654dbe7a None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:50.731846 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-11099c2e-3d76-4b03-822f-06cd654dbe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:50.732136 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581d11e-6313-4225-bd22-ab1ebb42038f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:50.747994 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11099c2e-3d76-4b03-822f-06cd654dbe7a None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:50.752928 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee3c14-5114-4492-9f9f-5e4523714954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:50.753980 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee3c14-5114-4492-9f9f-5e4523714954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:50.754270 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee3c14-5114-4492-9f9f-5e4523714954 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:50.754569 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee3c14-5114-4492-9f9f-5e4523714954 admin admin] PATH_INFO: `/v3/users/fd596ff0391444e288dc76f57a449daf` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:50.755783 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee3c14-5114-4492-9f9f-5e4523714954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd596ff0391444e288dc76f57a449daf)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:50.787655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee3c14-5114-4492-9f9f-5e4523714954 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:50.858097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 995/1982] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:50 2021] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:50.858909 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581d11e-6313-4225-bd22-ab1ebb42038f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:50.869324 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581d11e-6313-4225-bd22-ab1ebb42038f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:50.875080 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da443a4b-506b-4e0a-8eee-ed4bf9cd6ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:50.875758 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da443a4b-506b-4e0a-8eee-ed4bf9cd6ecd admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:50.876152 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da443a4b-506b-4e0a-8eee-ed4bf9cd6ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:50.876513 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da443a4b-506b-4e0a-8eee-ed4bf9cd6ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:50.877659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da443a4b-506b-4e0a-8eee-ed4bf9cd6ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:53:50.880826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da443a4b-506b-4e0a-8eee-ed4bf9cd6ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:50.907069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da443a4b-506b-4e0a-8eee-ed4bf9cd6ecd admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:50.920438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 996/1983] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:53:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:53:50.921358 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da443a4b-506b-4e0a-8eee-ed4bf9cd6ecd admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:50.924740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-da443a4b-506b-4e0a-8eee-ed4bf9cd6ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:50.937417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da443a4b-506b-4e0a-8eee-ed4bf9cd6ecd admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:50.941694 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ada11d-7987-4835-8351-e24ceffcf80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:50.942307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ada11d-7987-4835-8351-e24ceffcf80c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:50.942599 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ada11d-7987-4835-8351-e24ceffcf80c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:50.942879 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ada11d-7987-4835-8351-e24ceffcf80c admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:50.943561 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ada11d-7987-4835-8351-e24ceffcf80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:50.969604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ada11d-7987-4835-8351-e24ceffcf80c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:50.980799 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 997/1984] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:50 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:50.981685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ada11d-7987-4835-8351-e24ceffcf80c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:50.991418 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ada11d-7987-4835-8351-e24ceffcf80c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:50.996057 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d4f86-50ea-46ec-a23f-e07316f9d43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:50.996672 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d4f86-50ea-46ec-a23f-e07316f9d43e admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:50.996966 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d4f86-50ea-46ec-a23f-e07316f9d43e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:50.997249 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d4f86-50ea-46ec-a23f-e07316f9d43e admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:50.997899 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d4f86-50ea-46ec-a23f-e07316f9d43e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:51.028553 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d4f86-50ea-46ec-a23f-e07316f9d43e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:51.063395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ebee3c14-5114-4492-9f9f-5e4523714954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd596ff0391444e288dc76f57a449daf'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:51.164989 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ebee3c14-5114-4492-9f9f-5e4523714954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd596ff0391444e288dc76f57a449daf'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:51.170291 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ebee3c14-5114-4492-9f9f-5e4523714954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd596ff0391444e288dc76f57a449daf'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:51.176076 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ebee3c14-5114-4492-9f9f-5e4523714954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd596ff0391444e288dc76f57a449daf'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:51.176865 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ebee3c14-5114-4492-9f9f-5e4523714954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd596ff0391444e288dc76f57a449daf'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:51.200487 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 988/1985] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:50 2021] DELETE /identity/v3/users/fd596ff0391444e288dc76f57a449daf => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:51.201505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee3c14-5114-4492-9f9f-5e4523714954 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:51.202936 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-ebee3c14-5114-4492-9f9f-5e4523714954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:51.226069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 998/1986] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:50 2021] POST /identity/v3/projects => generated 401 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:51.228056 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d4f86-50ea-46ec-a23f-e07316f9d43e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:51.229708 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-dd8d4f86-50ea-46ec-a23f-e07316f9d43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:51.290544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee3c14-5114-4492-9f9f-5e4523714954 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:51.373301 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6dbfb2-d0a6-4398-b7a0-ed59c6b9b662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:51.376995 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dbfb2-d0a6-4398-b7a0-ed59c6b9b662 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:51.376995 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dbfb2-d0a6-4398-b7a0-ed59c6b9b662 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:51.376995 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dbfb2-d0a6-4398-b7a0-ed59c6b9b662 admin admin] PATH_INFO: `/v3/projects/23f5b215115f444c9d5e29bead918e25/users/9972ff75d96f4b4e851d0b01c4fe38ca/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:51.423441 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d4f86-50ea-46ec-a23f-e07316f9d43e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:51.441109 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb827ddf-f91b-4371-92eb-86770a1181c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:51.442552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb827ddf-f91b-4371-92eb-86770a1181c8 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:51.443420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6dbfb2-d0a6-4398-b7a0-ed59c6b9b662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f5b215115f444c9d5e29bead918e25, user_id=9972ff75d96f4b4e851d0b01c4fe38ca, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:51.445155 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb827ddf-f91b-4371-92eb-86770a1181c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:51.447431 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb827ddf-f91b-4371-92eb-86770a1181c8 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:51.451194 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb827ddf-f91b-4371-92eb-86770a1181c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:51.539460 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb827ddf-f91b-4371-92eb-86770a1181c8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:51.542000 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6dbfb2-d0a6-4398-b7a0-ed59c6b9b662 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:51.628820 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 989/1987] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:51 2021] PUT /identity/v3/projects/23f5b215115f444c9d5e29bead918e25/users/9972ff75d96f4b4e851d0b01c4fe38ca/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:51.632801 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6dbfb2-d0a6-4398-b7a0-ed59c6b9b662 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:51.659766 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 999/1988] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:51 2021] POST /identity/v3/users => generated 301 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:51.660945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb827ddf-f91b-4371-92eb-86770a1181c8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:51.691815 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb827ddf-f91b-4371-92eb-86770a1181c8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:51.712361 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6dbfb2-d0a6-4398-b7a0-ed59c6b9b662 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:51.715372 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f275a99-5a0d-44d8-b40f-13500c1803bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:51.716060 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f275a99-5a0d-44d8-b40f-13500c1803bd admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:51.716335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f275a99-5a0d-44d8-b40f-13500c1803bd admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:51.716642 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f275a99-5a0d-44d8-b40f-13500c1803bd admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:51.717347 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f275a99-5a0d-44d8-b40f-13500c1803bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:51.743577 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f275a99-5a0d-44d8-b40f-13500c1803bd admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:51.755020 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 990/1989] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:51 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:51.760909 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f275a99-5a0d-44d8-b40f-13500c1803bd admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:51.771608 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f275a99-5a0d-44d8-b40f-13500c1803bd admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:51.778055 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab9f0c-149c-46ae-bb2b-abc881b1efa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:51.778882 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab9f0c-149c-46ae-bb2b-abc881b1efa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:51.779166 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab9f0c-149c-46ae-bb2b-abc881b1efa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:51.779448 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab9f0c-149c-46ae-bb2b-abc881b1efa2 admin admin] PATH_INFO: `/v3/projects/23f5b215115f444c9d5e29bead918e25/users/9972ff75d96f4b4e851d0b01c4fe38ca/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:51.787080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab9f0c-149c-46ae-bb2b-abc881b1efa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f5b215115f444c9d5e29bead918e25, user_id=9972ff75d96f4b4e851d0b01c4fe38ca, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:51.813433 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58bb80-5846-4494-85fd-d71e868a5690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:51.814245 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58bb80-5846-4494-85fd-d71e868a5690 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:51.814755 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58bb80-5846-4494-85fd-d71e868a5690 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:51.815203 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58bb80-5846-4494-85fd-d71e868a5690 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:51.816323 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58bb80-5846-4494-85fd-d71e868a5690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:51.829301 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab9f0c-149c-46ae-bb2b-abc881b1efa2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:51.846795 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 991/1990] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:51 2021] PUT /identity/v3/projects/23f5b215115f444c9d5e29bead918e25/users/9972ff75d96f4b4e851d0b01c4fe38ca/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:51.847166 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58bb80-5846-4494-85fd-d71e868a5690 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:51.847747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab9f0c-149c-46ae-bb2b-abc881b1efa2 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:51.859024 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1000/1991] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:51 2021] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:51.863357 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58bb80-5846-4494-85fd-d71e868a5690 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:51.874151 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58bb80-5846-4494-85fd-d71e868a5690 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:51.934498 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab9f0c-149c-46ae-bb2b-abc881b1efa2 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:51.939891 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39836b8c-1acc-4dd5-9ea1-174f6ab4f89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:51.941017 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39836b8c-1acc-4dd5-9ea1-174f6ab4f89b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:51.941017 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39836b8c-1acc-4dd5-9ea1-174f6ab4f89b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:51.941191 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39836b8c-1acc-4dd5-9ea1-174f6ab4f89b admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:51.941784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39836b8c-1acc-4dd5-9ea1-174f6ab4f89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:51.981590 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39836b8c-1acc-4dd5-9ea1-174f6ab4f89b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:51.992526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569fc01-b36d-45b9-979a-d62abc60878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:51.993295 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569fc01-b36d-45b9-979a-d62abc60878d admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:51.993973 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569fc01-b36d-45b9-979a-d62abc60878d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:51.994459 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569fc01-b36d-45b9-979a-d62abc60878d admin admin] PATH_INFO: `/v3/projects/18a0c572c10649f8a59b1b1c68e5f92c/users/15e88fb1dff9474c8eac7537caf1029a/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:52.000612 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 992/1992] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:51 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:53:52.003704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39836b8c-1acc-4dd5-9ea1-174f6ab4f89b admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:52.026338 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39836b8c-1acc-4dd5-9ea1-174f6ab4f89b admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:52.042543 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569fc01-b36d-45b9-979a-d62abc60878d admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a0c572c10649f8a59b1b1c68e5f92c, user_id=15e88fb1dff9474c8eac7537caf1029a, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:52.056742 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f94e8-5e73-4731-abc6-1874c5997749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:52.057878 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f94e8-5e73-4731-abc6-1874c5997749 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:52.058439 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f94e8-5e73-4731-abc6-1874c5997749 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:52.058927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f94e8-5e73-4731-abc6-1874c5997749 admin admin] PATH_INFO: `/v3/projects/23f5b215115f444c9d5e29bead918e25/users/9972ff75d96f4b4e851d0b01c4fe38ca/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:52.062273 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f94e8-5e73-4731-abc6-1874c5997749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f5b215115f444c9d5e29bead918e25, user_id=9972ff75d96f4b4e851d0b01c4fe38ca, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:52.095760 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f94e8-5e73-4731-abc6-1874c5997749 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:52.096034 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569fc01-b36d-45b9-979a-d62abc60878d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:52.204755 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 993/1993] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:52 2021] PUT /identity/v3/projects/23f5b215115f444c9d5e29bead918e25/users/9972ff75d96f4b4e851d0b01c4fe38ca/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:52.215531 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211788a6-0f91-46ac-a260-958a303a3791 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:52.215831 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211788a6-0f91-46ac-a260-958a303a3791 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:52.216137 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211788a6-0f91-46ac-a260-958a303a3791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:52.226739 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1001/1994] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:51 2021] PUT /identity/v3/projects/18a0c572c10649f8a59b1b1c68e5f92c/users/15e88fb1dff9474c8eac7537caf1029a/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:52.247608 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d147a-af24-4ffc-a3c8-e96dc612af36 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:52.248128 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d147a-af24-4ffc-a3c8-e96dc612af36 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:52.248495 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d147a-af24-4ffc-a3c8-e96dc612af36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:52.279414 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-211788a6-0f91-46ac-a260-958a303a3791 None None] MFA Rules not processed for user `9972ff75d96f4b4e851d0b01c4fe38ca`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:52.280992 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-211788a6-0f91-46ac-a260-958a303a3791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:52.306116 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-0d7d147a-af24-4ffc-a3c8-e96dc612af36 None None] MFA Rules not processed for user `15e88fb1dff9474c8eac7537caf1029a`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:52.307695 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0d7d147a-af24-4ffc-a3c8-e96dc612af36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:52.381579 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 994/1995] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:52 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:53:52.392399 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211788a6-0f91-46ac-a260-958a303a3791 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:52.393980 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-211788a6-0f91-46ac-a260-958a303a3791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:52.451980 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1002/1996] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:52 2021] POST /identity/v3/auth/tokens => generated 3708 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:53:52.453849 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d147a-af24-4ffc-a3c8-e96dc612af36 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:52.494804 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211788a6-0f91-46ac-a260-958a303a3791 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:52.498761 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0640a1-5729-465e-8e20-aa61a2727e78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:52.499336 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0640a1-5729-465e-8e20-aa61a2727e78 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:52.499626 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0640a1-5729-465e-8e20-aa61a2727e78 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:52.499907 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0640a1-5729-465e-8e20-aa61a2727e78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:52.515042 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0640a1-5729-465e-8e20-aa61a2727e78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:52.534913 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d147a-af24-4ffc-a3c8-e96dc612af36 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:52.539233 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40a620-d0d1-4a6e-8150-0aa3bf390f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:52.539851 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40a620-d0d1-4a6e-8150-0aa3bf390f79 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:52.540295 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40a620-d0d1-4a6e-8150-0aa3bf390f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:52.540606 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40a620-d0d1-4a6e-8150-0aa3bf390f79 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:52.541249 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40a620-d0d1-4a6e-8150-0aa3bf390f79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:52.541828 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0640a1-5729-465e-8e20-aa61a2727e78 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:52.554599 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 995/1997] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:52 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:53:52.560644 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0640a1-5729-465e-8e20-aa61a2727e78 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:52.562661 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2d0640a1-5729-465e-8e20-aa61a2727e78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:52.588348 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0640a1-5729-465e-8e20-aa61a2727e78 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:52.592851 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd90b1-ba0a-4f0d-bb77-e837bfffa9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:52.593863 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd90b1-ba0a-4f0d-bb77-e837bfffa9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:52.594159 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd90b1-ba0a-4f0d-bb77-e837bfffa9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:52.595138 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd90b1-ba0a-4f0d-bb77-e837bfffa9f2 admin admin] PATH_INFO: `/v3/projects/6bd0af951f0d4a16bb5e9923ed1aa8ae` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:52.595229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40a620-d0d1-4a6e-8150-0aa3bf390f79 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:52.596189 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd90b1-ba0a-4f0d-bb77-e837bfffa9f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd0af951f0d4a16bb5e9923ed1aa8ae)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:52.625140 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd90b1-ba0a-4f0d-bb77-e837bfffa9f2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:52.740705 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1003/1998] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:52 2021] POST /identity/v3/projects => generated 401 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:52.740705 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40a620-d0d1-4a6e-8150-0aa3bf390f79 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:52.742001 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-4c40a620-d0d1-4a6e-8150-0aa3bf390f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:52.792155 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-95dd90b1-ba0a-4f0d-bb77-e837bfffa9f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd0af951f0d4a16bb5e9923ed1aa8ae', 'request_id': 'req-95dd90b1-ba0a-4f0d-bb77-e837bfffa9f2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:52.798522 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-95dd90b1-ba0a-4f0d-bb77-e837bfffa9f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd0af951f0d4a16bb5e9923ed1aa8ae', 'request_id': 'req-95dd90b1-ba0a-4f0d-bb77-e837bfffa9f2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:52.809608 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40a620-d0d1-4a6e-8150-0aa3bf390f79 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:52.811418 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-95dd90b1-ba0a-4f0d-bb77-e837bfffa9f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd0af951f0d4a16bb5e9923ed1aa8ae', 'request_id': 'req-95dd90b1-ba0a-4f0d-bb77-e837bfffa9f2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:52.867929 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34155c35-5f4c-42c5-b177-959141c40b4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:52.868509 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34155c35-5f4c-42c5-b177-959141c40b4f service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:52.868829 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34155c35-5f4c-42c5-b177-959141c40b4f service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:52.869111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34155c35-5f4c-42c5-b177-959141c40b4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:52.870803 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-34155c35-5f4c-42c5-b177-959141c40b4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:52.924900 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-95dd90b1-ba0a-4f0d-bb77-e837bfffa9f2 admin admin] The token cache is being invalidate because project 6bd0af951f0d4a16bb5e9923ed1aa8ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:53:52.925228 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-95dd90b1-ba0a-4f0d-bb77-e837bfffa9f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:52.926048 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-95dd90b1-ba0a-4f0d-bb77-e837bfffa9f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:52.927572 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 996/1999] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:53:52 2021] DELETE /identity/v3/projects/6bd0af951f0d4a16bb5e9923ed1aa8ae => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:52.935481 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd90b1-ba0a-4f0d-bb77-e837bfffa9f2 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:52.936844 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-95dd90b1-ba0a-4f0d-bb77-e837bfffa9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:52.944266 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34155c35-5f4c-42c5-b177-959141c40b4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:52.979040 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34155c35-5f4c-42c5-b177-959141c40b4f service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:52.998011 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1004/2000] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:52 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:52.999244 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96687cdf-d3cf-463d-80a1-bda5f4416917 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:52.999585 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96687cdf-d3cf-463d-80a1-bda5f4416917 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:53.000409 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96687cdf-d3cf-463d-80a1-bda5f4416917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:53.025610 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-96687cdf-d3cf-463d-80a1-bda5f4416917 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:53.026745 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd90b1-ba0a-4f0d-bb77-e837bfffa9f2 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:53.026946 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-96687cdf-d3cf-463d-80a1-bda5f4416917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:53.034786 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1005/2001] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:53.041989 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e55ac-5456-4f97-a507-f25813aa9333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:53.042251 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c864c4-f6e1-4e77-9c1c-e5be2312ddda None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:53.043175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c864c4-f6e1-4e77-9c1c-e5be2312ddda None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:53.043672 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e55ac-5456-4f97-a507-f25813aa9333 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:53.043763 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c864c4-f6e1-4e77-9c1c-e5be2312ddda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:53.043847 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e55ac-5456-4f97-a507-f25813aa9333 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:53.044439 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e55ac-5456-4f97-a507-f25813aa9333 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:53.045519 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e55ac-5456-4f97-a507-f25813aa9333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:53.073815 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-32c864c4-f6e1-4e77-9c1c-e5be2312ddda None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:53.075087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-32c864c4-f6e1-4e77-9c1c-e5be2312ddda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:53.083170 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1006/2002] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:53:53.085889 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e55ac-5456-4f97-a507-f25813aa9333 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:53.087110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c864c4-f6e1-4e77-9c1c-e5be2312ddda None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:53.097221 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c864c4-f6e1-4e77-9c1c-e5be2312ddda None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:53.101901 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe172e29-0639-44da-98b7-c1bac4fa842b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:53.102577 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe172e29-0639-44da-98b7-c1bac4fa842b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:53.102933 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe172e29-0639-44da-98b7-c1bac4fa842b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:53.103331 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe172e29-0639-44da-98b7-c1bac4fa842b admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:53.104108 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe172e29-0639-44da-98b7-c1bac4fa842b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:53:53.104407 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe172e29-0639-44da-98b7-c1bac4fa842b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:53.130517 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe172e29-0639-44da-98b7-c1bac4fa842b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:53.144351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1007/2003] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:53:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:53:53.148686 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe172e29-0639-44da-98b7-c1bac4fa842b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:53.158017 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe172e29-0639-44da-98b7-c1bac4fa842b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:53.162314 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cd2fd-ef45-473d-b871-241b6a33c52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:53.162931 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cd2fd-ef45-473d-b871-241b6a33c52f admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:53.163275 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cd2fd-ef45-473d-b871-241b6a33c52f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:53.163557 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cd2fd-ef45-473d-b871-241b6a33c52f admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:53.164182 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cd2fd-ef45-473d-b871-241b6a33c52f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:53.190760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cd2fd-ef45-473d-b871-241b6a33c52f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:53.205714 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 997/2004] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:52 2021] POST /identity/v3/users => generated 307 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:53.211480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e55ac-5456-4f97-a507-f25813aa9333 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:53.221032 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e55ac-5456-4f97-a507-f25813aa9333 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:53.225258 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8bd42-eb02-4cc3-9941-8e4a61e45cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:53.225837 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8bd42-eb02-4cc3-9941-8e4a61e45cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:53.226121 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8bd42-eb02-4cc3-9941-8e4a61e45cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:53.226399 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8bd42-eb02-4cc3-9941-8e4a61e45cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:53.227079 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8bd42-eb02-4cc3-9941-8e4a61e45cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:53.252651 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8bd42-eb02-4cc3-9941-8e4a61e45cf8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:53.263516 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 998/2005] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:53 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:53:53.267659 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8bd42-eb02-4cc3-9941-8e4a61e45cf8 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:53.276943 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8bd42-eb02-4cc3-9941-8e4a61e45cf8 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:53.281476 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f27e1-8e22-4f22-a59c-b439169a35b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:53.282262 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f27e1-8e22-4f22-a59c-b439169a35b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:53.282547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f27e1-8e22-4f22-a59c-b439169a35b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:53.282847 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f27e1-8e22-4f22-a59c-b439169a35b7 admin admin] PATH_INFO: `/v3/projects/93dc715d9f2b46478e7169dc3865dd6a/users/71ba0e68ca2b498ebd80cd28ff1f33ee/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:53.303222 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f27e1-8e22-4f22-a59c-b439169a35b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93dc715d9f2b46478e7169dc3865dd6a, user_id=71ba0e68ca2b498ebd80cd28ff1f33ee, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:53.307143 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1008/2006] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:53:53 2021] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:53.308699 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cd2fd-ef45-473d-b871-241b6a33c52f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:53.331777 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f27e1-8e22-4f22-a59c-b439169a35b7 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:53.380933 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cd2fd-ef45-473d-b871-241b6a33c52f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:53.387339 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab70433-0cd4-4331-a83e-c4b831654615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:53.387993 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab70433-0cd4-4331-a83e-c4b831654615 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:53.388337 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab70433-0cd4-4331-a83e-c4b831654615 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:53.388655 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab70433-0cd4-4331-a83e-c4b831654615 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:53.390147 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab70433-0cd4-4331-a83e-c4b831654615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:53.419642 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab70433-0cd4-4331-a83e-c4b831654615 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:53.467519 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 999/2007] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:53 2021] PUT /identity/v3/projects/93dc715d9f2b46478e7169dc3865dd6a/users/71ba0e68ca2b498ebd80cd28ff1f33ee/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:53.471386 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f27e1-8e22-4f22-a59c-b439169a35b7 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:53.538496 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f27e1-8e22-4f22-a59c-b439169a35b7 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:53.542752 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65135a23-71b4-40a0-8b92-76cbd1992bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:53.543336 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65135a23-71b4-40a0-8b92-76cbd1992bae admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:53.543621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65135a23-71b4-40a0-8b92-76cbd1992bae admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:53.543898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65135a23-71b4-40a0-8b92-76cbd1992bae admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:53.544596 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65135a23-71b4-40a0-8b92-76cbd1992bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:53.567953 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1009/2008] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:53:53 2021] POST /identity/v3/users => generated 283 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:53:53.569205 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab70433-0cd4-4331-a83e-c4b831654615 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:53.570779 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65135a23-71b4-40a0-8b92-76cbd1992bae admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:53.579053 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab70433-0cd4-4331-a83e-c4b831654615 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:53.584988 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1000/2009] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:53 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:53:53.585144 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fbe5b-e416-42a0-9115-c802866f1ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:53.585144 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fbe5b-e416-42a0-9115-c802866f1ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:53.585144 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fbe5b-e416-42a0-9115-c802866f1ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:53.585144 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fbe5b-e416-42a0-9115-c802866f1ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:53.585589 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fbe5b-e416-42a0-9115-c802866f1ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:53.585944 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65135a23-71b4-40a0-8b92-76cbd1992bae admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:53.595725 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65135a23-71b4-40a0-8b92-76cbd1992bae admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:53.605990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be1c87-7488-4dba-abe1-81415e4c2f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:53.605990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be1c87-7488-4dba-abe1-81415e4c2f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:53.605990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be1c87-7488-4dba-abe1-81415e4c2f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:53.605990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be1c87-7488-4dba-abe1-81415e4c2f57 admin admin] PATH_INFO: `/v3/projects/93dc715d9f2b46478e7169dc3865dd6a/users/71ba0e68ca2b498ebd80cd28ff1f33ee/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:53.606345 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be1c87-7488-4dba-abe1-81415e4c2f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93dc715d9f2b46478e7169dc3865dd6a, user_id=71ba0e68ca2b498ebd80cd28ff1f33ee, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:53.611296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fbe5b-e416-42a0-9115-c802866f1ca8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:53.621853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1010/2010] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:53 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:53:53.625964 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fbe5b-e416-42a0-9115-c802866f1ca8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:53.631695 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be1c87-7488-4dba-abe1-81415e4c2f57 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:53.635634 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fbe5b-e416-42a0-9115-c802866f1ca8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:53.640507 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24f730-9ce1-4ffd-ba99-ed3dc0f553f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:53.641394 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24f730-9ce1-4ffd-ba99-ed3dc0f553f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:53.641760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24f730-9ce1-4ffd-ba99-ed3dc0f553f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:53.642105 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24f730-9ce1-4ffd-ba99-ed3dc0f553f4 admin admin] PATH_INFO: `/v3/projects/83cf8b685cc043d2ba9b9b9183d3a040/users/74acce49bc3842eaba64aebb49201219/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:53.643212 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1001/2011] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:53 2021] PUT /identity/v3/projects/93dc715d9f2b46478e7169dc3865dd6a/users/71ba0e68ca2b498ebd80cd28ff1f33ee/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:53.647236 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be1c87-7488-4dba-abe1-81415e4c2f57 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:53.664858 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24f730-9ce1-4ffd-ba99-ed3dc0f553f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cf8b685cc043d2ba9b9b9183d3a040, user_id=74acce49bc3842eaba64aebb49201219, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:53.691474 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24f730-9ce1-4ffd-ba99-ed3dc0f553f4 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:53.720236 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be1c87-7488-4dba-abe1-81415e4c2f57 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:53.725078 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7080eb5-933e-42d3-9f1f-8ab964f61599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:53.725765 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7080eb5-933e-42d3-9f1f-8ab964f61599 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:53.726083 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7080eb5-933e-42d3-9f1f-8ab964f61599 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:53.726445 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7080eb5-933e-42d3-9f1f-8ab964f61599 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:53.727239 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7080eb5-933e-42d3-9f1f-8ab964f61599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:53.753077 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7080eb5-933e-42d3-9f1f-8ab964f61599 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:53.763752 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1002/2012] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:53:53 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:53:53.767670 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7080eb5-933e-42d3-9f1f-8ab964f61599 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:53.776366 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7080eb5-933e-42d3-9f1f-8ab964f61599 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:53.781170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f7338-4ae0-4e03-9bb5-9dded12b2875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:53.781935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f7338-4ae0-4e03-9bb5-9dded12b2875 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:53.782218 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f7338-4ae0-4e03-9bb5-9dded12b2875 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:53.782494 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f7338-4ae0-4e03-9bb5-9dded12b2875 admin admin] PATH_INFO: `/v3/projects/93dc715d9f2b46478e7169dc3865dd6a/users/71ba0e68ca2b498ebd80cd28ff1f33ee/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:53.784175 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f7338-4ae0-4e03-9bb5-9dded12b2875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93dc715d9f2b46478e7169dc3865dd6a, user_id=71ba0e68ca2b498ebd80cd28ff1f33ee, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:53.811286 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f7338-4ae0-4e03-9bb5-9dded12b2875 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:53.814422 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1011/2013] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:53 2021] PUT /identity/v3/projects/83cf8b685cc043d2ba9b9b9183d3a040/users/74acce49bc3842eaba64aebb49201219/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:53.826151 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255af3d8-6cf2-46e3-ad97-a294194af56d None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:53.826438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255af3d8-6cf2-46e3-ad97-a294194af56d None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:53.826716 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255af3d8-6cf2-46e3-ad97-a294194af56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:53.861234 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-255af3d8-6cf2-46e3-ad97-a294194af56d None None] MFA Rules not processed for user `74acce49bc3842eaba64aebb49201219`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:53.862363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-255af3d8-6cf2-46e3-ad97-a294194af56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:53.916600 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1003/2014] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:53:53 2021] PUT /identity/v3/projects/93dc715d9f2b46478e7169dc3865dd6a/users/71ba0e68ca2b498ebd80cd28ff1f33ee/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:53:53.926696 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce10e8d-c725-4812-9349-e61ccd73d030 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:53.927112 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce10e8d-c725-4812-9349-e61ccd73d030 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:53.927742 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce10e8d-c725-4812-9349-e61ccd73d030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:53.941318 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1012/2015] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:53 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:53:53.953762 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255af3d8-6cf2-46e3-ad97-a294194af56d None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:53.955293 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-255af3d8-6cf2-46e3-ad97-a294194af56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:53.969591 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-9ce10e8d-c725-4812-9349-e61ccd73d030 None None] MFA Rules not processed for user `71ba0e68ca2b498ebd80cd28ff1f33ee`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:53.981491 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-9ce10e8d-c725-4812-9349-e61ccd73d030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:54.029329 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255af3d8-6cf2-46e3-ad97-a294194af56d None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:54.075948 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1004/2016] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:53 2021] POST /identity/v3/auth/tokens => generated 3775 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:53:54.085338 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce10e8d-c725-4812-9349-e61ccd73d030 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:54.086677 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-9ce10e8d-c725-4812-9349-e61ccd73d030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:54.104086 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a5cca-4335-4ee0-98f6-73f9c5395c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:54.104732 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a5cca-4335-4ee0-98f6-73f9c5395c94 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:54.105023 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a5cca-4335-4ee0-98f6-73f9c5395c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:54.105299 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a5cca-4335-4ee0-98f6-73f9c5395c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:54.151317 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce10e8d-c725-4812-9349-e61ccd73d030 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:54.155442 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75355b-6279-4296-92de-4b6d370f65d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:54.156089 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75355b-6279-4296-92de-4b6d370f65d6 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:54.156381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75355b-6279-4296-92de-4b6d370f65d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:54.156704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75355b-6279-4296-92de-4b6d370f65d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:54.166365 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75355b-6279-4296-92de-4b6d370f65d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:54.169100 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a5cca-4335-4ee0-98f6-73f9c5395c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:54.192047 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75355b-6279-4296-92de-4b6d370f65d6 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:54.194255 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a5cca-4335-4ee0-98f6-73f9c5395c94 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:54.203967 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1013/2018] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:53 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:54.204657 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1005/2018] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:54 2021] GET /identity/v3/auth/tokens => generated 3775 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:54.521823 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a5cca-4335-4ee0-98f6-73f9c5395c94 service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:54.530762 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a5cca-4335-4ee0-98f6-73f9c5395c94 service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:54.534109 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6868d-359a-497c-b811-0d14a88f6353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:54.540726 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6868d-359a-497c-b811-0d14a88f6353 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:54.540726 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6868d-359a-497c-b811-0d14a88f6353 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:54.540726 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6868d-359a-497c-b811-0d14a88f6353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:54.540726 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-13f6868d-359a-497c-b811-0d14a88f6353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:54.603462 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6868d-359a-497c-b811-0d14a88f6353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:54.628580 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6868d-359a-497c-b811-0d14a88f6353 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:54.638019 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1014/2019] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:54 2021] GET /identity/v3/auth/tokens => generated 3708 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:53:59.334803 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75355b-6279-4296-92de-4b6d370f65d6 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:59.338039 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1d75355b-6279-4296-92de-4b6d370f65d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:59.423138 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75355b-6279-4296-92de-4b6d370f65d6 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:53:59.428169 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb76a1-2130-455b-a81f-55aefcd7287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:53:59.429153 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb76a1-2130-455b-a81f-55aefcd7287a admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:59.429539 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb76a1-2130-455b-a81f-55aefcd7287a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:59.429840 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb76a1-2130-455b-a81f-55aefcd7287a admin admin] PATH_INFO: `/v3/users/11d6579f401a4ba7bb91bc7db1fdeae9` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:59.431501 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb76a1-2130-455b-a81f-55aefcd7287a admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d6579f401a4ba7bb91bc7db1fdeae9)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:53:59.457783 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb76a1-2130-455b-a81f-55aefcd7287a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:53:59.709140 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0deb76a1-2130-455b-a81f-55aefcd7287a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d6579f401a4ba7bb91bc7db1fdeae9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:59.821514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0deb76a1-2130-455b-a81f-55aefcd7287a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d6579f401a4ba7bb91bc7db1fdeae9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:59.822090 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0deb76a1-2130-455b-a81f-55aefcd7287a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d6579f401a4ba7bb91bc7db1fdeae9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:59.830739 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0deb76a1-2130-455b-a81f-55aefcd7287a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d6579f401a4ba7bb91bc7db1fdeae9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:59.831332 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0deb76a1-2130-455b-a81f-55aefcd7287a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d6579f401a4ba7bb91bc7db1fdeae9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:53:59.852513 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1006/2020] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:53:59 2021] DELETE /identity/v3/users/11d6579f401a4ba7bb91bc7db1fdeae9 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:53:59.856775 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58d536-f14b-4f65-9911-0e73ee3a5c9a None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:53:59.857252 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58d536-f14b-4f65-9911-0e73ee3a5c9a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:53:59.858401 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58d536-f14b-4f65-9911-0e73ee3a5c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:53:59.890433 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-9b58d536-f14b-4f65-9911-0e73ee3a5c9a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:53:59.891761 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-9b58d536-f14b-4f65-9911-0e73ee3a5c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:53:59.974679 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1015/2021] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:53:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:53:59.983759 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb76a1-2130-455b-a81f-55aefcd7287a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:53:59.985590 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-0deb76a1-2130-455b-a81f-55aefcd7287a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:00.061476 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb76a1-2130-455b-a81f-55aefcd7287a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:00.065729 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34452f0f-4979-42df-b6b8-1c47c410204c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:00.066514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34452f0f-4979-42df-b6b8-1c47c410204c service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:00.066807 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34452f0f-4979-42df-b6b8-1c47c410204c service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:00.067142 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34452f0f-4979-42df-b6b8-1c47c410204c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:00.076830 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34452f0f-4979-42df-b6b8-1c47c410204c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:00.104904 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34452f0f-4979-42df-b6b8-1c47c410204c service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:00.115313 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1007/2022] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:53:59 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:54:00.707435 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58d536-f14b-4f65-9911-0e73ee3a5c9a None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:00.710607 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-9b58d536-f14b-4f65-9911-0e73ee3a5c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:00.734951 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58d536-f14b-4f65-9911-0e73ee3a5c9a None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:00.739962 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f11245-2764-4054-8a8f-e882139941fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:00.741430 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f11245-2764-4054-8a8f-e882139941fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:00.742482 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f11245-2764-4054-8a8f-e882139941fc admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:00.742780 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f11245-2764-4054-8a8f-e882139941fc admin admin] PATH_INFO: `/v3/projects/1e3841f6616343dcbaec88b9c030cacc` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:00.744549 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f11245-2764-4054-8a8f-e882139941fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3841f6616343dcbaec88b9c030cacc)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:00.779025 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f11245-2764-4054-8a8f-e882139941fc admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:00.898289 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d3f11245-2764-4054-8a8f-e882139941fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3841f6616343dcbaec88b9c030cacc', 'request_id': 'req-d3f11245-2764-4054-8a8f-e882139941fc'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:00.903678 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d3f11245-2764-4054-8a8f-e882139941fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3841f6616343dcbaec88b9c030cacc', 'request_id': 'req-d3f11245-2764-4054-8a8f-e882139941fc'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:00.914874 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d3f11245-2764-4054-8a8f-e882139941fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3841f6616343dcbaec88b9c030cacc', 'request_id': 'req-d3f11245-2764-4054-8a8f-e882139941fc'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:01.005950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d3f11245-2764-4054-8a8f-e882139941fc admin admin] The token cache is being invalidate because project 1e3841f6616343dcbaec88b9c030cacc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:54:01.006692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d3f11245-2764-4054-8a8f-e882139941fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:01.007678 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d3f11245-2764-4054-8a8f-e882139941fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:01.009841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1016/2023] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:54:00 2021] DELETE /identity/v3/projects/1e3841f6616343dcbaec88b9c030cacc => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:01.014233 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34452f0f-4979-42df-b6b8-1c47c410204c service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:01.032697 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34452f0f-4979-42df-b6b8-1c47c410204c service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:01.113933 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4d459-f9ac-4002-91b4-c52c4b4658fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:01.114776 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d459-f9ac-4002-91b4-c52c4b4658fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:01.115145 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d459-f9ac-4002-91b4-c52c4b4658fe admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:01.116063 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4d459-f9ac-4002-91b4-c52c4b4658fe admin admin] PATH_INFO: `/v3/users/7819cb00f45f4a1db34e3015ca2fda8b` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:01.119761 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4d459-f9ac-4002-91b4-c52c4b4658fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7819cb00f45f4a1db34e3015ca2fda8b)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:01.160420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4d459-f9ac-4002-91b4-c52c4b4658fe admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:01.294766 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f11245-2764-4054-8a8f-e882139941fc admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:01.296129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-d3f11245-2764-4054-8a8f-e882139941fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:01.308352 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f11245-2764-4054-8a8f-e882139941fc admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:01.313364 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4e113-5c0f-4500-b993-0bafa8538541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:01.314393 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4e113-5c0f-4500-b993-0bafa8538541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:01.314490 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4e113-5c0f-4500-b993-0bafa8538541 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:01.314707 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4e113-5c0f-4500-b993-0bafa8538541 admin admin] PATH_INFO: `/v3/users/15e88fb1dff9474c8eac7537caf1029a` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:01.315812 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4e113-5c0f-4500-b993-0bafa8538541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e88fb1dff9474c8eac7537caf1029a)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:01.342091 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4e113-5c0f-4500-b993-0bafa8538541 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:01.428586 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-adb4d459-f9ac-4002-91b4-c52c4b4658fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7819cb00f45f4a1db34e3015ca2fda8b'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:01.535411 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-adb4d459-f9ac-4002-91b4-c52c4b4658fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7819cb00f45f4a1db34e3015ca2fda8b'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:01.536303 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-adb4d459-f9ac-4002-91b4-c52c4b4658fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7819cb00f45f4a1db34e3015ca2fda8b'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:01.544746 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-adb4d459-f9ac-4002-91b4-c52c4b4658fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7819cb00f45f4a1db34e3015ca2fda8b'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:01.544926 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-b0f4e113-5c0f-4500-b993-0bafa8538541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e88fb1dff9474c8eac7537caf1029a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:01.545365 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-adb4d459-f9ac-4002-91b4-c52c4b4658fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7819cb00f45f4a1db34e3015ca2fda8b'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:01.545814 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-b0f4e113-5c0f-4500-b993-0bafa8538541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e88fb1dff9474c8eac7537caf1029a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:01.563513 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1008/2024] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:54:01 2021] DELETE /identity/v3/users/7819cb00f45f4a1db34e3015ca2fda8b => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:01.564504 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4d459-f9ac-4002-91b4-c52c4b4658fe admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:01.565647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-adb4d459-f9ac-4002-91b4-c52c4b4658fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:01.632791 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-b0f4e113-5c0f-4500-b993-0bafa8538541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e88fb1dff9474c8eac7537caf1029a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:01.639831 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4d459-f9ac-4002-91b4-c52c4b4658fe admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:01.644852 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-b0f4e113-5c0f-4500-b993-0bafa8538541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e88fb1dff9474c8eac7537caf1029a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:01.645711 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9afa4b-184b-42bd-8713-97b447089a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:01.646211 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-b0f4e113-5c0f-4500-b993-0bafa8538541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e88fb1dff9474c8eac7537caf1029a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:01.646521 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9afa4b-184b-42bd-8713-97b447089a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:01.646803 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9afa4b-184b-42bd-8713-97b447089a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:01.647082 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9afa4b-184b-42bd-8713-97b447089a8e admin admin] PATH_INFO: `/v3/users/5e04d9763a554cc7bea1a8d30e690bd5` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:01.648247 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9afa4b-184b-42bd-8713-97b447089a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e04d9763a554cc7bea1a8d30e690bd5)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:01.672729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1017/2025] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:54:01 2021] DELETE /identity/v3/users/15e88fb1dff9474c8eac7537caf1029a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:54:01.674470 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60997a3-7118-4255-a7d9-e1296ccffd1b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:01.674733 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9afa4b-184b-42bd-8713-97b447089a8e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:01.675184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60997a3-7118-4255-a7d9-e1296ccffd1b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:01.675691 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60997a3-7118-4255-a7d9-e1296ccffd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:01.702060 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-b60997a3-7118-4255-a7d9-e1296ccffd1b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:01.703432 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-b60997a3-7118-4255-a7d9-e1296ccffd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:01.767317 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1018/2026] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:01.778034 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60997a3-7118-4255-a7d9-e1296ccffd1b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:01.781467 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-b60997a3-7118-4255-a7d9-e1296ccffd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:01.851765 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60997a3-7118-4255-a7d9-e1296ccffd1b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:01.859129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb255652-c35e-4e8e-9c88-7b05d88a3232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:01.859787 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb255652-c35e-4e8e-9c88-7b05d88a3232 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:01.860140 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb255652-c35e-4e8e-9c88-7b05d88a3232 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:01.860486 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb255652-c35e-4e8e-9c88-7b05d88a3232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:01.874388 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb255652-c35e-4e8e-9c88-7b05d88a3232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:01.897661 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb255652-c35e-4e8e-9c88-7b05d88a3232 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:01.907835 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1019/2027] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:54:01.914259 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-3b9afa4b-184b-42bd-8713-97b447089a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e04d9763a554cc7bea1a8d30e690bd5'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:01.998420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-3b9afa4b-184b-42bd-8713-97b447089a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e04d9763a554cc7bea1a8d30e690bd5'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:01.999019 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-3b9afa4b-184b-42bd-8713-97b447089a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e04d9763a554cc7bea1a8d30e690bd5'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:02.007401 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-3b9afa4b-184b-42bd-8713-97b447089a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e04d9763a554cc7bea1a8d30e690bd5'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:02.008057 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-3b9afa4b-184b-42bd-8713-97b447089a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e04d9763a554cc7bea1a8d30e690bd5'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:02.028221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1009/2028] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:54:01 2021] DELETE /identity/v3/users/5e04d9763a554cc7bea1a8d30e690bd5 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:02.250247 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb255652-c35e-4e8e-9c88-7b05d88a3232 service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:02.251721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-fb255652-c35e-4e8e-9c88-7b05d88a3232 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:02.272506 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb255652-c35e-4e8e-9c88-7b05d88a3232 service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:02.365958 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180431c-c3f3-4f8a-a57c-234f43a5a239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:02.366666 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180431c-c3f3-4f8a-a57c-234f43a5a239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:02.366969 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180431c-c3f3-4f8a-a57c-234f43a5a239 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:02.367223 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180431c-c3f3-4f8a-a57c-234f43a5a239 admin admin] PATH_INFO: `/v3/projects/8715d3def5ae4d9d92289cf3defe31f2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:02.368305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180431c-c3f3-4f8a-a57c-234f43a5a239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8715d3def5ae4d9d92289cf3defe31f2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:02.396106 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180431c-c3f3-4f8a-a57c-234f43a5a239 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:02.537819 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-3180431c-c3f3-4f8a-a57c-234f43a5a239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8715d3def5ae4d9d92289cf3defe31f2', 'request_id': 'req-3180431c-c3f3-4f8a-a57c-234f43a5a239'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:02.551663 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-3180431c-c3f3-4f8a-a57c-234f43a5a239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8715d3def5ae4d9d92289cf3defe31f2', 'request_id': 'req-3180431c-c3f3-4f8a-a57c-234f43a5a239'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:02.566181 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-3180431c-c3f3-4f8a-a57c-234f43a5a239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8715d3def5ae4d9d92289cf3defe31f2', 'request_id': 'req-3180431c-c3f3-4f8a-a57c-234f43a5a239'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:02.641008 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9afa4b-184b-42bd-8713-97b447089a8e admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:02.642443 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-3b9afa4b-184b-42bd-8713-97b447089a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:02.655423 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9afa4b-184b-42bd-8713-97b447089a8e admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:02.673044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-3180431c-c3f3-4f8a-a57c-234f43a5a239 admin admin] The token cache is being invalidate because project 8715d3def5ae4d9d92289cf3defe31f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:54:02.673334 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-3180431c-c3f3-4f8a-a57c-234f43a5a239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:02.674063 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-3180431c-c3f3-4f8a-a57c-234f43a5a239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:02.675547 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1020/2029] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:54:02 2021] DELETE /identity/v3/projects/8715d3def5ae4d9d92289cf3defe31f2 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:02.676358 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180431c-c3f3-4f8a-a57c-234f43a5a239 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:02.677816 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-3180431c-c3f3-4f8a-a57c-234f43a5a239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:02.723904 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab305a3b-b2ac-4167-a0f5-c676cb0e8a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:02.724947 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab305a3b-b2ac-4167-a0f5-c676cb0e8a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:02.725244 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab305a3b-b2ac-4167-a0f5-c676cb0e8a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:02.725524 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab305a3b-b2ac-4167-a0f5-c676cb0e8a74 admin admin] PATH_INFO: `/v3/projects/18a0c572c10649f8a59b1b1c68e5f92c` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:02.726611 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab305a3b-b2ac-4167-a0f5-c676cb0e8a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a0c572c10649f8a59b1b1c68e5f92c)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:02.747671 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180431c-c3f3-4f8a-a57c-234f43a5a239 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:02.751862 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4ffe7-2819-42c3-aeb5-02742c2bac4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:02.752688 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4ffe7-2819-42c3-aeb5-02742c2bac4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:02.752877 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab305a3b-b2ac-4167-a0f5-c676cb0e8a74 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:02.752972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4ffe7-2819-42c3-aeb5-02742c2bac4b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:02.753254 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4ffe7-2819-42c3-aeb5-02742c2bac4b admin admin] PATH_INFO: `/v3/users/9c27dc8fa7f64391a58232b29d4aae11` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:02.754347 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4ffe7-2819-42c3-aeb5-02742c2bac4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c27dc8fa7f64391a58232b29d4aae11)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:02.781684 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4ffe7-2819-42c3-aeb5-02742c2bac4b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:02.965413 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ab305a3b-b2ac-4167-a0f5-c676cb0e8a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a0c572c10649f8a59b1b1c68e5f92c', 'request_id': 'req-ab305a3b-b2ac-4167-a0f5-c676cb0e8a74'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:02.970362 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ab305a3b-b2ac-4167-a0f5-c676cb0e8a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a0c572c10649f8a59b1b1c68e5f92c', 'request_id': 'req-ab305a3b-b2ac-4167-a0f5-c676cb0e8a74'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:02.981776 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ab305a3b-b2ac-4167-a0f5-c676cb0e8a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a0c572c10649f8a59b1b1c68e5f92c', 'request_id': 'req-ab305a3b-b2ac-4167-a0f5-c676cb0e8a74'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.066367 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ab305a3b-b2ac-4167-a0f5-c676cb0e8a74 admin admin] The token cache is being invalidate because project 18a0c572c10649f8a59b1b1c68e5f92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:54:03.067038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ab305a3b-b2ac-4167-a0f5-c676cb0e8a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.067220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ab305a3b-b2ac-4167-a0f5-c676cb0e8a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.068655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1010/2030] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:54:02 2021] DELETE /identity/v3/projects/18a0c572c10649f8a59b1b1c68e5f92c => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:54:03.069409 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab305a3b-b2ac-4167-a0f5-c676cb0e8a74 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:03.070612 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-ab305a3b-b2ac-4167-a0f5-c676cb0e8a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:03.106286 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f8d4ffe7-2819-42c3-aeb5-02742c2bac4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c27dc8fa7f64391a58232b29d4aae11'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.109886 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f8d4ffe7-2819-42c3-aeb5-02742c2bac4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c27dc8fa7f64391a58232b29d4aae11'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.139086 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab305a3b-b2ac-4167-a0f5-c676cb0e8a74 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:03.143419 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b6a2e-8610-416b-8556-5175ace70c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:03.144264 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b6a2e-8610-416b-8556-5175ace70c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:03.144553 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b6a2e-8610-416b-8556-5175ace70c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:03.144865 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b6a2e-8610-416b-8556-5175ace70c69 admin admin] PATH_INFO: `/v3/projects/416847e4711d4c9f9a4baf68f89d10d3` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:03.145994 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b6a2e-8610-416b-8556-5175ace70c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=416847e4711d4c9f9a4baf68f89d10d3)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:03.173581 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b6a2e-8610-416b-8556-5175ace70c69 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:03.193381 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f8d4ffe7-2819-42c3-aeb5-02742c2bac4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c27dc8fa7f64391a58232b29d4aae11'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.202629 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f8d4ffe7-2819-42c3-aeb5-02742c2bac4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c27dc8fa7f64391a58232b29d4aae11'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.203527 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f8d4ffe7-2819-42c3-aeb5-02742c2bac4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c27dc8fa7f64391a58232b29d4aae11'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.224188 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1021/2031] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:54:02 2021] DELETE /identity/v3/users/9c27dc8fa7f64391a58232b29d4aae11 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:03.224188 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4ffe7-2819-42c3-aeb5-02742c2bac4b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:03.224188 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f8d4ffe7-2819-42c3-aeb5-02742c2bac4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:03.318862 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4ffe7-2819-42c3-aeb5-02742c2bac4b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:03.326674 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7f3b6a2e-8610-416b-8556-5175ace70c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '416847e4711d4c9f9a4baf68f89d10d3', 'request_id': 'req-7f3b6a2e-8610-416b-8556-5175ace70c69'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.332451 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7f3b6a2e-8610-416b-8556-5175ace70c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '416847e4711d4c9f9a4baf68f89d10d3', 'request_id': 'req-7f3b6a2e-8610-416b-8556-5175ace70c69'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.345054 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7f3b6a2e-8610-416b-8556-5175ace70c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '416847e4711d4c9f9a4baf68f89d10d3', 'request_id': 'req-7f3b6a2e-8610-416b-8556-5175ace70c69'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.384584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77348f30-5f6b-4cbf-859a-a6bcd8777891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:03.385460 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77348f30-5f6b-4cbf-859a-a6bcd8777891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:03.385746 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77348f30-5f6b-4cbf-859a-a6bcd8777891 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:03.386543 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77348f30-5f6b-4cbf-859a-a6bcd8777891 admin admin] PATH_INFO: `/v3/users/9972ff75d96f4b4e851d0b01c4fe38ca` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:03.387626 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77348f30-5f6b-4cbf-859a-a6bcd8777891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9972ff75d96f4b4e851d0b01c4fe38ca)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:03.413307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77348f30-5f6b-4cbf-859a-a6bcd8777891 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:03.465071 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7f3b6a2e-8610-416b-8556-5175ace70c69 admin admin] The token cache is being invalidate because project 416847e4711d4c9f9a4baf68f89d10d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:54:03.465362 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7f3b6a2e-8610-416b-8556-5175ace70c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.466012 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7f3b6a2e-8610-416b-8556-5175ace70c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.472078 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1011/2032] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:54:03 2021] DELETE /identity/v3/projects/416847e4711d4c9f9a4baf68f89d10d3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:03.472078 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b6a2e-8610-416b-8556-5175ace70c69 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:03.472078 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-7f3b6a2e-8610-416b-8556-5175ace70c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:03.482502 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b6a2e-8610-416b-8556-5175ace70c69 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:03.487046 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec100ba2-29a0-414d-877c-6696eea0f823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:03.487848 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec100ba2-29a0-414d-877c-6696eea0f823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:03.488142 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec100ba2-29a0-414d-877c-6696eea0f823 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:03.488429 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec100ba2-29a0-414d-877c-6696eea0f823 admin admin] PATH_INFO: `/v3/users/71ba0e68ca2b498ebd80cd28ff1f33ee` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:03.489558 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec100ba2-29a0-414d-877c-6696eea0f823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ba0e68ca2b498ebd80cd28ff1f33ee)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:03.516195 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec100ba2-29a0-414d-877c-6696eea0f823 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:03.690543 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-77348f30-5f6b-4cbf-859a-a6bcd8777891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9972ff75d96f4b4e851d0b01c4fe38ca'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.691227 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-77348f30-5f6b-4cbf-859a-a6bcd8777891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9972ff75d96f4b4e851d0b01c4fe38ca'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.754422 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ec100ba2-29a0-414d-877c-6696eea0f823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ba0e68ca2b498ebd80cd28ff1f33ee'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.768050 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-77348f30-5f6b-4cbf-859a-a6bcd8777891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9972ff75d96f4b4e851d0b01c4fe38ca'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.776392 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-77348f30-5f6b-4cbf-859a-a6bcd8777891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9972ff75d96f4b4e851d0b01c4fe38ca'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.777964 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-77348f30-5f6b-4cbf-859a-a6bcd8777891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9972ff75d96f4b4e851d0b01c4fe38ca'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.795076 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1022/2033] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:54:03 2021] DELETE /identity/v3/users/9972ff75d96f4b4e851d0b01c4fe38ca => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:03.796292 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcd61a-0e00-4299-b4d8-b610245d61f8 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:03.796611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcd61a-0e00-4299-b4d8-b610245d61f8 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:03.796898 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcd61a-0e00-4299-b4d8-b610245d61f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:03.819863 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-78dcd61a-0e00-4299-b4d8-b610245d61f8 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:03.821054 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-78dcd61a-0e00-4299-b4d8-b610245d61f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:03.861700 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ec100ba2-29a0-414d-877c-6696eea0f823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ba0e68ca2b498ebd80cd28ff1f33ee'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.862295 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ec100ba2-29a0-414d-877c-6696eea0f823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ba0e68ca2b498ebd80cd28ff1f33ee'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.871008 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ec100ba2-29a0-414d-877c-6696eea0f823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ba0e68ca2b498ebd80cd28ff1f33ee'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.871673 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-ec100ba2-29a0-414d-877c-6696eea0f823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ba0e68ca2b498ebd80cd28ff1f33ee'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:03.888242 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1023/2034] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:03.890041 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a2282-ecb7-4176-b46f-2386853ececc None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:03.890487 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a2282-ecb7-4176-b46f-2386853ececc None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:03.892773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a2282-ecb7-4176-b46f-2386853ececc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:03.913373 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1012/2035] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:54:03 2021] DELETE /identity/v3/users/71ba0e68ca2b498ebd80cd28ff1f33ee => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:03.918376 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec100ba2-29a0-414d-877c-6696eea0f823 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:03.922412 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-6c4a2282-ecb7-4176-b46f-2386853ececc None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:03.924063 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-6c4a2282-ecb7-4176-b46f-2386853ececc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:03.932602 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-ec100ba2-29a0-414d-877c-6696eea0f823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:04.009195 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1024/2036] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:04.018572 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03eed5-1523-48ef-9fd3-916e7fe4356b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:04.018876 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03eed5-1523-48ef-9fd3-916e7fe4356b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:04.019149 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03eed5-1523-48ef-9fd3-916e7fe4356b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:04.027562 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec100ba2-29a0-414d-877c-6696eea0f823 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:04.048044 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7467bad-3344-4bbc-9bc9-4ad54dc204e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:04.048205 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-cc03eed5-1523-48ef-9fd3-916e7fe4356b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:04.048205 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-cc03eed5-1523-48ef-9fd3-916e7fe4356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:04.048352 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7467bad-3344-4bbc-9bc9-4ad54dc204e3 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:04.048352 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7467bad-3344-4bbc-9bc9-4ad54dc204e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:04.048785 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7467bad-3344-4bbc-9bc9-4ad54dc204e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:04.059580 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1025/2037] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:04.060825 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03eed5-1523-48ef-9fd3-916e7fe4356b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:04.072168 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03eed5-1523-48ef-9fd3-916e7fe4356b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:04.077119 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7467bad-3344-4bbc-9bc9-4ad54dc204e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:04.078657 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317344e-fefd-4a8e-b94a-1bf25a960ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:04.079473 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317344e-fefd-4a8e-b94a-1bf25a960ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:04.080249 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317344e-fefd-4a8e-b94a-1bf25a960ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:04.080734 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317344e-fefd-4a8e-b94a-1bf25a960ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:04.085588 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317344e-fefd-4a8e-b94a-1bf25a960ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:54:04.085963 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317344e-fefd-4a8e-b94a-1bf25a960ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:04.118124 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317344e-fefd-4a8e-b94a-1bf25a960ac9 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:04.139648 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1026/2038] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:54:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:54:04.139791 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7467bad-3344-4bbc-9bc9-4ad54dc204e3 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:04.139889 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317344e-fefd-4a8e-b94a-1bf25a960ac9 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:04.150648 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317344e-fefd-4a8e-b94a-1bf25a960ac9 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:04.160152 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac02ba0-6c41-4ef4-a4b2-4f9e05805e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:04.160854 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac02ba0-6c41-4ef4-a4b2-4f9e05805e6c admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:04.161147 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac02ba0-6c41-4ef4-a4b2-4f9e05805e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:04.161431 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac02ba0-6c41-4ef4-a4b2-4f9e05805e6c admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:04.162114 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac02ba0-6c41-4ef4-a4b2-4f9e05805e6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:04.163848 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1013/2039] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:54:04.189730 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac02ba0-6c41-4ef4-a4b2-4f9e05805e6c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:04.326815 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1027/2040] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:54:04 2021] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:54:04.327017 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7467bad-3344-4bbc-9bc9-4ad54dc204e3 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:04.335677 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7467bad-3344-4bbc-9bc9-4ad54dc204e3 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:04.417917 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a644eb-188f-46e4-b97d-e8c2149f6d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:04.418671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a644eb-188f-46e4-b97d-e8c2149f6d7d admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:04.419006 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a644eb-188f-46e4-b97d-e8c2149f6d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:04.419297 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a644eb-188f-46e4-b97d-e8c2149f6d7d admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:04.421653 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a644eb-188f-46e4-b97d-e8c2149f6d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:04.450279 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a644eb-188f-46e4-b97d-e8c2149f6d7d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:04.545716 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1014/2041] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:54:04 2021] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:54:04.549735 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac02ba0-6c41-4ef4-a4b2-4f9e05805e6c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:04.559884 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac02ba0-6c41-4ef4-a4b2-4f9e05805e6c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:04.564195 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d9a51-ea25-458c-a651-fc1ac3f34e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:04.564815 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d9a51-ea25-458c-a651-fc1ac3f34e0f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:04.565109 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d9a51-ea25-458c-a651-fc1ac3f34e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:04.565502 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d9a51-ea25-458c-a651-fc1ac3f34e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:04.566081 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d9a51-ea25-458c-a651-fc1ac3f34e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:04.608943 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d9a51-ea25-458c-a651-fc1ac3f34e0f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:04.627650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1028/2042] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:54:04 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:54:04.628885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a644eb-188f-46e4-b97d-e8c2149f6d7d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:04.642664 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a644eb-188f-46e4-b97d-e8c2149f6d7d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:04.647722 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d9a51-ea25-458c-a651-fc1ac3f34e0f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:04.649455 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0b2d9a51-ea25-458c-a651-fc1ac3f34e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:04.653780 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d48995-053e-4f77-b26d-385db8de1818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:04.655950 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d48995-053e-4f77-b26d-385db8de1818 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:04.657555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d48995-053e-4f77-b26d-385db8de1818 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:04.657555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d48995-053e-4f77-b26d-385db8de1818 admin admin] PATH_INFO: `/v3/projects/a7d76269b9b84905a47232cf7b258150/users/627bb2f869634b91973d020f20d1f4b0/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:04.666422 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d9a51-ea25-458c-a651-fc1ac3f34e0f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:04.672172 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b37f9-8a5a-439e-b2e3-0c77ee15919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:04.673047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b37f9-8a5a-439e-b2e3-0c77ee15919b admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:04.673302 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b37f9-8a5a-439e-b2e3-0c77ee15919b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:04.673695 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b37f9-8a5a-439e-b2e3-0c77ee15919b admin admin] PATH_INFO: `/v3/projects/93dc715d9f2b46478e7169dc3865dd6a` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:04.674815 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b37f9-8a5a-439e-b2e3-0c77ee15919b admin admin] RBAC: Authorizing `identity:delete_project(project_id=93dc715d9f2b46478e7169dc3865dd6a)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:04.688650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d48995-053e-4f77-b26d-385db8de1818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7d76269b9b84905a47232cf7b258150, user_id=627bb2f869634b91973d020f20d1f4b0, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:04.703082 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b37f9-8a5a-439e-b2e3-0c77ee15919b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:04.723763 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d48995-053e-4f77-b26d-385db8de1818 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:04.821271 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1015/2043] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:54:04 2021] PUT /identity/v3/projects/a7d76269b9b84905a47232cf7b258150/users/627bb2f869634b91973d020f20d1f4b0/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:04.822135 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d48995-053e-4f77-b26d-385db8de1818 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:04.824866 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-56d48995-053e-4f77-b26d-385db8de1818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:04.847947 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-e23b37f9-8a5a-439e-b2e3-0c77ee15919b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93dc715d9f2b46478e7169dc3865dd6a', 'request_id': 'req-e23b37f9-8a5a-439e-b2e3-0c77ee15919b'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:04.855620 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-e23b37f9-8a5a-439e-b2e3-0c77ee15919b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93dc715d9f2b46478e7169dc3865dd6a', 'request_id': 'req-e23b37f9-8a5a-439e-b2e3-0c77ee15919b'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:04.873482 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-e23b37f9-8a5a-439e-b2e3-0c77ee15919b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93dc715d9f2b46478e7169dc3865dd6a', 'request_id': 'req-e23b37f9-8a5a-439e-b2e3-0c77ee15919b'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:04.907105 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d48995-053e-4f77-b26d-385db8de1818 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:04.983699 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3705d-529c-4385-9b0d-99c6d6e173d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:04.984499 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3705d-529c-4385-9b0d-99c6d6e173d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:04.984820 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3705d-529c-4385-9b0d-99c6d6e173d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:04.985105 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3705d-529c-4385-9b0d-99c6d6e173d9 admin admin] PATH_INFO: `/v3/projects/23f5b215115f444c9d5e29bead918e25` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:04.986184 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3705d-529c-4385-9b0d-99c6d6e173d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f5b215115f444c9d5e29bead918e25)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:04.999853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-e23b37f9-8a5a-439e-b2e3-0c77ee15919b admin admin] The token cache is being invalidate because project 93dc715d9f2b46478e7169dc3865dd6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:54:05.000159 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-e23b37f9-8a5a-439e-b2e3-0c77ee15919b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:05.000887 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-e23b37f9-8a5a-439e-b2e3-0c77ee15919b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:05.002721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1029/2044] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:54:04 2021] DELETE /identity/v3/projects/93dc715d9f2b46478e7169dc3865dd6a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:05.004082 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5abfa0-1295-40ee-bba5-d7824af915c7 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:05.004443 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5abfa0-1295-40ee-bba5-d7824af915c7 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:05.004811 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5abfa0-1295-40ee-bba5-d7824af915c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:05.016795 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3705d-529c-4385-9b0d-99c6d6e173d9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:05.026809 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-ec5abfa0-1295-40ee-bba5-d7824af915c7 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:05.028029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ec5abfa0-1295-40ee-bba5-d7824af915c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:05.034915 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1030/2045] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:05.035747 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5abfa0-1295-40ee-bba5-d7824af915c7 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:05.036950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ec5abfa0-1295-40ee-bba5-d7824af915c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:05.048537 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5abfa0-1295-40ee-bba5-d7824af915c7 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:05.052698 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229f7ae-f60b-441c-8f4e-2d101588df6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:05.053466 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229f7ae-f60b-441c-8f4e-2d101588df6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:05.053751 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229f7ae-f60b-441c-8f4e-2d101588df6c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:05.054035 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229f7ae-f60b-441c-8f4e-2d101588df6c admin admin] PATH_INFO: `/v3/projects/f723ea2b7fc74fa28f80482b43863998` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:05.055110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229f7ae-f60b-441c-8f4e-2d101588df6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f723ea2b7fc74fa28f80482b43863998)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:05.081730 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229f7ae-f60b-441c-8f4e-2d101588df6c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:05.127853 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-18b3705d-529c-4385-9b0d-99c6d6e173d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f5b215115f444c9d5e29bead918e25', 'request_id': 'req-18b3705d-529c-4385-9b0d-99c6d6e173d9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:05.132932 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-18b3705d-529c-4385-9b0d-99c6d6e173d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f5b215115f444c9d5e29bead918e25', 'request_id': 'req-18b3705d-529c-4385-9b0d-99c6d6e173d9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:05.144038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-18b3705d-529c-4385-9b0d-99c6d6e173d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f5b215115f444c9d5e29bead918e25', 'request_id': 'req-18b3705d-529c-4385-9b0d-99c6d6e173d9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:05.237917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-2229f7ae-f60b-441c-8f4e-2d101588df6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f723ea2b7fc74fa28f80482b43863998', 'request_id': 'req-2229f7ae-f60b-441c-8f4e-2d101588df6c'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:05.242990 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-2229f7ae-f60b-441c-8f4e-2d101588df6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f723ea2b7fc74fa28f80482b43863998', 'request_id': 'req-2229f7ae-f60b-441c-8f4e-2d101588df6c'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:05.253936 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-2229f7ae-f60b-441c-8f4e-2d101588df6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f723ea2b7fc74fa28f80482b43863998', 'request_id': 'req-2229f7ae-f60b-441c-8f4e-2d101588df6c'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:05.275988 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-18b3705d-529c-4385-9b0d-99c6d6e173d9 admin admin] The token cache is being invalidate because project 23f5b215115f444c9d5e29bead918e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:54:05.276329 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-18b3705d-529c-4385-9b0d-99c6d6e173d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:05.277455 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-18b3705d-529c-4385-9b0d-99c6d6e173d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:05.278896 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1016/2046] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:54:04 2021] DELETE /identity/v3/projects/23f5b215115f444c9d5e29bead918e25 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:05.280185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b343c-8138-4b2e-9296-55e537c38da8 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:05.280470 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b343c-8138-4b2e-9296-55e537c38da8 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:05.280855 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b343c-8138-4b2e-9296-55e537c38da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:05.305435 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-797b343c-8138-4b2e-9296-55e537c38da8 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:05.306820 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-797b343c-8138-4b2e-9296-55e537c38da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:05.373797 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1017/2047] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:05.374985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b343c-8138-4b2e-9296-55e537c38da8 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:05.376303 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-797b343c-8138-4b2e-9296-55e537c38da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:05.428772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-2229f7ae-f60b-441c-8f4e-2d101588df6c admin admin] The token cache is being invalidate because project f723ea2b7fc74fa28f80482b43863998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:54:05.429226 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-2229f7ae-f60b-441c-8f4e-2d101588df6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:05.430406 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-2229f7ae-f60b-441c-8f4e-2d101588df6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:05.437229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1031/2048] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:54:05 2021] DELETE /identity/v3/projects/f723ea2b7fc74fa28f80482b43863998 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:05.438690 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad58f54-e4f1-42f8-90fe-148465f6eb93 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:05.438987 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad58f54-e4f1-42f8-90fe-148465f6eb93 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:05.439274 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad58f54-e4f1-42f8-90fe-148465f6eb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:05.449147 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b343c-8138-4b2e-9296-55e537c38da8 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:05.452506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b49f5-cb87-4518-80c5-3bfd8a7c4060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:05.453303 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b49f5-cb87-4518-80c5-3bfd8a7c4060 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:05.453598 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b49f5-cb87-4518-80c5-3bfd8a7c4060 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:05.453935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b49f5-cb87-4518-80c5-3bfd8a7c4060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:05.455592 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-621b49f5-cb87-4518-80c5-3bfd8a7c4060 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:05.462507 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-1ad58f54-e4f1-42f8-90fe-148465f6eb93 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:05.463608 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1ad58f54-e4f1-42f8-90fe-148465f6eb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:05.467395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b49f5-cb87-4518-80c5-3bfd8a7c4060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:05.471725 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1032/2049] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:05.472727 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd93ea1-07e7-4222-ae60-eee33eecc4b7 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:05.473014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd93ea1-07e7-4222-ae60-eee33eecc4b7 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:05.473294 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd93ea1-07e7-4222-ae60-eee33eecc4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:05.493016 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b49f5-cb87-4518-80c5-3bfd8a7c4060 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:05.494675 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-abd93ea1-07e7-4222-ae60-eee33eecc4b7 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:05.495789 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-abd93ea1-07e7-4222-ae60-eee33eecc4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:05.502731 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1018/2050] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:54:05.503373 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b49f5-cb87-4518-80c5-3bfd8a7c4060 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:05.504760 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-621b49f5-cb87-4518-80c5-3bfd8a7c4060 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:05.504993 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1033/2051] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:05.506466 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842e34b-128c-4928-8a03-37be494e102e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:05.506905 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842e34b-128c-4928-8a03-37be494e102e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:05.507310 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842e34b-128c-4928-8a03-37be494e102e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:05.516186 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b49f5-cb87-4518-80c5-3bfd8a7c4060 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:05.520908 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c899b2-c689-4932-b396-0037547f4b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:05.521702 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c899b2-c689-4932-b396-0037547f4b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:05.521991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c899b2-c689-4932-b396-0037547f4b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:05.522269 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c899b2-c689-4932-b396-0037547f4b6b admin admin] PATH_INFO: `/v3/users/538e9ea069b74451bc4eb6f999657b95` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:05.523353 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c899b2-c689-4932-b396-0037547f4b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=538e9ea069b74451bc4eb6f999657b95)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:05.531492 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-d842e34b-128c-4928-8a03-37be494e102e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:05.532342 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-d842e34b-128c-4928-8a03-37be494e102e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:05.552590 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1034/2052] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:05.552590 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842e34b-128c-4928-8a03-37be494e102e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:05.552780 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c899b2-c689-4932-b396-0037547f4b6b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:05.552873 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842e34b-128c-4928-8a03-37be494e102e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:05.557189 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a853f2-264e-47c2-952d-f90a505c710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:05.557834 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a853f2-264e-47c2-952d-f90a505c710d admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:05.558186 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a853f2-264e-47c2-952d-f90a505c710d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:05.558526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a853f2-264e-47c2-952d-f90a505c710d admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:05.559257 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a853f2-264e-47c2-952d-f90a505c710d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:54:05.559863 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a853f2-264e-47c2-952d-f90a505c710d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:05.587618 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a853f2-264e-47c2-952d-f90a505c710d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:05.601296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1035/2053] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:54:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:54:05.602099 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a853f2-264e-47c2-952d-f90a505c710d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:05.611660 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a853f2-264e-47c2-952d-f90a505c710d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:05.615996 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef314db7-a2f2-43d9-9fc9-c6a522bb0cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:05.616572 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef314db7-a2f2-43d9-9fc9-c6a522bb0cbb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:05.616888 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef314db7-a2f2-43d9-9fc9-c6a522bb0cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:05.617165 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef314db7-a2f2-43d9-9fc9-c6a522bb0cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:05.617829 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef314db7-a2f2-43d9-9fc9-c6a522bb0cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:54:05.618123 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef314db7-a2f2-43d9-9fc9-c6a522bb0cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:05.643854 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef314db7-a2f2-43d9-9fc9-c6a522bb0cbb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:05.656325 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1036/2054] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:54:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:54:05.657108 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef314db7-a2f2-43d9-9fc9-c6a522bb0cbb admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:05.666671 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef314db7-a2f2-43d9-9fc9-c6a522bb0cbb admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:05.671509 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6dbf0-8448-467b-9117-47b025c2df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:05.672875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6dbf0-8448-467b-9117-47b025c2df27 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:05.672875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6dbf0-8448-467b-9117-47b025c2df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:05.672875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6dbf0-8448-467b-9117-47b025c2df27 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:05.673276 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6dbf0-8448-467b-9117-47b025c2df27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:05.699606 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6dbf0-8448-467b-9117-47b025c2df27 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:05.802160 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-70c899b2-c689-4932-b396-0037547f4b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '538e9ea069b74451bc4eb6f999657b95'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:05.829176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1037/2055] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:54:05 2021] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:54:05.829176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6dbf0-8448-467b-9117-47b025c2df27 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:05.893585 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6dbf0-8448-467b-9117-47b025c2df27 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:05.898008 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a2d0a-8f43-4958-9047-54732982e064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:05.899305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a2d0a-8f43-4958-9047-54732982e064 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:05.899305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a2d0a-8f43-4958-9047-54732982e064 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:05.899305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a2d0a-8f43-4958-9047-54732982e064 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:05.899897 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a2d0a-8f43-4958-9047-54732982e064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:05.926132 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-70c899b2-c689-4932-b396-0037547f4b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '538e9ea069b74451bc4eb6f999657b95'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:05.929842 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-70c899b2-c689-4932-b396-0037547f4b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '538e9ea069b74451bc4eb6f999657b95'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:05.935260 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a2d0a-8f43-4958-9047-54732982e064 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:05.945937 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-70c899b2-c689-4932-b396-0037547f4b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '538e9ea069b74451bc4eb6f999657b95'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:05.950167 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-70c899b2-c689-4932-b396-0037547f4b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '538e9ea069b74451bc4eb6f999657b95'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:05.982771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1019/2056] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:54:05 2021] DELETE /identity/v3/users/538e9ea069b74451bc4eb6f999657b95 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:05.983189 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c899b2-c689-4932-b396-0037547f4b6b admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:05.986591 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-70c899b2-c689-4932-b396-0037547f4b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:06.072906 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1038/2057] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:54:05 2021] POST /identity/v3/projects => generated 371 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:54:06.074191 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a2d0a-8f43-4958-9047-54732982e064 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:06.077853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-9a8a2d0a-8f43-4958-9047-54732982e064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:06.143233 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c899b2-c689-4932-b396-0037547f4b6b admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:06.225053 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a2d0a-8f43-4958-9047-54732982e064 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:06.229589 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92806774-9290-4daa-a830-7b2fa8897baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:06.230347 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92806774-9290-4daa-a830-7b2fa8897baf admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:06.230470 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92806774-9290-4daa-a830-7b2fa8897baf admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:06.230750 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92806774-9290-4daa-a830-7b2fa8897baf admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:06.231483 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92806774-9290-4daa-a830-7b2fa8897baf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:06.257189 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92806774-9290-4daa-a830-7b2fa8897baf admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:06.277785 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07282da8-e082-4395-859b-c54d774f63df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:06.278563 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07282da8-e082-4395-859b-c54d774f63df admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:06.278860 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07282da8-e082-4395-859b-c54d774f63df admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:06.279264 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07282da8-e082-4395-859b-c54d774f63df admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:06.280325 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07282da8-e082-4395-859b-c54d774f63df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:06.307530 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07282da8-e082-4395-859b-c54d774f63df admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:06.362555 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1039/2058] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:54:06 2021] POST /identity/v3/users => generated 286 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:54:06.366436 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92806774-9290-4daa-a830-7b2fa8897baf admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:06.377999 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92806774-9290-4daa-a830-7b2fa8897baf admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:06.401332 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184b44e-82ba-4794-9293-4216ebfab95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:06.402213 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184b44e-82ba-4794-9293-4216ebfab95f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:06.402680 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184b44e-82ba-4794-9293-4216ebfab95f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:06.403438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184b44e-82ba-4794-9293-4216ebfab95f admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:06.406076 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184b44e-82ba-4794-9293-4216ebfab95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:06.431642 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1020/2059] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:54:05 2021] POST /identity/v3/users => generated 289 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:54:06.433509 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07282da8-e082-4395-859b-c54d774f63df admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:06.439377 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184b44e-82ba-4794-9293-4216ebfab95f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:06.454374 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1040/2060] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:54:06 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:54:06.455545 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184b44e-82ba-4794-9293-4216ebfab95f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:06.460115 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07282da8-e082-4395-859b-c54d774f63df admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:06.467899 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184b44e-82ba-4794-9293-4216ebfab95f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:06.472605 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c2862-f8ce-4b5c-9b3c-2a963035ced0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:06.473500 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b142c-75c5-419d-a39e-a0985afb89f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:06.473607 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c2862-f8ce-4b5c-9b3c-2a963035ced0 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:06.473921 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c2862-f8ce-4b5c-9b3c-2a963035ced0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:06.474279 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c2862-f8ce-4b5c-9b3c-2a963035ced0 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:06.474586 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b142c-75c5-419d-a39e-a0985afb89f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:06.474880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b142c-75c5-419d-a39e-a0985afb89f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:06.475154 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b142c-75c5-419d-a39e-a0985afb89f0 admin admin] PATH_INFO: `/v3/projects/b957058c6f594acdb887b13f539aa696/users/84dec84ed5134c2397a21cb265ace7d0/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:06.477432 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c2862-f8ce-4b5c-9b3c-2a963035ced0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:06.502519 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b142c-75c5-419d-a39e-a0985afb89f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b957058c6f594acdb887b13f539aa696, user_id=84dec84ed5134c2397a21cb265ace7d0, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:06.532524 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b142c-75c5-419d-a39e-a0985afb89f0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:06.541788 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c2862-f8ce-4b5c-9b3c-2a963035ced0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:06.560920 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1021/2061] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:54:06 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:54:06.564835 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c2862-f8ce-4b5c-9b3c-2a963035ced0 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:06.579144 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c2862-f8ce-4b5c-9b3c-2a963035ced0 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:06.588144 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd6a6b-0a1c-4600-9abe-fb4722e03fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:06.589576 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd6a6b-0a1c-4600-9abe-fb4722e03fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:06.589884 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd6a6b-0a1c-4600-9abe-fb4722e03fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:06.590159 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd6a6b-0a1c-4600-9abe-fb4722e03fbf admin admin] PATH_INFO: `/v3/projects/93229c89e9ee4875b6128cb401f84d4e/users/dba3a36c5ac34084815f20542613f4c5/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:06.619106 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd6a6b-0a1c-4600-9abe-fb4722e03fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=93229c89e9ee4875b6128cb401f84d4e, user_id=dba3a36c5ac34084815f20542613f4c5, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:06.655654 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd6a6b-0a1c-4600-9abe-fb4722e03fbf admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:06.672039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1041/2062] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:54:06 2021] PUT /identity/v3/projects/b957058c6f594acdb887b13f539aa696/users/84dec84ed5134c2397a21cb265ace7d0/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:06.680473 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf981d15-dea0-49af-9209-cfbaafd98ca2 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:06.680918 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf981d15-dea0-49af-9209-cfbaafd98ca2 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:06.681272 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf981d15-dea0-49af-9209-cfbaafd98ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:06.706561 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-cf981d15-dea0-49af-9209-cfbaafd98ca2 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:06.707842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-cf981d15-dea0-49af-9209-cfbaafd98ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:06.801648 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1022/2063] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:54:06 2021] PUT /identity/v3/projects/93229c89e9ee4875b6128cb401f84d4e/users/dba3a36c5ac34084815f20542613f4c5/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:06.801648 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bfaa8-5fd8-4911-b75e-fd383f1c5b4a None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:06.801648 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bfaa8-5fd8-4911-b75e-fd383f1c5b4a None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:06.801648 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bfaa8-5fd8-4911-b75e-fd383f1c5b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:06.802664 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1042/2064] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:54:06.823164 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf981d15-dea0-49af-9209-cfbaafd98ca2 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:06.825619 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-cf981d15-dea0-49af-9209-cfbaafd98ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:06.978950 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-075bfaa8-5fd8-4911-b75e-fd383f1c5b4a None None] MFA Rules not processed for user `dba3a36c5ac34084815f20542613f4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:06.978950 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-075bfaa8-5fd8-4911-b75e-fd383f1c5b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:06.978950 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1023/2065] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:06 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:54:06.981799 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf981d15-dea0-49af-9209-cfbaafd98ca2 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:06.983082 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bfaa8-5fd8-4911-b75e-fd383f1c5b4a None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:06.983530 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-075bfaa8-5fd8-4911-b75e-fd383f1c5b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:07.047858 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f1a88-ef85-4081-95af-ab8a3d64ce5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:07.048479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f1a88-ef85-4081-95af-ab8a3d64ce5d service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:07.048806 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f1a88-ef85-4081-95af-ab8a3d64ce5d service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:07.049085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f1a88-ef85-4081-95af-ab8a3d64ce5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:07.071367 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bfaa8-5fd8-4911-b75e-fd383f1c5b4a None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:07.075671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd376f6-5240-408d-9d03-e0d3a5bb7600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:07.076464 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd376f6-5240-408d-9d03-e0d3a5bb7600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:07.076779 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd376f6-5240-408d-9d03-e0d3a5bb7600 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:07.077251 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd376f6-5240-408d-9d03-e0d3a5bb7600 admin admin] PATH_INFO: `/v3/projects/01037685517a409aab4939602944b07e` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:07.078339 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd376f6-5240-408d-9d03-e0d3a5bb7600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01037685517a409aab4939602944b07e)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:07.103964 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd376f6-5240-408d-9d03-e0d3a5bb7600 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:07.116236 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f1a88-ef85-4081-95af-ab8a3d64ce5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:07.142305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f1a88-ef85-4081-95af-ab8a3d64ce5d service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:07.152099 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1043/2066] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:54:07.156918 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f1a88-ef85-4081-95af-ab8a3d64ce5d service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:07.156918 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0e2f1a88-ef85-4081-95af-ab8a3d64ce5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:07.228826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f1a88-ef85-4081-95af-ab8a3d64ce5d service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:07.231526 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-8fd376f6-5240-408d-9d03-e0d3a5bb7600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01037685517a409aab4939602944b07e', 'request_id': 'req-8fd376f6-5240-408d-9d03-e0d3a5bb7600'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:07.237149 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-8fd376f6-5240-408d-9d03-e0d3a5bb7600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01037685517a409aab4939602944b07e', 'request_id': 'req-8fd376f6-5240-408d-9d03-e0d3a5bb7600'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:07.261504 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-8fd376f6-5240-408d-9d03-e0d3a5bb7600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01037685517a409aab4939602944b07e', 'request_id': 'req-8fd376f6-5240-408d-9d03-e0d3a5bb7600'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:07.302796 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bdb1e-4d05-4d18-923d-1c1fcdd0f5b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913cd471ba494382af7dda858b9010c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:07.303425 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bdb1e-4d05-4d18-923d-1c1fcdd0f5b7 service glance] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:07.303741 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bdb1e-4d05-4d18-923d-1c1fcdd0f5b7 service glance] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:07.303965 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bdb1e-4d05-4d18-923d-1c1fcdd0f5b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:07.363803 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-8fd376f6-5240-408d-9d03-e0d3a5bb7600 admin admin] The token cache is being invalidate because project 01037685517a409aab4939602944b07e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:54:07.364092 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-8fd376f6-5240-408d-9d03-e0d3a5bb7600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:07.364787 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-8fd376f6-5240-408d-9d03-e0d3a5bb7600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:07.366465 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1024/2067] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:54:06 2021] DELETE /identity/v3/projects/01037685517a409aab4939602944b07e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:07.372255 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c62093-6950-445a-9602-7e700a821172 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:07.372554 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c62093-6950-445a-9602-7e700a821172 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:07.372893 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c62093-6950-445a-9602-7e700a821172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:07.379437 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bdb1e-4d05-4d18-923d-1c1fcdd0f5b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:07.397838 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-49c62093-6950-445a-9602-7e700a821172 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:07.399010 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-49c62093-6950-445a-9602-7e700a821172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:07.417905 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bdb1e-4d05-4d18-923d-1c1fcdd0f5b7 service glance] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:07.430629 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1044/2068] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:07 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:54:07.470985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1025/2069] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:54:07.483980 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2505c-65a9-4af5-b0dd-eef0ca66d864 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:07.484264 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2505c-65a9-4af5-b0dd-eef0ca66d864 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:07.484464 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2505c-65a9-4af5-b0dd-eef0ca66d864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:07.513886 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-02e2505c-65a9-4af5-b0dd-eef0ca66d864 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:07.515389 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-02e2505c-65a9-4af5-b0dd-eef0ca66d864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:07.527874 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1045/2070] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:07.528996 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c62093-6950-445a-9602-7e700a821172 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:07.540027 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c62093-6950-445a-9602-7e700a821172 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:07.546846 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62881557-c188-4d6b-bef9-902e9a79bbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:07.547687 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62881557-c188-4d6b-bef9-902e9a79bbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:07.548098 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62881557-c188-4d6b-bef9-902e9a79bbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:07.548641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62881557-c188-4d6b-bef9-902e9a79bbc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:07.549604 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62881557-c188-4d6b-bef9-902e9a79bbc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:54:07.549817 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62881557-c188-4d6b-bef9-902e9a79bbc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:07.581757 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62881557-c188-4d6b-bef9-902e9a79bbc1 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:07.603498 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1026/2071] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:54:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:54:07.610415 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2505c-65a9-4af5-b0dd-eef0ca66d864 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:07.632460 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2505c-65a9-4af5-b0dd-eef0ca66d864 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:07.643212 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c0a33-ab39-47b7-95b9-8e10fd93346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:07.647027 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c0a33-ab39-47b7-95b9-8e10fd93346c admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:07.647027 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c0a33-ab39-47b7-95b9-8e10fd93346c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:07.647027 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c0a33-ab39-47b7-95b9-8e10fd93346c admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:07.647027 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c0a33-ab39-47b7-95b9-8e10fd93346c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:07.658082 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1a568-99c6-4bf5-91ca-70fe27c1f636 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:07.658377 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1a568-99c6-4bf5-91ca-70fe27c1f636 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:07.658662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1a568-99c6-4bf5-91ca-70fe27c1f636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:07.700902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c0a33-ab39-47b7-95b9-8e10fd93346c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:07.722721 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-98c1a568-99c6-4bf5-91ca-70fe27c1f636 None None] MFA Rules not processed for user `627bb2f869634b91973d020f20d1f4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:07.724301 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-98c1a568-99c6-4bf5-91ca-70fe27c1f636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:07.784492 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1046/2072] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:54:07 2021] POST /identity/v3/projects => generated 391 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:54:07.788751 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c0a33-ab39-47b7-95b9-8e10fd93346c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:07.847647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1027/2073] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:07 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:07.859035 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709483a-eef7-48af-9e86-f9c30e941ed7 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:07.859340 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709483a-eef7-48af-9e86-f9c30e941ed7 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:07.859756 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709483a-eef7-48af-9e86-f9c30e941ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:07.890557 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-a709483a-eef7-48af-9e86-f9c30e941ed7 None None] MFA Rules not processed for user `627bb2f869634b91973d020f20d1f4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:07.892873 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a709483a-eef7-48af-9e86-f9c30e941ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:07.915631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c0a33-ab39-47b7-95b9-8e10fd93346c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:07.920684 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8495d-66c7-4319-a91f-efd94c0bfbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:07.921293 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8495d-66c7-4319-a91f-efd94c0bfbd4 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:07.921586 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8495d-66c7-4319-a91f-efd94c0bfbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:07.921976 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8495d-66c7-4319-a91f-efd94c0bfbd4 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:07.922704 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8495d-66c7-4319-a91f-efd94c0bfbd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:07.949299 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8495d-66c7-4319-a91f-efd94c0bfbd4 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:07.976339 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1028/2074] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:07 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:08.100518 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1047/2075] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:54:07 2021] POST /identity/v3/users => generated 296 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:54:08.104321 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709483a-eef7-48af-9e86-f9c30e941ed7 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:08.116360 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709483a-eef7-48af-9e86-f9c30e941ed7 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:08.122315 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1533c-b91e-4463-84d5-beed2f2a6d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:08.123029 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1533c-b91e-4463-84d5-beed2f2a6d35 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:08.123597 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1533c-b91e-4463-84d5-beed2f2a6d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:08.123974 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1533c-b91e-4463-84d5-beed2f2a6d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:08.124807 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1533c-b91e-4463-84d5-beed2f2a6d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:08.154801 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1533c-b91e-4463-84d5-beed2f2a6d35 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:08.166927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1029/2076] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:54:08 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:54:08.171677 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8495d-66c7-4319-a91f-efd94c0bfbd4 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:08.181465 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8495d-66c7-4319-a91f-efd94c0bfbd4 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:08.186111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7bff8-ca8d-4af9-814c-043811e87b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:08.186924 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7bff8-ca8d-4af9-814c-043811e87b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:08.187214 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7bff8-ca8d-4af9-814c-043811e87b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:08.187495 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7bff8-ca8d-4af9-814c-043811e87b30 admin admin] PATH_INFO: `/v3/projects/e343c3b0e722488b836cd6592126a720/users/e547fce6ae4f4be5b936c2a0aebc6f8e/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:08.207444 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7bff8-ca8d-4af9-814c-043811e87b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e343c3b0e722488b836cd6592126a720, user_id=e547fce6ae4f4be5b936c2a0aebc6f8e, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:08.235307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7bff8-ca8d-4af9-814c-043811e87b30 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:08.342465 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1048/2077] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:54:08 2021] PUT /identity/v3/projects/e343c3b0e722488b836cd6592126a720/users/e547fce6ae4f4be5b936c2a0aebc6f8e/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:54:08.352471 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b4ff0-1f5d-474a-ae3c-d7b3413e8c08 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:08.352905 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b4ff0-1f5d-474a-ae3c-d7b3413e8c08 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:08.353205 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b4ff0-1f5d-474a-ae3c-d7b3413e8c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:08.450750 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-2d8b4ff0-1f5d-474a-ae3c-d7b3413e8c08 None None] MFA Rules not processed for user `e547fce6ae4f4be5b936c2a0aebc6f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:08.452572 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2d8b4ff0-1f5d-474a-ae3c-d7b3413e8c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:08.563042 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1030/2078] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:08 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:08.567305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7bff8-ca8d-4af9-814c-043811e87b30 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:08.641817 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7bff8-ca8d-4af9-814c-043811e87b30 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:08.646271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b74eb-01ec-43b2-9581-080a23304cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:08.646962 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b74eb-01ec-43b2-9581-080a23304cac admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:08.647338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b74eb-01ec-43b2-9581-080a23304cac admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:08.647703 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b74eb-01ec-43b2-9581-080a23304cac admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:08.648709 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b74eb-01ec-43b2-9581-080a23304cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:08.675336 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b74eb-01ec-43b2-9581-080a23304cac admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:08.780388 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ed198-8e6e-4898-b86f-4d441c9ed375 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:08.780926 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ed198-8e6e-4898-b86f-4d441c9ed375 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:08.781211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ed198-8e6e-4898-b86f-4d441c9ed375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:08.786021 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1049/2079] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:54:08 2021] POST /identity/v3/projects => generated 391 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:54:08.789841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b74eb-01ec-43b2-9581-080a23304cac admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:08.819781 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-351ed198-8e6e-4898-b86f-4d441c9ed375 None None] MFA Rules not processed for user `84dec84ed5134c2397a21cb265ace7d0`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:08.821742 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-351ed198-8e6e-4898-b86f-4d441c9ed375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:08.865365 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b74eb-01ec-43b2-9581-080a23304cac admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:08.869941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36b88c-9e50-4eed-9742-17fb7a60025c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:08.871171 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36b88c-9e50-4eed-9742-17fb7a60025c admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:08.871553 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36b88c-9e50-4eed-9742-17fb7a60025c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:08.871929 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36b88c-9e50-4eed-9742-17fb7a60025c admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:08.872697 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36b88c-9e50-4eed-9742-17fb7a60025c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:08.899772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36b88c-9e50-4eed-9742-17fb7a60025c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:08.908557 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1031/2080] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:08 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:54:08.909554 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ed198-8e6e-4898-b86f-4d441c9ed375 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:08.910804 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-351ed198-8e6e-4898-b86f-4d441c9ed375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:08.923261 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ed198-8e6e-4898-b86f-4d441c9ed375 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:08.927623 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d8d81-373e-4140-ad08-016797248ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:08.928291 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d8d81-373e-4140-ad08-016797248ade admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:08.928706 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d8d81-373e-4140-ad08-016797248ade admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:08.929058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d8d81-373e-4140-ad08-016797248ade admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:08.929759 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d8d81-373e-4140-ad08-016797248ade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:08.957093 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d8d81-373e-4140-ad08-016797248ade admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:09.021386 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1050/2081] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:54:08 2021] POST /identity/v3/users => generated 302 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:54:09.025348 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36b88c-9e50-4eed-9742-17fb7a60025c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:09.034452 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36b88c-9e50-4eed-9742-17fb7a60025c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:09.038890 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a33c1a-17e2-4c1c-83e2-19dbf599a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:09.039475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a33c1a-17e2-4c1c-83e2-19dbf599a411 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:09.039765 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a33c1a-17e2-4c1c-83e2-19dbf599a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:09.040048 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a33c1a-17e2-4c1c-83e2-19dbf599a411 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:09.040807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a33c1a-17e2-4c1c-83e2-19dbf599a411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:09.057247 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1032/2082] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:54:08 2021] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:54:09.063923 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d8d81-373e-4140-ad08-016797248ade admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:09.067635 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a33c1a-17e2-4c1c-83e2-19dbf599a411 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:09.079132 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1051/2083] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:54:09 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:54:09.083259 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a33c1a-17e2-4c1c-83e2-19dbf599a411 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:09.092648 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a33c1a-17e2-4c1c-83e2-19dbf599a411 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:09.144511 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d8d81-373e-4140-ad08-016797248ade admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:09.149168 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c7a66-a9ea-46e1-bf71-d5c28f1f9677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:09.149959 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c7a66-a9ea-46e1-bf71-d5c28f1f9677 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:09.150249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c7a66-a9ea-46e1-bf71-d5c28f1f9677 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:09.150530 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c7a66-a9ea-46e1-bf71-d5c28f1f9677 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:09.151184 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c7a66-a9ea-46e1-bf71-d5c28f1f9677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:09.177202 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c7a66-a9ea-46e1-bf71-d5c28f1f9677 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:09.239021 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfec9d-6a69-4f81-9634-40c2c00c6058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:09.239842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfec9d-6a69-4f81-9634-40c2c00c6058 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:09.240137 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfec9d-6a69-4f81-9634-40c2c00c6058 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:09.240408 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfec9d-6a69-4f81-9634-40c2c00c6058 admin admin] PATH_INFO: `/v3/projects/5ebd603b4e914193a15e423856e292d2/users/a028a44310e145568143f9b0f17d383f/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:09.259402 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfec9d-6a69-4f81-9634-40c2c00c6058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ebd603b4e914193a15e423856e292d2, user_id=a028a44310e145568143f9b0f17d383f, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:09.286326 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfec9d-6a69-4f81-9634-40c2c00c6058 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:09.314085 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1033/2084] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:54:09 2021] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:54:09.318108 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c7a66-a9ea-46e1-bf71-d5c28f1f9677 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:09.326968 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c7a66-a9ea-46e1-bf71-d5c28f1f9677 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:09.331424 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e709234-eb07-4e0b-bcf6-28c38fa04cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:09.331996 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e709234-eb07-4e0b-bcf6-28c38fa04cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:09.332313 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e709234-eb07-4e0b-bcf6-28c38fa04cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:09.332614 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e709234-eb07-4e0b-bcf6-28c38fa04cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:09.333324 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e709234-eb07-4e0b-bcf6-28c38fa04cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:09.359195 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e709234-eb07-4e0b-bcf6-28c38fa04cf4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:09.374343 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1034/2085] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:54:09 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:54:09.374343 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e709234-eb07-4e0b-bcf6-28c38fa04cf4 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:09.382694 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e709234-eb07-4e0b-bcf6-28c38fa04cf4 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:09.386907 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35df1a-3475-4fa9-aff1-d620611ce54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:09.387693 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35df1a-3475-4fa9-aff1-d620611ce54d admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:09.387985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35df1a-3475-4fa9-aff1-d620611ce54d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:09.388267 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35df1a-3475-4fa9-aff1-d620611ce54d admin admin] PATH_INFO: `/v3/projects/ff64b622be5f4cc5b4179045e7b73a41/users/b10ad48db81545968a8a6939dd0bd7e0/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:09.399809 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1052/2086] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:54:09 2021] PUT /identity/v3/projects/5ebd603b4e914193a15e423856e292d2/users/a028a44310e145568143f9b0f17d383f/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:54:09.403763 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfec9d-6a69-4f81-9634-40c2c00c6058 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:09.410174 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35df1a-3475-4fa9-aff1-d620611ce54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff64b622be5f4cc5b4179045e7b73a41, user_id=b10ad48db81545968a8a6939dd0bd7e0, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:09.435369 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35df1a-3475-4fa9-aff1-d620611ce54d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:09.475896 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfec9d-6a69-4f81-9634-40c2c00c6058 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:09.480848 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a119a2-cf52-4a31-b9fe-a92010021fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:09.481445 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a119a2-cf52-4a31-b9fe-a92010021fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:09.481729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a119a2-cf52-4a31-b9fe-a92010021fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:09.482008 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a119a2-cf52-4a31-b9fe-a92010021fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:09.483026 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a119a2-cf52-4a31-b9fe-a92010021fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:09.508969 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a119a2-cf52-4a31-b9fe-a92010021fb9 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:09.519255 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1053/2087] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:54:09 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:54:09.523165 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a119a2-cf52-4a31-b9fe-a92010021fb9 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:09.532175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a119a2-cf52-4a31-b9fe-a92010021fb9 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:09.535413 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1035/2088] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:54:09 2021] PUT /identity/v3/projects/ff64b622be5f4cc5b4179045e7b73a41/users/b10ad48db81545968a8a6939dd0bd7e0/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:54:09.539297 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35df1a-3475-4fa9-aff1-d620611ce54d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:09.595251 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdb360-76fb-4468-9481-786390df9f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:09.596193 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdb360-76fb-4468-9481-786390df9f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:09.596499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdb360-76fb-4468-9481-786390df9f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:09.596793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdb360-76fb-4468-9481-786390df9f70 admin admin] PATH_INFO: `/v3/projects/5ebd603b4e914193a15e423856e292d2/users/a028a44310e145568143f9b0f17d383f/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:09.598529 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdb360-76fb-4468-9481-786390df9f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ebd603b4e914193a15e423856e292d2, user_id=a028a44310e145568143f9b0f17d383f, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:09.608569 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35df1a-3475-4fa9-aff1-d620611ce54d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:09.612892 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de693a8-baf5-4080-b89b-e8ed79e420ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:09.613478 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de693a8-baf5-4080-b89b-e8ed79e420ea admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:09.613764 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de693a8-baf5-4080-b89b-e8ed79e420ea admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:09.614042 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de693a8-baf5-4080-b89b-e8ed79e420ea admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:09.614774 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de693a8-baf5-4080-b89b-e8ed79e420ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:09.625441 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdb360-76fb-4468-9481-786390df9f70 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:09.635251 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1054/2089] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:54:09 2021] PUT /identity/v3/projects/5ebd603b4e914193a15e423856e292d2/users/a028a44310e145568143f9b0f17d383f/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:54:09.639186 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdb360-76fb-4468-9481-786390df9f70 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:09.640208 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de693a8-baf5-4080-b89b-e8ed79e420ea admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:09.654062 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1036/2090] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:54:09 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:54:09.655153 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de693a8-baf5-4080-b89b-e8ed79e420ea admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:09.664175 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de693a8-baf5-4080-b89b-e8ed79e420ea admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:09.708213 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdb360-76fb-4468-9481-786390df9f70 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:09.712612 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458db01e-aff2-4253-b805-5d25024047f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:09.713279 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458db01e-aff2-4253-b805-5d25024047f1 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:09.714286 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458db01e-aff2-4253-b805-5d25024047f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:09.714467 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458db01e-aff2-4253-b805-5d25024047f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:09.715222 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458db01e-aff2-4253-b805-5d25024047f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:09.729060 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd5b0c-10d2-4b48-b6a7-584c4fffadd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:09.740886 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd5b0c-10d2-4b48-b6a7-584c4fffadd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:09.740886 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd5b0c-10d2-4b48-b6a7-584c4fffadd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:09.740886 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd5b0c-10d2-4b48-b6a7-584c4fffadd9 admin admin] PATH_INFO: `/v3/projects/ff64b622be5f4cc5b4179045e7b73a41/users/b10ad48db81545968a8a6939dd0bd7e0/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:09.740886 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd5b0c-10d2-4b48-b6a7-584c4fffadd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff64b622be5f4cc5b4179045e7b73a41, user_id=b10ad48db81545968a8a6939dd0bd7e0, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:09.741964 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458db01e-aff2-4253-b805-5d25024047f1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:09.753982 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1055/2091] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:54:09 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:54:09.757849 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458db01e-aff2-4253-b805-5d25024047f1 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:09.761704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd5b0c-10d2-4b48-b6a7-584c4fffadd9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:09.775084 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458db01e-aff2-4253-b805-5d25024047f1 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:09.778278 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1037/2092] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:54:09 2021] PUT /identity/v3/projects/ff64b622be5f4cc5b4179045e7b73a41/users/b10ad48db81545968a8a6939dd0bd7e0/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:09.779047 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd5b0c-10d2-4b48-b6a7-584c4fffadd9 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:09.782110 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-6ffd5b0c-10d2-4b48-b6a7-584c4fffadd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:09.846580 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092cc24-c45d-4dfe-8fbf-1b9ecdd11131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:09.847729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092cc24-c45d-4dfe-8fbf-1b9ecdd11131 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:09.848338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092cc24-c45d-4dfe-8fbf-1b9ecdd11131 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:09.848338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092cc24-c45d-4dfe-8fbf-1b9ecdd11131 admin admin] PATH_INFO: `/v3/projects/5ebd603b4e914193a15e423856e292d2/users/a028a44310e145568143f9b0f17d383f/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:09.850449 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092cc24-c45d-4dfe-8fbf-1b9ecdd11131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ebd603b4e914193a15e423856e292d2, user_id=a028a44310e145568143f9b0f17d383f, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:09.880910 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092cc24-c45d-4dfe-8fbf-1b9ecdd11131 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:09.883360 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd5b0c-10d2-4b48-b6a7-584c4fffadd9 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:09.889244 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89a652-f233-4203-bd65-58fd62b64944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:09.889895 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89a652-f233-4203-bd65-58fd62b64944 service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:09.890250 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89a652-f233-4203-bd65-58fd62b64944 service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:09.890597 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89a652-f233-4203-bd65-58fd62b64944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:09.959331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89a652-f233-4203-bd65-58fd62b64944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:09.985239 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89a652-f233-4203-bd65-58fd62b64944 service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:09.996796 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1038/2093] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:09 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:54:10.002089 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89a652-f233-4203-bd65-58fd62b64944 service nova] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:10.010900 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1056/2094] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:54:09 2021] PUT /identity/v3/projects/5ebd603b4e914193a15e423856e292d2/users/a028a44310e145568143f9b0f17d383f/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:10.013269 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db45c3-4fa6-487c-9a24-4db7beefb85a None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:10.013269 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db45c3-4fa6-487c-9a24-4db7beefb85a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:10.013774 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db45c3-4fa6-487c-9a24-4db7beefb85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:10.022869 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89a652-f233-4203-bd65-58fd62b64944 service nova] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:10.060705 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-21db45c3-4fa6-487c-9a24-4db7beefb85a None None] MFA Rules not processed for user `a028a44310e145568143f9b0f17d383f`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:10.062030 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-21db45c3-4fa6-487c-9a24-4db7beefb85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:10.163550 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1057/2095] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:10 2021] POST /identity/v3/auth/tokens => generated 3765 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:10.172873 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db45c3-4fa6-487c-9a24-4db7beefb85a None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:10.175338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-21db45c3-4fa6-487c-9a24-4db7beefb85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:10.208857 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88927590-bdcd-485b-866b-0f69526e16f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:10.212689 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88927590-bdcd-485b-866b-0f69526e16f6 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:10.212689 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88927590-bdcd-485b-866b-0f69526e16f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:10.212689 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88927590-bdcd-485b-866b-0f69526e16f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:10.212689 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88927590-bdcd-485b-866b-0f69526e16f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:10.244556 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88927590-bdcd-485b-866b-0f69526e16f6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:10.247112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db45c3-4fa6-487c-9a24-4db7beefb85a None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:10.250888 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824694f-a920-410a-846b-3b1de6960f85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:10.251522 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824694f-a920-410a-846b-3b1de6960f85 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:10.251885 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824694f-a920-410a-846b-3b1de6960f85 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:10.252241 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824694f-a920-410a-846b-3b1de6960f85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:10.263003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1039/2096] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:54:10 2021] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:54:10.263566 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824694f-a920-410a-846b-3b1de6960f85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:10.267585 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88927590-bdcd-485b-866b-0f69526e16f6 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:10.278313 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88927590-bdcd-485b-866b-0f69526e16f6 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:10.283515 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc83dbd-5e20-444f-8087-22599bb48358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:10.284419 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc83dbd-5e20-444f-8087-22599bb48358 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:10.287175 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc83dbd-5e20-444f-8087-22599bb48358 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:10.287175 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc83dbd-5e20-444f-8087-22599bb48358 admin admin] PATH_INFO: `/v3/projects/ff64b622be5f4cc5b4179045e7b73a41/users/b10ad48db81545968a8a6939dd0bd7e0/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:10.287175 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc83dbd-5e20-444f-8087-22599bb48358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff64b622be5f4cc5b4179045e7b73a41, user_id=b10ad48db81545968a8a6939dd0bd7e0, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:10.290646 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824694f-a920-410a-846b-3b1de6960f85 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:10.300589 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1058/2097] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:10 2021] GET /identity/v3/auth/tokens => generated 3765 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:54:10.319264 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc83dbd-5e20-444f-8087-22599bb48358 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:10.348587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824694f-a920-410a-846b-3b1de6960f85 service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:10.349896 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-b824694f-a920-410a-846b-3b1de6960f85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:10.360816 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824694f-a920-410a-846b-3b1de6960f85 service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:10.364390 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f5e58-c676-4b85-a8c7-fa01194c2d8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:10.364983 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f5e58-c676-4b85-a8c7-fa01194c2d8b service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:10.365271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f5e58-c676-4b85-a8c7-fa01194c2d8b service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:10.367521 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f5e58-c676-4b85-a8c7-fa01194c2d8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:10.395470 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1040/2098] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:54:10 2021] PUT /identity/v3/projects/ff64b622be5f4cc5b4179045e7b73a41/users/b10ad48db81545968a8a6939dd0bd7e0/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:54:10.442159 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f5e58-c676-4b85-a8c7-fa01194c2d8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:10.474256 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f5e58-c676-4b85-a8c7-fa01194c2d8b service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:10.486047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1059/2099] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:10 2021] GET /identity/v3/auth/tokens => generated 3698 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:54:11.978858 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2927f-0dee-46c9-bc8d-7985abdf98bf None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:11.982917 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2927f-0dee-46c9-bc8d-7985abdf98bf None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:11.982917 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2927f-0dee-46c9-bc8d-7985abdf98bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:12.030688 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-dff2927f-0dee-46c9-bc8d-7985abdf98bf None None] MFA Rules not processed for user `b10ad48db81545968a8a6939dd0bd7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:12.031898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-dff2927f-0dee-46c9-bc8d-7985abdf98bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:12.138412 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1041/2100] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:11 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:12.219233 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f5e58-c676-4b85-a8c7-fa01194c2d8b service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:12.227467 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f5e58-c676-4b85-a8c7-fa01194c2d8b service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:12.294770 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92033841-8388-4bb4-9a05-7d59f6a57a02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:12.295362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92033841-8388-4bb4-9a05-7d59f6a57a02 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:12.295650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92033841-8388-4bb4-9a05-7d59f6a57a02 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:12.295929 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92033841-8388-4bb4-9a05-7d59f6a57a02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:12.418932 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92033841-8388-4bb4-9a05-7d59f6a57a02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:12.445106 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92033841-8388-4bb4-9a05-7d59f6a57a02 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:12.455071 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1060/2101] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:12 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:54:14.507884 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2927f-0dee-46c9-bc8d-7985abdf98bf None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:14.520291 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2927f-0dee-46c9-bc8d-7985abdf98bf None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:14.524313 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cc6a4-e6f1-42ce-8a49-6bdc4393f4d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:14.525267 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cc6a4-e6f1-42ce-8a49-6bdc4393f4d9 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:14.525797 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cc6a4-e6f1-42ce-8a49-6bdc4393f4d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:14.526617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cc6a4-e6f1-42ce-8a49-6bdc4393f4d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:14.537546 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cc6a4-e6f1-42ce-8a49-6bdc4393f4d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:14.564273 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cc6a4-e6f1-42ce-8a49-6bdc4393f4d9 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:14.574978 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1042/2102] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:14 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:54:16.267650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92033841-8388-4bb4-9a05-7d59f6a57a02 service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:16.343581 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92033841-8388-4bb4-9a05-7d59f6a57a02 service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:16.347906 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a78b0-e09a-46f2-af26-7d65bfb6e2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:16.348905 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a78b0-e09a-46f2-af26-7d65bfb6e2b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:16.354252 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a78b0-e09a-46f2-af26-7d65bfb6e2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:16.354252 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a78b0-e09a-46f2-af26-7d65bfb6e2b7 admin admin] PATH_INFO: `/v3/users/e547fce6ae4f4be5b936c2a0aebc6f8e` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:16.354252 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a78b0-e09a-46f2-af26-7d65bfb6e2b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e547fce6ae4f4be5b936c2a0aebc6f8e)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:16.378056 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a78b0-e09a-46f2-af26-7d65bfb6e2b7 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:16.595067 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4f0a78b0-e09a-46f2-af26-7d65bfb6e2b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e547fce6ae4f4be5b936c2a0aebc6f8e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:16.595247 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4f0a78b0-e09a-46f2-af26-7d65bfb6e2b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e547fce6ae4f4be5b936c2a0aebc6f8e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:16.695524 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4f0a78b0-e09a-46f2-af26-7d65bfb6e2b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e547fce6ae4f4be5b936c2a0aebc6f8e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:16.706307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4f0a78b0-e09a-46f2-af26-7d65bfb6e2b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e547fce6ae4f4be5b936c2a0aebc6f8e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:16.707331 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4f0a78b0-e09a-46f2-af26-7d65bfb6e2b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e547fce6ae4f4be5b936c2a0aebc6f8e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:16.732267 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1061/2103] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:54:16 2021] DELETE /identity/v3/users/e547fce6ae4f4be5b936c2a0aebc6f8e => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:16.736308 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca8196-79aa-4a2d-b6bb-42d4130e0f27 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:16.736798 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca8196-79aa-4a2d-b6bb-42d4130e0f27 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:16.736908 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca8196-79aa-4a2d-b6bb-42d4130e0f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:16.760232 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-02ca8196-79aa-4a2d-b6bb-42d4130e0f27 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:16.762053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-02ca8196-79aa-4a2d-b6bb-42d4130e0f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:16.852206 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1043/2104] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:16.857272 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a78b0-e09a-46f2-af26-7d65bfb6e2b7 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:16.858720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-4f0a78b0-e09a-46f2-af26-7d65bfb6e2b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:16.942698 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a78b0-e09a-46f2-af26-7d65bfb6e2b7 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:16.948511 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8ff86-7f20-4931-83d1-76c4fff2f94e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:16.949208 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8ff86-7f20-4931-83d1-76c4fff2f94e service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:16.949492 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8ff86-7f20-4931-83d1-76c4fff2f94e service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:16.949765 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8ff86-7f20-4931-83d1-76c4fff2f94e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:16.959728 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8ff86-7f20-4931-83d1-76c4fff2f94e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:16.990396 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8ff86-7f20-4931-83d1-76c4fff2f94e service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:17.000975 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1062/2105] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:16 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:54:17.700669 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca8196-79aa-4a2d-b6bb-42d4130e0f27 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:17.702875 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-02ca8196-79aa-4a2d-b6bb-42d4130e0f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:17.726656 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca8196-79aa-4a2d-b6bb-42d4130e0f27 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:17.732355 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369df48-51ab-4a3a-9b81-d849076d8c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:17.733966 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369df48-51ab-4a3a-9b81-d849076d8c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:17.734627 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369df48-51ab-4a3a-9b81-d849076d8c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:17.734921 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369df48-51ab-4a3a-9b81-d849076d8c47 admin admin] PATH_INFO: `/v3/projects/e343c3b0e722488b836cd6592126a720` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:17.736288 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369df48-51ab-4a3a-9b81-d849076d8c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e343c3b0e722488b836cd6592126a720)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:17.768703 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369df48-51ab-4a3a-9b81-d849076d8c47 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:17.925272 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7369df48-51ab-4a3a-9b81-d849076d8c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e343c3b0e722488b836cd6592126a720', 'request_id': 'req-7369df48-51ab-4a3a-9b81-d849076d8c47'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:17.930312 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7369df48-51ab-4a3a-9b81-d849076d8c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e343c3b0e722488b836cd6592126a720', 'request_id': 'req-7369df48-51ab-4a3a-9b81-d849076d8c47'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:17.943152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7369df48-51ab-4a3a-9b81-d849076d8c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e343c3b0e722488b836cd6592126a720', 'request_id': 'req-7369df48-51ab-4a3a-9b81-d849076d8c47'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:18.035784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7369df48-51ab-4a3a-9b81-d849076d8c47 admin admin] The token cache is being invalidate because project e343c3b0e722488b836cd6592126a720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:54:18.036065 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7369df48-51ab-4a3a-9b81-d849076d8c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:18.036878 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7369df48-51ab-4a3a-9b81-d849076d8c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:18.038307 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1044/2106] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:54:17 2021] DELETE /identity/v3/projects/e343c3b0e722488b836cd6592126a720 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:18.042323 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8ff86-7f20-4931-83d1-76c4fff2f94e service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:18.051538 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8ff86-7f20-4931-83d1-76c4fff2f94e service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:18.121207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c91354-4139-4a1a-82b5-6150a9e0f753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:18.122764 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c91354-4139-4a1a-82b5-6150a9e0f753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:18.123160 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c91354-4139-4a1a-82b5-6150a9e0f753 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:18.123316 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c91354-4139-4a1a-82b5-6150a9e0f753 admin admin] PATH_INFO: `/v3/users/a028a44310e145568143f9b0f17d383f` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:18.124806 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c91354-4139-4a1a-82b5-6150a9e0f753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a028a44310e145568143f9b0f17d383f)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:18.152403 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c91354-4139-4a1a-82b5-6150a9e0f753 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:18.347913 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-15c91354-4139-4a1a-82b5-6150a9e0f753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a028a44310e145568143f9b0f17d383f'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:18.348551 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-15c91354-4139-4a1a-82b5-6150a9e0f753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a028a44310e145568143f9b0f17d383f'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:18.433279 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-15c91354-4139-4a1a-82b5-6150a9e0f753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a028a44310e145568143f9b0f17d383f'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:18.445988 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-15c91354-4139-4a1a-82b5-6150a9e0f753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a028a44310e145568143f9b0f17d383f'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:18.447423 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-15c91354-4139-4a1a-82b5-6150a9e0f753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a028a44310e145568143f9b0f17d383f'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:18.469195 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1063/2107] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:54:18 2021] DELETE /identity/v3/users/a028a44310e145568143f9b0f17d383f => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:18.986670 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369df48-51ab-4a3a-9b81-d849076d8c47 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:18.989520 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-7369df48-51ab-4a3a-9b81-d849076d8c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:19.017855 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369df48-51ab-4a3a-9b81-d849076d8c47 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:19.092329 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbc57e-0bf6-4fc1-834b-e9d93625fffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:19.093378 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbc57e-0bf6-4fc1-834b-e9d93625fffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:19.093542 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbc57e-0bf6-4fc1-834b-e9d93625fffa admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:19.094029 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbc57e-0bf6-4fc1-834b-e9d93625fffa admin admin] PATH_INFO: `/v3/projects/5ebd603b4e914193a15e423856e292d2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:19.095449 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cbc57e-0bf6-4fc1-834b-e9d93625fffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ebd603b4e914193a15e423856e292d2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:19.123022 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cbc57e-0bf6-4fc1-834b-e9d93625fffa admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:19.249505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-30cbc57e-0bf6-4fc1-834b-e9d93625fffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ebd603b4e914193a15e423856e292d2', 'request_id': 'req-30cbc57e-0bf6-4fc1-834b-e9d93625fffa'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:19.254530 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-30cbc57e-0bf6-4fc1-834b-e9d93625fffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ebd603b4e914193a15e423856e292d2', 'request_id': 'req-30cbc57e-0bf6-4fc1-834b-e9d93625fffa'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:19.274798 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-30cbc57e-0bf6-4fc1-834b-e9d93625fffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ebd603b4e914193a15e423856e292d2', 'request_id': 'req-30cbc57e-0bf6-4fc1-834b-e9d93625fffa'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:19.357811 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-30cbc57e-0bf6-4fc1-834b-e9d93625fffa admin admin] The token cache is being invalidate because project 5ebd603b4e914193a15e423856e292d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:54:19.358093 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-30cbc57e-0bf6-4fc1-834b-e9d93625fffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:19.358733 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-30cbc57e-0bf6-4fc1-834b-e9d93625fffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:19.360286 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1045/2108] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:54:18 2021] DELETE /identity/v3/projects/5ebd603b4e914193a15e423856e292d2 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:19.365849 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225b376-6cb4-43d0-bd67-72af18e20ea4 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:19.366416 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225b376-6cb4-43d0-bd67-72af18e20ea4 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:19.366416 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225b376-6cb4-43d0-bd67-72af18e20ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:19.389231 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-4225b376-6cb4-43d0-bd67-72af18e20ea4 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:19.390418 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-4225b376-6cb4-43d0-bd67-72af18e20ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:19.458459 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1064/2109] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:19.466136 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0866fb-9c5c-408e-9ebc-3b4e647ca185 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:19.466416 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0866fb-9c5c-408e-9ebc-3b4e647ca185 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:19.466695 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0866fb-9c5c-408e-9ebc-3b4e647ca185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:19.489243 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-fc0866fb-9c5c-408e-9ebc-3b4e647ca185 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:19.490414 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-fc0866fb-9c5c-408e-9ebc-3b4e647ca185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:19.498076 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1046/2110] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:19.502376 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225b376-6cb4-43d0-bd67-72af18e20ea4 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:19.512194 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225b376-6cb4-43d0-bd67-72af18e20ea4 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:19.516531 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea643861-80bf-4030-82ce-fd94e4fea197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:19.517173 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea643861-80bf-4030-82ce-fd94e4fea197 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:19.517463 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea643861-80bf-4030-82ce-fd94e4fea197 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:19.517759 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea643861-80bf-4030-82ce-fd94e4fea197 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:19.518437 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea643861-80bf-4030-82ce-fd94e4fea197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:54:19.518738 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea643861-80bf-4030-82ce-fd94e4fea197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:19.545142 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea643861-80bf-4030-82ce-fd94e4fea197 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:19.559693 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1065/2111] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:54:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:54:19.564689 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0866fb-9c5c-408e-9ebc-3b4e647ca185 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:19.575777 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0866fb-9c5c-408e-9ebc-3b4e647ca185 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:19.580839 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e278c1-ace1-48f7-adbc-2785ec556c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:19.581648 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e278c1-ace1-48f7-adbc-2785ec556c65 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:19.581961 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e278c1-ace1-48f7-adbc-2785ec556c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:19.582287 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e278c1-ace1-48f7-adbc-2785ec556c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:19.582884 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e278c1-ace1-48f7-adbc-2785ec556c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:19.609563 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e278c1-ace1-48f7-adbc-2785ec556c65 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:19.755560 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1047/2112] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:54:19 2021] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:54:19.759619 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea643861-80bf-4030-82ce-fd94e4fea197 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:19.769030 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea643861-80bf-4030-82ce-fd94e4fea197 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:19.842176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a092a-a0f5-4e98-970a-1ab1f5f9ca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:19.842790 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a092a-a0f5-4e98-970a-1ab1f5f9ca0b admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:19.843093 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a092a-a0f5-4e98-970a-1ab1f5f9ca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:19.843361 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a092a-a0f5-4e98-970a-1ab1f5f9ca0b admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:19.843995 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a092a-a0f5-4e98-970a-1ab1f5f9ca0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:19.872205 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a092a-a0f5-4e98-970a-1ab1f5f9ca0b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:19.975347 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1066/2113] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:54:19 2021] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:54:19.980252 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e278c1-ace1-48f7-adbc-2785ec556c65 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:19.990085 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e278c1-ace1-48f7-adbc-2785ec556c65 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:19.994873 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a0164-0d03-4776-96d9-d292c4ce7ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:19.996025 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a0164-0d03-4776-96d9-d292c4ce7ecd admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:19.996317 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a0164-0d03-4776-96d9-d292c4ce7ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:19.996629 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a0164-0d03-4776-96d9-d292c4ce7ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:19.997361 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a0164-0d03-4776-96d9-d292c4ce7ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:20.023079 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a0164-0d03-4776-96d9-d292c4ce7ecd admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:20.033583 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1048/2114] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:54:19 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:54:20.037776 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a092a-a0f5-4e98-970a-1ab1f5f9ca0b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:20.047753 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a092a-a0f5-4e98-970a-1ab1f5f9ca0b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:20.051975 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fa3b2-941a-4eda-8f7a-e1b846c21cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:20.052821 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fa3b2-941a-4eda-8f7a-e1b846c21cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:20.053106 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fa3b2-941a-4eda-8f7a-e1b846c21cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:20.053386 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fa3b2-941a-4eda-8f7a-e1b846c21cfe admin admin] PATH_INFO: `/v3/projects/e6d0b45b4ea840b2b9d5335b0b6d3a86/users/ff7728c6c13e453aa1c8ef6884aa9b67/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:20.074104 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fa3b2-941a-4eda-8f7a-e1b846c21cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d0b45b4ea840b2b9d5335b0b6d3a86, user_id=ff7728c6c13e453aa1c8ef6884aa9b67, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:20.100691 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fa3b2-941a-4eda-8f7a-e1b846c21cfe admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:20.225731 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1067/2115] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:54:20 2021] PUT /identity/v3/projects/e6d0b45b4ea840b2b9d5335b0b6d3a86/users/ff7728c6c13e453aa1c8ef6884aa9b67/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:54:20.236101 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99324f-e0a3-4b8b-8c15-adc45820ee9b None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:20.236380 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99324f-e0a3-4b8b-8c15-adc45820ee9b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:20.236697 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99324f-e0a3-4b8b-8c15-adc45820ee9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:20.327095 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-be99324f-e0a3-4b8b-8c15-adc45820ee9b None None] MFA Rules not processed for user `ff7728c6c13e453aa1c8ef6884aa9b67`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:20.328423 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-be99324f-e0a3-4b8b-8c15-adc45820ee9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:20.459322 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1049/2116] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:20 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:20.460801 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fa3b2-941a-4eda-8f7a-e1b846c21cfe admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:20.552981 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fa3b2-941a-4eda-8f7a-e1b846c21cfe admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:20.560080 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e7f2f-f843-4a01-903f-2c6f672e26f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:20.561047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e7f2f-f843-4a01-903f-2c6f672e26f1 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:20.561347 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e7f2f-f843-4a01-903f-2c6f672e26f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:20.561789 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e7f2f-f843-4a01-903f-2c6f672e26f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:20.562564 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e7f2f-f843-4a01-903f-2c6f672e26f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:20.589853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e7f2f-f843-4a01-903f-2c6f672e26f1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:20.725346 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1068/2117] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:54:20 2021] POST /identity/v3/projects => generated 385 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:54:20.733848 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99324f-e0a3-4b8b-8c15-adc45820ee9b None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:20.744028 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99324f-e0a3-4b8b-8c15-adc45820ee9b None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:20.815042 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0d303-1e7b-4013-a54b-15401c567e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:20.815848 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0d303-1e7b-4013-a54b-15401c567e97 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:20.816325 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0d303-1e7b-4013-a54b-15401c567e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:20.816667 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0d303-1e7b-4013-a54b-15401c567e97 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:20.817484 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0d303-1e7b-4013-a54b-15401c567e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:20.843393 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0d303-1e7b-4013-a54b-15401c567e97 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:20.953229 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1050/2118] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:54:20 2021] POST /identity/v3/users => generated 299 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:54:20.957102 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e7f2f-f843-4a01-903f-2c6f672e26f1 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:20.967321 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e7f2f-f843-4a01-903f-2c6f672e26f1 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:20.971422 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84e67c-ccdf-45a5-b38a-4189b9577366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:20.972003 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84e67c-ccdf-45a5-b38a-4189b9577366 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:20.972293 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84e67c-ccdf-45a5-b38a-4189b9577366 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:20.972581 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84e67c-ccdf-45a5-b38a-4189b9577366 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:20.973284 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84e67c-ccdf-45a5-b38a-4189b9577366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:20.999422 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84e67c-ccdf-45a5-b38a-4189b9577366 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:21.010507 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1069/2119] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:54:20 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:54:21.014660 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0d303-1e7b-4013-a54b-15401c567e97 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:21.024304 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0d303-1e7b-4013-a54b-15401c567e97 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:21.029052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dae710-42de-4eba-83d2-8a8b2c7c6fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:21.029849 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dae710-42de-4eba-83d2-8a8b2c7c6fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:21.030134 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dae710-42de-4eba-83d2-8a8b2c7c6fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:21.030415 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dae710-42de-4eba-83d2-8a8b2c7c6fc1 admin admin] PATH_INFO: `/v3/projects/6cf5b7f3e70d4bde8e245b2876f6f23e/users/c9824fd573a748578ccb1b136a82a0f6/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:21.052106 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dae710-42de-4eba-83d2-8a8b2c7c6fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf5b7f3e70d4bde8e245b2876f6f23e, user_id=c9824fd573a748578ccb1b136a82a0f6, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:21.081223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dae710-42de-4eba-83d2-8a8b2c7c6fc1 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:21.159594 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1051/2120] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:54:21 2021] PUT /identity/v3/projects/6cf5b7f3e70d4bde8e245b2876f6f23e/users/c9824fd573a748578ccb1b136a82a0f6/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:21.163484 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84e67c-ccdf-45a5-b38a-4189b9577366 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:21.175135 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84e67c-ccdf-45a5-b38a-4189b9577366 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:21.265888 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b9ff2-8a16-4c96-b408-8e711741f559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:21.266493 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b9ff2-8a16-4c96-b408-8e711741f559 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:21.266880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b9ff2-8a16-4c96-b408-8e711741f559 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:21.267257 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b9ff2-8a16-4c96-b408-8e711741f559 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:21.268035 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b9ff2-8a16-4c96-b408-8e711741f559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:21.294498 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b9ff2-8a16-4c96-b408-8e711741f559 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:21.305098 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1070/2121] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:54:21 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:54:21.309841 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dae710-42de-4eba-83d2-8a8b2c7c6fc1 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:21.319647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dae710-42de-4eba-83d2-8a8b2c7c6fc1 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:21.324411 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e5b94-d9a6-4fb7-b1a9-0cd693edfea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:21.327960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e5b94-d9a6-4fb7-b1a9-0cd693edfea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:21.327960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e5b94-d9a6-4fb7-b1a9-0cd693edfea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:21.327960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e5b94-d9a6-4fb7-b1a9-0cd693edfea8 admin admin] PATH_INFO: `/v3/projects/6cf5b7f3e70d4bde8e245b2876f6f23e/users/c9824fd573a748578ccb1b136a82a0f6/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:21.327960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e5b94-d9a6-4fb7-b1a9-0cd693edfea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf5b7f3e70d4bde8e245b2876f6f23e, user_id=c9824fd573a748578ccb1b136a82a0f6, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:21.357519 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e5b94-d9a6-4fb7-b1a9-0cd693edfea8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:21.366604 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1052/2122] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:54:21 2021] PUT /identity/v3/projects/6cf5b7f3e70d4bde8e245b2876f6f23e/users/c9824fd573a748578ccb1b136a82a0f6/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:54:21.371014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b9ff2-8a16-4c96-b408-8e711741f559 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:21.380734 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b9ff2-8a16-4c96-b408-8e711741f559 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:21.445160 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4842ca-1a71-4db7-9aed-336f3e39880b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:21.445762 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4842ca-1a71-4db7-9aed-336f3e39880b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:21.446046 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4842ca-1a71-4db7-9aed-336f3e39880b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:21.446324 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4842ca-1a71-4db7-9aed-336f3e39880b admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:21.447013 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4842ca-1a71-4db7-9aed-336f3e39880b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:21.474075 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4842ca-1a71-4db7-9aed-336f3e39880b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:21.488207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1071/2123] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:54:21 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:54:21.489478 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e5b94-d9a6-4fb7-b1a9-0cd693edfea8 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:21.502021 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e5b94-d9a6-4fb7-b1a9-0cd693edfea8 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:21.506608 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02520bd3-2c8f-4325-b159-3b4f6435ec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:21.507414 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02520bd3-2c8f-4325-b159-3b4f6435ec0f admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:21.507702 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02520bd3-2c8f-4325-b159-3b4f6435ec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:21.507984 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02520bd3-2c8f-4325-b159-3b4f6435ec0f admin admin] PATH_INFO: `/v3/projects/6cf5b7f3e70d4bde8e245b2876f6f23e/users/c9824fd573a748578ccb1b136a82a0f6/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:21.510080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02520bd3-2c8f-4325-b159-3b4f6435ec0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf5b7f3e70d4bde8e245b2876f6f23e, user_id=c9824fd573a748578ccb1b136a82a0f6, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:21.538401 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02520bd3-2c8f-4325-b159-3b4f6435ec0f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:21.607172 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1053/2124] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:54:21 2021] PUT /identity/v3/projects/6cf5b7f3e70d4bde8e245b2876f6f23e/users/c9824fd573a748578ccb1b136a82a0f6/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:21.621366 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07061201-59ca-4409-8bcc-ccb37b85f49c None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:21.621768 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07061201-59ca-4409-8bcc-ccb37b85f49c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:21.622066 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07061201-59ca-4409-8bcc-ccb37b85f49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:21.675664 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-07061201-59ca-4409-8bcc-ccb37b85f49c None None] MFA Rules not processed for user `c9824fd573a748578ccb1b136a82a0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:21.677081 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-07061201-59ca-4409-8bcc-ccb37b85f49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:21.842169 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1072/2125] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:21 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:21.852474 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02520bd3-2c8f-4325-b159-3b4f6435ec0f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:21.858133 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-02520bd3-2c8f-4325-b159-3b4f6435ec0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:21.934178 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02520bd3-2c8f-4325-b159-3b4f6435ec0f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:21.939288 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de0bb3-f3b5-44ac-9644-a5caf16f9796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:21.940664 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de0bb3-f3b5-44ac-9644-a5caf16f9796 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:21.941211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de0bb3-f3b5-44ac-9644-a5caf16f9796 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:21.941877 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de0bb3-f3b5-44ac-9644-a5caf16f9796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:22.043685 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de0bb3-f3b5-44ac-9644-a5caf16f9796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:22.073961 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de0bb3-f3b5-44ac-9644-a5caf16f9796 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:22.084500 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1054/2126] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:21 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:54:28.916857 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07061201-59ca-4409-8bcc-ccb37b85f49c None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:28.918585 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-07061201-59ca-4409-8bcc-ccb37b85f49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:28.929896 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07061201-59ca-4409-8bcc-ccb37b85f49c None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:28.933490 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b0cf8-4308-44b2-8762-fbdbae252b21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:28.934064 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b0cf8-4308-44b2-8762-fbdbae252b21 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:28.934608 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b0cf8-4308-44b2-8762-fbdbae252b21 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:28.934888 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b0cf8-4308-44b2-8762-fbdbae252b21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:28.944862 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b0cf8-4308-44b2-8762-fbdbae252b21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:28.972501 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b0cf8-4308-44b2-8762-fbdbae252b21 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:28.982537 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1073/2127] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:28 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:54:35.798116 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de0bb3-f3b5-44ac-9644-a5caf16f9796 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:35.799513 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d1de0bb3-f3b5-44ac-9644-a5caf16f9796 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:35.942374 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de0bb3-f3b5-44ac-9644-a5caf16f9796 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:35.946601 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcb1ee-caaa-4d24-9ca8-eab3208e0284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:35.948055 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcb1ee-caaa-4d24-9ca8-eab3208e0284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:35.948345 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcb1ee-caaa-4d24-9ca8-eab3208e0284 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:35.948663 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcb1ee-caaa-4d24-9ca8-eab3208e0284 admin admin] PATH_INFO: `/v3/users/84dec84ed5134c2397a21cb265ace7d0` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:35.949788 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcb1ee-caaa-4d24-9ca8-eab3208e0284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84dec84ed5134c2397a21cb265ace7d0)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:35.976192 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcb1ee-caaa-4d24-9ca8-eab3208e0284 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:36.197349 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b0cf8-4308-44b2-8762-fbdbae252b21 service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:36.211897 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6edcb1ee-caaa-4d24-9ca8-eab3208e0284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84dec84ed5134c2397a21cb265ace7d0'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:36.232475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b0cf8-4308-44b2-8762-fbdbae252b21 service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:36.236677 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926b3f9-0699-49c1-b5a1-16aa59112923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:36.237473 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926b3f9-0699-49c1-b5a1-16aa59112923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:36.237764 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926b3f9-0699-49c1-b5a1-16aa59112923 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:36.238047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926b3f9-0699-49c1-b5a1-16aa59112923 admin admin] PATH_INFO: `/v3/users/ff7728c6c13e453aa1c8ef6884aa9b67` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:36.239136 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926b3f9-0699-49c1-b5a1-16aa59112923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff7728c6c13e453aa1c8ef6884aa9b67)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:36.265331 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926b3f9-0699-49c1-b5a1-16aa59112923 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:36.375511 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6edcb1ee-caaa-4d24-9ca8-eab3208e0284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84dec84ed5134c2397a21cb265ace7d0'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:36.376109 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6edcb1ee-caaa-4d24-9ca8-eab3208e0284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84dec84ed5134c2397a21cb265ace7d0'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:36.384168 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6edcb1ee-caaa-4d24-9ca8-eab3208e0284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84dec84ed5134c2397a21cb265ace7d0'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:36.386301 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6edcb1ee-caaa-4d24-9ca8-eab3208e0284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84dec84ed5134c2397a21cb265ace7d0'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:36.403754 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1055/2128] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:54:35 2021] DELETE /identity/v3/users/84dec84ed5134c2397a21cb265ace7d0 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:36.639584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4926b3f9-0699-49c1-b5a1-16aa59112923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff7728c6c13e453aa1c8ef6884aa9b67'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:36.640452 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4926b3f9-0699-49c1-b5a1-16aa59112923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff7728c6c13e453aa1c8ef6884aa9b67'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:36.767745 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcb1ee-caaa-4d24-9ca8-eab3208e0284 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:36.769168 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-6edcb1ee-caaa-4d24-9ca8-eab3208e0284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:36.775606 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4926b3f9-0699-49c1-b5a1-16aa59112923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff7728c6c13e453aa1c8ef6884aa9b67'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:36.787190 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4926b3f9-0699-49c1-b5a1-16aa59112923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff7728c6c13e453aa1c8ef6884aa9b67'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:36.788043 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4926b3f9-0699-49c1-b5a1-16aa59112923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff7728c6c13e453aa1c8ef6884aa9b67'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:36.827087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1074/2129] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:54:36 2021] DELETE /identity/v3/users/ff7728c6c13e453aa1c8ef6884aa9b67 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:54:36.830927 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4981f67-031f-4760-b88f-199bfb17b96b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:36.831290 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4981f67-031f-4760-b88f-199bfb17b96b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:36.831648 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4981f67-031f-4760-b88f-199bfb17b96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:36.873263 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-b4981f67-031f-4760-b88f-199bfb17b96b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:36.874692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-b4981f67-031f-4760-b88f-199bfb17b96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:36.894489 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcb1ee-caaa-4d24-9ca8-eab3208e0284 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:36.952288 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1075/2130] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:36.962890 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4981f67-031f-4760-b88f-199bfb17b96b None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:36.964369 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-b4981f67-031f-4760-b88f-199bfb17b96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:36.967134 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a2c92-d261-4402-a51f-fdd9f488d762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:36.967937 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2c92-d261-4402-a51f-fdd9f488d762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:36.968230 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2c92-d261-4402-a51f-fdd9f488d762 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:36.968601 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2c92-d261-4402-a51f-fdd9f488d762 admin admin] PATH_INFO: `/v3/projects/b957058c6f594acdb887b13f539aa696` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:36.969767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a2c92-d261-4402-a51f-fdd9f488d762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b957058c6f594acdb887b13f539aa696)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:36.997588 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a2c92-d261-4402-a51f-fdd9f488d762 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:37.075130 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4981f67-031f-4760-b88f-199bfb17b96b None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:37.078553 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a62cef-4827-47d6-81c7-a8fdf2f73062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:37.079153 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a62cef-4827-47d6-81c7-a8fdf2f73062 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:37.079435 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a62cef-4827-47d6-81c7-a8fdf2f73062 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:37.079707 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a62cef-4827-47d6-81c7-a8fdf2f73062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:37.089031 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a62cef-4827-47d6-81c7-a8fdf2f73062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:37.113785 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a62cef-4827-47d6-81c7-a8fdf2f73062 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:37.123019 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1076/2131] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:54:37.124293 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e81858-c250-4cad-9a22-0d41d950dbf1 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:37.124616 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e81858-c250-4cad-9a22-0d41d950dbf1 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:37.124905 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e81858-c250-4cad-9a22-0d41d950dbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:37.149669 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-d5e81858-c250-4cad-9a22-0d41d950dbf1 None None] MFA Rules not processed for user `627bb2f869634b91973d020f20d1f4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:37.151545 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-d5e81858-c250-4cad-9a22-0d41d950dbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:37.156837 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-1e9a2c92-d261-4402-a51f-fdd9f488d762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b957058c6f594acdb887b13f539aa696', 'request_id': 'req-1e9a2c92-d261-4402-a51f-fdd9f488d762'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:37.162090 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-1e9a2c92-d261-4402-a51f-fdd9f488d762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b957058c6f594acdb887b13f539aa696', 'request_id': 'req-1e9a2c92-d261-4402-a51f-fdd9f488d762'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:37.175534 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-1e9a2c92-d261-4402-a51f-fdd9f488d762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b957058c6f594acdb887b13f539aa696', 'request_id': 'req-1e9a2c92-d261-4402-a51f-fdd9f488d762'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:37.230039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1077/2132] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:37 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:37.302635 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-1e9a2c92-d261-4402-a51f-fdd9f488d762 admin admin] The token cache is being invalidate because project b957058c6f594acdb887b13f539aa696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:54:37.302635 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-1e9a2c92-d261-4402-a51f-fdd9f488d762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:37.302635 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-1e9a2c92-d261-4402-a51f-fdd9f488d762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:37.303179 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1056/2133] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:54:36 2021] DELETE /identity/v3/projects/b957058c6f594acdb887b13f539aa696 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:54:37.307581 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e81858-c250-4cad-9a22-0d41d950dbf1 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:37.309240 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-d5e81858-c250-4cad-9a22-0d41d950dbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:37.381593 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e81858-c250-4cad-9a22-0d41d950dbf1 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:37.386207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9a42e-2be8-4a7a-bd61-1fdf915b10bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:37.387315 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9a42e-2be8-4a7a-bd61-1fdf915b10bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:37.387754 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9a42e-2be8-4a7a-bd61-1fdf915b10bc admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:37.388193 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9a42e-2be8-4a7a-bd61-1fdf915b10bc admin admin] PATH_INFO: `/v3/users/b10ad48db81545968a8a6939dd0bd7e0` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:37.389522 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9a42e-2be8-4a7a-bd61-1fdf915b10bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b10ad48db81545968a8a6939dd0bd7e0)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:37.417216 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9a42e-2be8-4a7a-bd61-1fdf915b10bc admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:37.796917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1bd9a42e-2be8-4a7a-bd61-1fdf915b10bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b10ad48db81545968a8a6939dd0bd7e0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:37.798018 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1bd9a42e-2be8-4a7a-bd61-1fdf915b10bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b10ad48db81545968a8a6939dd0bd7e0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:37.913087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1bd9a42e-2be8-4a7a-bd61-1fdf915b10bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b10ad48db81545968a8a6939dd0bd7e0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:37.922122 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1bd9a42e-2be8-4a7a-bd61-1fdf915b10bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b10ad48db81545968a8a6939dd0bd7e0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:37.922770 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1bd9a42e-2be8-4a7a-bd61-1fdf915b10bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b10ad48db81545968a8a6939dd0bd7e0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:37.949790 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1078/2134] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:54:37 2021] DELETE /identity/v3/users/b10ad48db81545968a8a6939dd0bd7e0 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:37.983104 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a2c92-d261-4402-a51f-fdd9f488d762 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:37.984947 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1e9a2c92-d261-4402-a51f-fdd9f488d762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:38.010125 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a2c92-d261-4402-a51f-fdd9f488d762 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:38.084695 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148af2dc-f67e-4a14-b8d6-b074948532c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:38.085565 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148af2dc-f67e-4a14-b8d6-b074948532c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:38.085906 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148af2dc-f67e-4a14-b8d6-b074948532c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:38.086362 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148af2dc-f67e-4a14-b8d6-b074948532c7 admin admin] PATH_INFO: `/v3/projects/e6d0b45b4ea840b2b9d5335b0b6d3a86` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:38.087481 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148af2dc-f67e-4a14-b8d6-b074948532c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6d0b45b4ea840b2b9d5335b0b6d3a86)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:38.117080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148af2dc-f67e-4a14-b8d6-b074948532c7 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:38.320157 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-148af2dc-f67e-4a14-b8d6-b074948532c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6d0b45b4ea840b2b9d5335b0b6d3a86', 'request_id': 'req-148af2dc-f67e-4a14-b8d6-b074948532c7'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:38.325753 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-148af2dc-f67e-4a14-b8d6-b074948532c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6d0b45b4ea840b2b9d5335b0b6d3a86', 'request_id': 'req-148af2dc-f67e-4a14-b8d6-b074948532c7'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:38.337227 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-148af2dc-f67e-4a14-b8d6-b074948532c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6d0b45b4ea840b2b9d5335b0b6d3a86', 'request_id': 'req-148af2dc-f67e-4a14-b8d6-b074948532c7'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:38.403958 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9a42e-2be8-4a7a-bd61-1fdf915b10bc admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:38.406029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1bd9a42e-2be8-4a7a-bd61-1fdf915b10bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:38.475784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-148af2dc-f67e-4a14-b8d6-b074948532c7 admin admin] The token cache is being invalidate because project e6d0b45b4ea840b2b9d5335b0b6d3a86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:54:38.477909 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-148af2dc-f67e-4a14-b8d6-b074948532c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:38.480140 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9a42e-2be8-4a7a-bd61-1fdf915b10bc admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:38.482333 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-148af2dc-f67e-4a14-b8d6-b074948532c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:38.491174 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1057/2135] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:54:37 2021] DELETE /identity/v3/projects/e6d0b45b4ea840b2b9d5335b0b6d3a86 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:38.496278 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148af2dc-f67e-4a14-b8d6-b074948532c7 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:38.498290 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-148af2dc-f67e-4a14-b8d6-b074948532c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:38.574822 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded199d-0a0b-4293-b59a-8037190466d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:38.575620 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded199d-0a0b-4293-b59a-8037190466d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:38.575909 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded199d-0a0b-4293-b59a-8037190466d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:38.576193 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded199d-0a0b-4293-b59a-8037190466d6 admin admin] PATH_INFO: `/v3/projects/ff64b622be5f4cc5b4179045e7b73a41` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:38.577291 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded199d-0a0b-4293-b59a-8037190466d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff64b622be5f4cc5b4179045e7b73a41)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:38.594951 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148af2dc-f67e-4a14-b8d6-b074948532c7 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:38.606858 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded199d-0a0b-4293-b59a-8037190466d6 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:38.609555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54e4e2-641e-4f77-ac81-2eecc4f41509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:38.610475 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54e4e2-641e-4f77-ac81-2eecc4f41509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:38.612111 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54e4e2-641e-4f77-ac81-2eecc4f41509 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:38.612498 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54e4e2-641e-4f77-ac81-2eecc4f41509 admin admin] PATH_INFO: `/v3/users/c9824fd573a748578ccb1b136a82a0f6` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:38.617216 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54e4e2-641e-4f77-ac81-2eecc4f41509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9824fd573a748578ccb1b136a82a0f6)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:38.651124 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54e4e2-641e-4f77-ac81-2eecc4f41509 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:38.718402 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0ded199d-0a0b-4293-b59a-8037190466d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff64b622be5f4cc5b4179045e7b73a41', 'request_id': 'req-0ded199d-0a0b-4293-b59a-8037190466d6'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:38.723247 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0ded199d-0a0b-4293-b59a-8037190466d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff64b622be5f4cc5b4179045e7b73a41', 'request_id': 'req-0ded199d-0a0b-4293-b59a-8037190466d6'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:38.735737 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0ded199d-0a0b-4293-b59a-8037190466d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff64b622be5f4cc5b4179045e7b73a41', 'request_id': 'req-0ded199d-0a0b-4293-b59a-8037190466d6'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:38.815434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0ded199d-0a0b-4293-b59a-8037190466d6 admin admin] The token cache is being invalidate because project ff64b622be5f4cc5b4179045e7b73a41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:54:38.816039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0ded199d-0a0b-4293-b59a-8037190466d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:38.816535 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0ded199d-0a0b-4293-b59a-8037190466d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:38.818793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1079/2136] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:54:38 2021] DELETE /identity/v3/projects/ff64b622be5f4cc5b4179045e7b73a41 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:38.824171 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bf561-3345-4c2d-80a2-13adba3cc7d9 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:38.824583 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bf561-3345-4c2d-80a2-13adba3cc7d9 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:38.824967 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bf561-3345-4c2d-80a2-13adba3cc7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:38.874862 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-2b0bf561-3345-4c2d-80a2-13adba3cc7d9 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:38.881631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-2b0bf561-3345-4c2d-80a2-13adba3cc7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:38.883568 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-cc54e4e2-641e-4f77-ac81-2eecc4f41509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9824fd573a748578ccb1b136a82a0f6'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:38.943270 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1080/2137] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:54:38.952189 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15693121-843d-4c5d-a802-908650059ace None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:38.952489 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15693121-843d-4c5d-a802-908650059ace None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:38.952909 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15693121-843d-4c5d-a802-908650059ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:38.975108 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-cc54e4e2-641e-4f77-ac81-2eecc4f41509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9824fd573a748578ccb1b136a82a0f6'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:38.979178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-15693121-843d-4c5d-a802-908650059ace None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:38.979407 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-cc54e4e2-641e-4f77-ac81-2eecc4f41509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9824fd573a748578ccb1b136a82a0f6'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:38.979493 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-15693121-843d-4c5d-a802-908650059ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:38.984493 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1081/2138] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:54:38.988501 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15693121-843d-4c5d-a802-908650059ace None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:38.991461 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-cc54e4e2-641e-4f77-ac81-2eecc4f41509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9824fd573a748578ccb1b136a82a0f6'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:38.993531 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-cc54e4e2-641e-4f77-ac81-2eecc4f41509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9824fd573a748578ccb1b136a82a0f6'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:38.999365 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15693121-843d-4c5d-a802-908650059ace None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:39.017141 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a1be7-d2fc-4587-acb5-72344e3efc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:39.023087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a1be7-d2fc-4587-acb5-72344e3efc90 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:39.023397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a1be7-d2fc-4587-acb5-72344e3efc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:39.023703 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a1be7-d2fc-4587-acb5-72344e3efc90 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:39.024413 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a1be7-d2fc-4587-acb5-72344e3efc90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:54:39.024742 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a1be7-d2fc-4587-acb5-72344e3efc90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:39.029443 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1058/2139] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:54:38 2021] DELETE /identity/v3/users/c9824fd573a748578ccb1b136a82a0f6 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:54:39.050365 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a1be7-d2fc-4587-acb5-72344e3efc90 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:39.064741 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1082/2140] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:54:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:54:39.069197 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54e4e2-641e-4f77-ac81-2eecc4f41509 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:39.152158 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54e4e2-641e-4f77-ac81-2eecc4f41509 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:39.158887 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07459e-4340-4995-b60d-6106b7ecff93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:39.159702 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07459e-4340-4995-b60d-6106b7ecff93 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:39.160151 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07459e-4340-4995-b60d-6106b7ecff93 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:39.160600 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07459e-4340-4995-b60d-6106b7ecff93 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:39.161397 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07459e-4340-4995-b60d-6106b7ecff93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:39.188631 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07459e-4340-4995-b60d-6106b7ecff93 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:39.386776 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1059/2141] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:54:39 2021] POST /identity/v3/projects => generated 361 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:54:39.390719 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a1be7-d2fc-4587-acb5-72344e3efc90 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:39.400903 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a1be7-d2fc-4587-acb5-72344e3efc90 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:39.465139 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e688ce-c3d5-4512-a27d-e012619e084a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:39.465758 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e688ce-c3d5-4512-a27d-e012619e084a admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:39.466071 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e688ce-c3d5-4512-a27d-e012619e084a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:39.466797 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e688ce-c3d5-4512-a27d-e012619e084a admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:39.467037 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e688ce-c3d5-4512-a27d-e012619e084a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:39.493333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e688ce-c3d5-4512-a27d-e012619e084a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:39.608082 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07459e-4340-4995-b60d-6106b7ecff93 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:39.609729 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-fa07459e-4340-4995-b60d-6106b7ecff93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:39.622467 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07459e-4340-4995-b60d-6106b7ecff93 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:39.629078 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1083/2142] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:54:39 2021] POST /identity/v3/users => generated 281 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:54:39.633690 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e688ce-c3d5-4512-a27d-e012619e084a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:39.644484 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e688ce-c3d5-4512-a27d-e012619e084a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:39.648009 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303083e4-7ce3-42aa-97d4-35e95131db6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:39.648979 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303083e4-7ce3-42aa-97d4-35e95131db6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:39.649366 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303083e4-7ce3-42aa-97d4-35e95131db6d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:39.649843 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303083e4-7ce3-42aa-97d4-35e95131db6d admin admin] PATH_INFO: `/v3/projects/6cf5b7f3e70d4bde8e245b2876f6f23e` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:39.650050 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7583647-683a-4e25-bc68-cff831000829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:39.651493 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7583647-683a-4e25-bc68-cff831000829 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:39.651830 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7583647-683a-4e25-bc68-cff831000829 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:39.652114 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7583647-683a-4e25-bc68-cff831000829 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:39.652292 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303083e4-7ce3-42aa-97d4-35e95131db6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf5b7f3e70d4bde8e245b2876f6f23e)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:39.652904 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7583647-683a-4e25-bc68-cff831000829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:39.686669 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303083e4-7ce3-42aa-97d4-35e95131db6d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:39.691112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7583647-683a-4e25-bc68-cff831000829 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:39.703402 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1084/2143] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:54:39 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:54:39.710710 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7583647-683a-4e25-bc68-cff831000829 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:39.725479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7583647-683a-4e25-bc68-cff831000829 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:39.730691 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a41e56-3381-46cf-ad75-76f2b12f47fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:39.731525 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a41e56-3381-46cf-ad75-76f2b12f47fc admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:39.731819 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a41e56-3381-46cf-ad75-76f2b12f47fc admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:39.732150 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a41e56-3381-46cf-ad75-76f2b12f47fc admin admin] PATH_INFO: `/v3/projects/caa9d2bd9422428cb4231dd60be6e04a/users/52cecfc8948e433ca5982168f37e5570/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:39.752311 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a41e56-3381-46cf-ad75-76f2b12f47fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa9d2bd9422428cb4231dd60be6e04a, user_id=52cecfc8948e433ca5982168f37e5570, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:39.779475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a41e56-3381-46cf-ad75-76f2b12f47fc admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:39.895985 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1085/2144] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:54:39 2021] PUT /identity/v3/projects/caa9d2bd9422428cb4231dd60be6e04a/users/52cecfc8948e433ca5982168f37e5570/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:54:39.905306 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-303083e4-7ce3-42aa-97d4-35e95131db6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf5b7f3e70d4bde8e245b2876f6f23e', 'request_id': 'req-303083e4-7ce3-42aa-97d4-35e95131db6d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:39.907126 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20ee4c-4ba8-4826-a3d0-83fad5c12f6c None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:39.907261 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20ee4c-4ba8-4826-a3d0-83fad5c12f6c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:39.907484 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20ee4c-4ba8-4826-a3d0-83fad5c12f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:39.910715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-303083e4-7ce3-42aa-97d4-35e95131db6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf5b7f3e70d4bde8e245b2876f6f23e', 'request_id': 'req-303083e4-7ce3-42aa-97d4-35e95131db6d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:39.923686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-303083e4-7ce3-42aa-97d4-35e95131db6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf5b7f3e70d4bde8e245b2876f6f23e', 'request_id': 'req-303083e4-7ce3-42aa-97d4-35e95131db6d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:39.963424 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-6e20ee4c-4ba8-4826-a3d0-83fad5c12f6c None None] MFA Rules not processed for user `52cecfc8948e433ca5982168f37e5570`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:39.964640 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-6e20ee4c-4ba8-4826-a3d0-83fad5c12f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:40.039253 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1086/2145] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:39 2021] POST /identity/v3/auth/tokens => generated 3668 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:54:40.052744 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-303083e4-7ce3-42aa-97d4-35e95131db6d admin admin] The token cache is being invalidate because project 6cf5b7f3e70d4bde8e245b2876f6f23e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:54:40.057561 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-303083e4-7ce3-42aa-97d4-35e95131db6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:40.057561 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-303083e4-7ce3-42aa-97d4-35e95131db6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:40.057561 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1060/2146] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:54:39 2021] DELETE /identity/v3/projects/6cf5b7f3e70d4bde8e245b2876f6f23e => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:40.063304 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240565c-9b9e-49a4-9963-9ea65569d0b7 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:40.063603 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240565c-9b9e-49a4-9963-9ea65569d0b7 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:40.063888 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240565c-9b9e-49a4-9963-9ea65569d0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:40.071152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80826efc-dfe8-4f4d-8050-17205383b295 None None] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:40.071542 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80826efc-dfe8-4f4d-8050-17205383b295 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:40.071943 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80826efc-dfe8-4f4d-8050-17205383b295 None None] PATH_INFO: `/` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:40.073821 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1061/2147] 10.222.0.20 () {54 vars in 962 bytes} [Mon Aug 23 01:54:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 01:54:40.078335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e349d19-df9f-45bb-96bb-f32ff34fcfa4 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:40.078713 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e349d19-df9f-45bb-96bb-f32ff34fcfa4 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:40.079000 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e349d19-df9f-45bb-96bb-f32ff34fcfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:40.086712 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-a240565c-9b9e-49a4-9963-9ea65569d0b7 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:40.087903 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-a240565c-9b9e-49a4-9963-9ea65569d0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:40.104733 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-1e349d19-df9f-45bb-96bb-f32ff34fcfa4 None None] MFA Rules not processed for user `43ec554d6a304e029ee4f244f4a18e24`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:40.105980 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1e349d19-df9f-45bb-96bb-f32ff34fcfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:40.158509 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1087/2148] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:40.163135 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1062/2149] 10.222.0.20 () {58 vars in 1060 bytes} [Mon Aug 23 01:54:40 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:54:40.167478 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a27552-8739-45cb-8043-58e83dd6cecd None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:40.167772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a27552-8739-45cb-8043-58e83dd6cecd None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:40.168052 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a27552-8739-45cb-8043-58e83dd6cecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:40.173097 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e349d19-df9f-45bb-96bb-f32ff34fcfa4 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:40.182797 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e349d19-df9f-45bb-96bb-f32ff34fcfa4 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:40.186664 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a61194-8eb1-4813-837c-602521993626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:40.187415 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a61194-8eb1-4813-837c-602521993626 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:40.187863 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a61194-8eb1-4813-837c-602521993626 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:40.188299 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a61194-8eb1-4813-837c-602521993626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:40.190291 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d6a61194-8eb1-4813-837c-602521993626 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:40.192071 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-10a27552-8739-45cb-8043-58e83dd6cecd None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:40.193208 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-10a27552-8739-45cb-8043-58e83dd6cecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:40.200951 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1088/2150] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:54:40.206375 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a61194-8eb1-4813-837c-602521993626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:40.206585 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a27552-8739-45cb-8043-58e83dd6cecd None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:40.215029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a27552-8739-45cb-8043-58e83dd6cecd None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:40.219469 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35f2b4-6e56-42c2-88ed-22f19163acdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:40.220051 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35f2b4-6e56-42c2-88ed-22f19163acdf admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:40.220336 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35f2b4-6e56-42c2-88ed-22f19163acdf admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:40.220643 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35f2b4-6e56-42c2-88ed-22f19163acdf admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:40.221322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35f2b4-6e56-42c2-88ed-22f19163acdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:54:40.221616 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35f2b4-6e56-42c2-88ed-22f19163acdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:40.232860 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a61194-8eb1-4813-837c-602521993626 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:40.242781 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1063/2151] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:40 2021] GET /identity/v3/auth/tokens => generated 3668 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:54:40.248519 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35f2b4-6e56-42c2-88ed-22f19163acdf admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:40.261981 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1089/2152] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:54:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:54:40.266592 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a61194-8eb1-4813-837c-602521993626 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:40.278248 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a61194-8eb1-4813-837c-602521993626 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:40.283526 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88bb3a-9ac6-4ac6-89b8-c8ece6254dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:40.284525 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88bb3a-9ac6-4ac6-89b8-c8ece6254dda admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:40.284944 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88bb3a-9ac6-4ac6-89b8-c8ece6254dda admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:40.285566 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88bb3a-9ac6-4ac6-89b8-c8ece6254dda admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:40.286423 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88bb3a-9ac6-4ac6-89b8-c8ece6254dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:40.319152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88bb3a-9ac6-4ac6-89b8-c8ece6254dda admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:40.479409 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35f2b4-6e56-42c2-88ed-22f19163acdf admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:40.484272 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1064/2153] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:54:40 2021] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:54:40.487331 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35f2b4-6e56-42c2-88ed-22f19163acdf admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:40.529987 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88bb3a-9ac6-4ac6-89b8-c8ece6254dda admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:40.531651 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-6a88bb3a-9ac6-4ac6-89b8-c8ece6254dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:40.557805 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082adcb4-0ae8-4e76-a0c1-8a2f813c22bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:40.558524 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082adcb4-0ae8-4e76-a0c1-8a2f813c22bc admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:40.558875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082adcb4-0ae8-4e76-a0c1-8a2f813c22bc admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:40.559595 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082adcb4-0ae8-4e76-a0c1-8a2f813c22bc admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:40.560448 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082adcb4-0ae8-4e76-a0c1-8a2f813c22bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:40.593908 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082adcb4-0ae8-4e76-a0c1-8a2f813c22bc admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:40.614011 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88bb3a-9ac6-4ac6-89b8-c8ece6254dda admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:40.618419 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44474c87-0915-4ab2-831d-b3c62f04b192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:40.622491 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44474c87-0915-4ab2-831d-b3c62f04b192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:40.622491 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44474c87-0915-4ab2-831d-b3c62f04b192 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:40.622491 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44474c87-0915-4ab2-831d-b3c62f04b192 admin admin] PATH_INFO: `/v3/users/52cecfc8948e433ca5982168f37e5570` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:40.622491 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44474c87-0915-4ab2-831d-b3c62f04b192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52cecfc8948e433ca5982168f37e5570)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:40.647410 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44474c87-0915-4ab2-831d-b3c62f04b192 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:40.676505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1090/2154] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:54:40 2021] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:54:40.680701 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082adcb4-0ae8-4e76-a0c1-8a2f813c22bc admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:40.690165 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082adcb4-0ae8-4e76-a0c1-8a2f813c22bc admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:40.695994 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876f2e4-de1f-4e30-a3af-cbb40dd4a97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:40.696689 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876f2e4-de1f-4e30-a3af-cbb40dd4a97f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:40.697561 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876f2e4-de1f-4e30-a3af-cbb40dd4a97f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:40.697910 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876f2e4-de1f-4e30-a3af-cbb40dd4a97f admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:40.698986 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876f2e4-de1f-4e30-a3af-cbb40dd4a97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:40.724985 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876f2e4-de1f-4e30-a3af-cbb40dd4a97f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:40.735853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1091/2155] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:54:40 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:54:40.739688 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876f2e4-de1f-4e30-a3af-cbb40dd4a97f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:40.749170 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876f2e4-de1f-4e30-a3af-cbb40dd4a97f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:40.757028 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f11ae-511a-42cf-8a42-9798cf92dc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:40.758054 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f11ae-511a-42cf-8a42-9798cf92dc7e admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:40.758399 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f11ae-511a-42cf-8a42-9798cf92dc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:40.758787 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f11ae-511a-42cf-8a42-9798cf92dc7e admin admin] PATH_INFO: `/v3/projects/756c5919b92048deb803a98e23115cb7/users/a731318e561c47e3aa97098946cf5a58/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:40.781926 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f11ae-511a-42cf-8a42-9798cf92dc7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=756c5919b92048deb803a98e23115cb7, user_id=a731318e561c47e3aa97098946cf5a58, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:40.809440 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f11ae-511a-42cf-8a42-9798cf92dc7e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:40.909409 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-44474c87-0915-4ab2-831d-b3c62f04b192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52cecfc8948e433ca5982168f37e5570'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:40.958779 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1092/2156] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:54:40 2021] PUT /identity/v3/projects/756c5919b92048deb803a98e23115cb7/users/a731318e561c47e3aa97098946cf5a58/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:54:40.969764 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b59ec3-d074-435a-b154-36684f16737c None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:40.970128 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b59ec3-d074-435a-b154-36684f16737c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:40.970506 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b59ec3-d074-435a-b154-36684f16737c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:40.988451 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-44474c87-0915-4ab2-831d-b3c62f04b192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52cecfc8948e433ca5982168f37e5570'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:40.989659 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-44474c87-0915-4ab2-831d-b3c62f04b192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52cecfc8948e433ca5982168f37e5570'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:41.013532 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-44474c87-0915-4ab2-831d-b3c62f04b192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52cecfc8948e433ca5982168f37e5570'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:41.013712 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-f3b59ec3-d074-435a-b154-36684f16737c None None] MFA Rules not processed for user `a731318e561c47e3aa97098946cf5a58`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:41.015890 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f3b59ec3-d074-435a-b154-36684f16737c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:41.016452 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-44474c87-0915-4ab2-831d-b3c62f04b192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52cecfc8948e433ca5982168f37e5570'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:41.052361 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1065/2157] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:54:40 2021] DELETE /identity/v3/users/52cecfc8948e433ca5982168f37e5570 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:54:41.057459 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f7194-a960-4c31-8e36-a15a5460de24 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:41.058041 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f7194-a960-4c31-8e36-a15a5460de24 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:41.058134 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f7194-a960-4c31-8e36-a15a5460de24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:41.087050 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-5b3f7194-a960-4c31-8e36-a15a5460de24 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:41.088887 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5b3f7194-a960-4c31-8e36-a15a5460de24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:41.137377 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1093/2158] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:40 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:41.157252 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b59ec3-d074-435a-b154-36684f16737c None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:41.158716 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f3b59ec3-d074-435a-b154-36684f16737c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:41.160115 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1066/2159] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:41.175878 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f7194-a960-4c31-8e36-a15a5460de24 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:41.179118 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5b3f7194-a960-4c31-8e36-a15a5460de24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:41.251416 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b59ec3-d074-435a-b154-36684f16737c None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:41.301293 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f7194-a960-4c31-8e36-a15a5460de24 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:41.305480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec27735-f80a-444c-977b-332147806a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:41.306080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec27735-f80a-444c-977b-332147806a68 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:41.306419 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec27735-f80a-444c-977b-332147806a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:41.306758 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec27735-f80a-444c-977b-332147806a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:41.318896 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec27735-f80a-444c-977b-332147806a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:41.320210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc303a24-81ce-40bd-8e03-a169f9151807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:41.321057 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc303a24-81ce-40bd-8e03-a169f9151807 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:41.321342 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc303a24-81ce-40bd-8e03-a169f9151807 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:41.321627 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc303a24-81ce-40bd-8e03-a169f9151807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:41.345009 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec27735-f80a-444c-977b-332147806a68 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:41.356621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1067/2160] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:54:41.428543 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc303a24-81ce-40bd-8e03-a169f9151807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:41.470452 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc303a24-81ce-40bd-8e03-a169f9151807 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:41.503115 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1094/2161] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:41 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:54:42.231950 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec27735-f80a-444c-977b-332147806a68 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:42.233451 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-aec27735-f80a-444c-977b-332147806a68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:42.253952 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec27735-f80a-444c-977b-332147806a68 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:42.277836 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e14b27-83e5-4513-942c-b8ec6bdabfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:42.279104 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e14b27-83e5-4513-942c-b8ec6bdabfab admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:42.279618 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e14b27-83e5-4513-942c-b8ec6bdabfab admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:42.280130 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e14b27-83e5-4513-942c-b8ec6bdabfab admin admin] PATH_INFO: `/v3/projects/caa9d2bd9422428cb4231dd60be6e04a` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:42.283006 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e14b27-83e5-4513-942c-b8ec6bdabfab admin admin] RBAC: Authorizing `identity:delete_project(project_id=caa9d2bd9422428cb4231dd60be6e04a)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:42.324660 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e14b27-83e5-4513-942c-b8ec6bdabfab admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:42.547670 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-39e14b27-83e5-4513-942c-b8ec6bdabfab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caa9d2bd9422428cb4231dd60be6e04a', 'request_id': 'req-39e14b27-83e5-4513-942c-b8ec6bdabfab'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:42.566305 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-39e14b27-83e5-4513-942c-b8ec6bdabfab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caa9d2bd9422428cb4231dd60be6e04a', 'request_id': 'req-39e14b27-83e5-4513-942c-b8ec6bdabfab'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:42.579297 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-39e14b27-83e5-4513-942c-b8ec6bdabfab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caa9d2bd9422428cb4231dd60be6e04a', 'request_id': 'req-39e14b27-83e5-4513-942c-b8ec6bdabfab'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:42.684403 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-39e14b27-83e5-4513-942c-b8ec6bdabfab admin admin] The token cache is being invalidate because project caa9d2bd9422428cb4231dd60be6e04a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:54:42.684785 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-39e14b27-83e5-4513-942c-b8ec6bdabfab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:42.688962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-39e14b27-83e5-4513-942c-b8ec6bdabfab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:42.691453 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1068/2162] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:54:42 2021] DELETE /identity/v3/projects/caa9d2bd9422428cb4231dd60be6e04a => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:43.605415 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc303a24-81ce-40bd-8e03-a169f9151807 service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:43.606769 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-bc303a24-81ce-40bd-8e03-a169f9151807 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:43.619813 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc303a24-81ce-40bd-8e03-a169f9151807 service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:43.699417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34be11f-9c57-4546-8375-1381a2e2f580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:43.700233 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34be11f-9c57-4546-8375-1381a2e2f580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:43.700537 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34be11f-9c57-4546-8375-1381a2e2f580 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:43.700845 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34be11f-9c57-4546-8375-1381a2e2f580 admin admin] PATH_INFO: `/v3/users/dba3a36c5ac34084815f20542613f4c5` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:43.705407 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34be11f-9c57-4546-8375-1381a2e2f580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dba3a36c5ac34084815f20542613f4c5)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:43.732778 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34be11f-9c57-4546-8375-1381a2e2f580 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:44.015135 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f34be11f-9c57-4546-8375-1381a2e2f580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dba3a36c5ac34084815f20542613f4c5'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:44.017066 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f34be11f-9c57-4546-8375-1381a2e2f580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dba3a36c5ac34084815f20542613f4c5'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:44.173287 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f34be11f-9c57-4546-8375-1381a2e2f580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dba3a36c5ac34084815f20542613f4c5'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:44.181731 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f34be11f-9c57-4546-8375-1381a2e2f580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dba3a36c5ac34084815f20542613f4c5'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:44.184779 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f34be11f-9c57-4546-8375-1381a2e2f580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dba3a36c5ac34084815f20542613f4c5'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:44.201164 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1095/2163] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:54:43 2021] DELETE /identity/v3/users/dba3a36c5ac34084815f20542613f4c5 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:44.206042 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18163d5c-628c-41bd-b271-acc55307bcfa None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:44.206571 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18163d5c-628c-41bd-b271-acc55307bcfa None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:44.206751 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18163d5c-628c-41bd-b271-acc55307bcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:44.229535 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-18163d5c-628c-41bd-b271-acc55307bcfa None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:44.230683 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-18163d5c-628c-41bd-b271-acc55307bcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:44.307341 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1069/2164] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:54:44.317584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34be11f-9c57-4546-8375-1381a2e2f580 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:44.319843 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f34be11f-9c57-4546-8375-1381a2e2f580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:44.390865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34be11f-9c57-4546-8375-1381a2e2f580 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:44.394352 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ada84-2fd4-4d16-a1ee-a23a7453ac4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:44.395003 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ada84-2fd4-4d16-a1ee-a23a7453ac4d service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:44.395290 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ada84-2fd4-4d16-a1ee-a23a7453ac4d service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:44.395569 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ada84-2fd4-4d16-a1ee-a23a7453ac4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:44.405944 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ada84-2fd4-4d16-a1ee-a23a7453ac4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:44.435326 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ada84-2fd4-4d16-a1ee-a23a7453ac4d service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:44.446202 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1096/2165] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:54:45.447800 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18163d5c-628c-41bd-b271-acc55307bcfa None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:45.449219 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-18163d5c-628c-41bd-b271-acc55307bcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:45.460591 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18163d5c-628c-41bd-b271-acc55307bcfa None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:45.466246 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeb738-84fc-4bab-9747-3615823cb823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:45.467021 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeb738-84fc-4bab-9747-3615823cb823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:45.467306 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeb738-84fc-4bab-9747-3615823cb823 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:45.467584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeb738-84fc-4bab-9747-3615823cb823 admin admin] PATH_INFO: `/v3/projects/93229c89e9ee4875b6128cb401f84d4e` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:45.468666 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaeb738-84fc-4bab-9747-3615823cb823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93229c89e9ee4875b6128cb401f84d4e)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:45.495784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaeb738-84fc-4bab-9747-3615823cb823 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:45.617147 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-feaeb738-84fc-4bab-9747-3615823cb823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93229c89e9ee4875b6128cb401f84d4e', 'request_id': 'req-feaeb738-84fc-4bab-9747-3615823cb823'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:45.622827 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-feaeb738-84fc-4bab-9747-3615823cb823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93229c89e9ee4875b6128cb401f84d4e', 'request_id': 'req-feaeb738-84fc-4bab-9747-3615823cb823'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:45.634078 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-feaeb738-84fc-4bab-9747-3615823cb823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93229c89e9ee4875b6128cb401f84d4e', 'request_id': 'req-feaeb738-84fc-4bab-9747-3615823cb823'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:45.740721 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-feaeb738-84fc-4bab-9747-3615823cb823 admin admin] The token cache is being invalidate because project 93229c89e9ee4875b6128cb401f84d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:54:45.741022 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-feaeb738-84fc-4bab-9747-3615823cb823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:45.741946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-feaeb738-84fc-4bab-9747-3615823cb823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:45.751208 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1070/2166] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:54:45 2021] DELETE /identity/v3/projects/93229c89e9ee4875b6128cb401f84d4e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:45.751300 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85ac7d-f90f-4c7b-b843-f289c285463e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:45.751300 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85ac7d-f90f-4c7b-b843-f289c285463e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:45.751300 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85ac7d-f90f-4c7b-b843-f289c285463e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:45.777286 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-9f85ac7d-f90f-4c7b-b843-f289c285463e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:45.778417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-9f85ac7d-f90f-4c7b-b843-f289c285463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:45.842064 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1097/2167] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:45.849892 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660309af-f05e-4f1a-a545-abfbfdaee11a None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:45.850190 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660309af-f05e-4f1a-a545-abfbfdaee11a None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:45.850480 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660309af-f05e-4f1a-a545-abfbfdaee11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:45.875478 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-660309af-f05e-4f1a-a545-abfbfdaee11a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:45.876655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-660309af-f05e-4f1a-a545-abfbfdaee11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:45.883892 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1071/2168] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:45.888806 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85ac7d-f90f-4c7b-b843-f289c285463e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:45.897834 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85ac7d-f90f-4c7b-b843-f289c285463e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:45.902090 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc069170-ec7e-4a53-b129-862d511706e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:45.902668 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc069170-ec7e-4a53-b129-862d511706e8 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:45.902956 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc069170-ec7e-4a53-b129-862d511706e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:45.903236 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc069170-ec7e-4a53-b129-862d511706e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:45.903910 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc069170-ec7e-4a53-b129-862d511706e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:54:45.904213 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc069170-ec7e-4a53-b129-862d511706e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:45.929683 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc069170-ec7e-4a53-b129-862d511706e8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:45.944635 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1098/2169] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:54:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:54:45.948873 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660309af-f05e-4f1a-a545-abfbfdaee11a None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:45.957694 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660309af-f05e-4f1a-a545-abfbfdaee11a None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:45.962404 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e283574-68af-49d7-a814-57cb18a0b969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:45.962973 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e283574-68af-49d7-a814-57cb18a0b969 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:45.963256 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e283574-68af-49d7-a814-57cb18a0b969 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:45.963531 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e283574-68af-49d7-a814-57cb18a0b969 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:45.964213 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e283574-68af-49d7-a814-57cb18a0b969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:45.989859 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e283574-68af-49d7-a814-57cb18a0b969 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:46.101868 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1072/2170] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:54:45 2021] POST /identity/v3/projects => generated 399 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:54:46.106062 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc069170-ec7e-4a53-b129-862d511706e8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:46.115410 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc069170-ec7e-4a53-b129-862d511706e8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:46.176744 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee59f8-9d51-45d3-acc1-2944e4776eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:46.177341 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee59f8-9d51-45d3-acc1-2944e4776eca admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:46.177619 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee59f8-9d51-45d3-acc1-2944e4776eca admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:46.177893 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee59f8-9d51-45d3-acc1-2944e4776eca admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:46.178524 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee59f8-9d51-45d3-acc1-2944e4776eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:46.205072 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee59f8-9d51-45d3-acc1-2944e4776eca admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:46.295014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1099/2171] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:54:46 2021] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:54:46.298874 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e283574-68af-49d7-a814-57cb18a0b969 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:46.309534 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e283574-68af-49d7-a814-57cb18a0b969 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:46.313745 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3dd580-c3e7-42bd-8f85-5a69d56743ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:46.314328 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dd580-c3e7-42bd-8f85-5a69d56743ee admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:46.314619 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dd580-c3e7-42bd-8f85-5a69d56743ee admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:46.319970 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dd580-c3e7-42bd-8f85-5a69d56743ee admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:46.319970 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3dd580-c3e7-42bd-8f85-5a69d56743ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:46.341376 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3dd580-c3e7-42bd-8f85-5a69d56743ee admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:46.354882 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1073/2172] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:54:46 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:54:46.356132 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee59f8-9d51-45d3-acc1-2944e4776eca admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:46.365784 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee59f8-9d51-45d3-acc1-2944e4776eca admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:46.370622 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a94d90-fd6a-4e70-aab7-8dd920144f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:46.371490 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a94d90-fd6a-4e70-aab7-8dd920144f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:46.371851 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a94d90-fd6a-4e70-aab7-8dd920144f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:46.372203 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a94d90-fd6a-4e70-aab7-8dd920144f9b admin admin] PATH_INFO: `/v3/projects/045202c106b642ebaf6c0e54884ba074/users/2e39ba61160a4baaafeb75292bc035ac/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:46.392385 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a94d90-fd6a-4e70-aab7-8dd920144f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=045202c106b642ebaf6c0e54884ba074, user_id=2e39ba61160a4baaafeb75292bc035ac, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:46.418991 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a94d90-fd6a-4e70-aab7-8dd920144f9b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:46.487670 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1100/2173] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:54:46 2021] PUT /identity/v3/projects/045202c106b642ebaf6c0e54884ba074/users/2e39ba61160a4baaafeb75292bc035ac/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:46.500122 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff51ceb-d64e-4c52-b6f2-94dd57be8a4d None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:46.500605 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff51ceb-d64e-4c52-b6f2-94dd57be8a4d None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:46.500878 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff51ceb-d64e-4c52-b6f2-94dd57be8a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:46.540020 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-3ff51ceb-d64e-4c52-b6f2-94dd57be8a4d None None] MFA Rules not processed for user `2e39ba61160a4baaafeb75292bc035ac`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:46.541237 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-3ff51ceb-d64e-4c52-b6f2-94dd57be8a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:46.613428 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1074/2174] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:46 2021] POST /identity/v3/auth/tokens => generated 3706 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:46.624017 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a94d90-fd6a-4e70-aab7-8dd920144f9b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:46.625751 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-73a94d90-fd6a-4e70-aab7-8dd920144f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:46.691638 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a94d90-fd6a-4e70-aab7-8dd920144f9b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:46.695030 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4fc8e-7b4c-4c83-bca6-7ae738292f45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:46.695601 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4fc8e-7b4c-4c83-bca6-7ae738292f45 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:46.695885 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4fc8e-7b4c-4c83-bca6-7ae738292f45 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:46.696162 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4fc8e-7b4c-4c83-bca6-7ae738292f45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:46.704059 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4fc8e-7b4c-4c83-bca6-7ae738292f45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:46.729289 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4fc8e-7b4c-4c83-bca6-7ae738292f45 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:46.737523 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1101/2175] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:46 2021] GET /identity/v3/auth/tokens => generated 3706 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:54:55.734630 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff51ceb-d64e-4c52-b6f2-94dd57be8a4d None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:55.735990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-3ff51ceb-d64e-4c52-b6f2-94dd57be8a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:55.834391 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff51ceb-d64e-4c52-b6f2-94dd57be8a4d None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:55.845788 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb930108-d4c4-49ad-8c5a-80feec01882a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:55.846638 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb930108-d4c4-49ad-8c5a-80feec01882a admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:55.846894 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb930108-d4c4-49ad-8c5a-80feec01882a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:55.847175 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb930108-d4c4-49ad-8c5a-80feec01882a admin admin] PATH_INFO: `/v3/users/a731318e561c47e3aa97098946cf5a58` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:55.849782 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb930108-d4c4-49ad-8c5a-80feec01882a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a731318e561c47e3aa97098946cf5a58)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:55.897414 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb930108-d4c4-49ad-8c5a-80feec01882a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:56.104892 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fb930108-d4c4-49ad-8c5a-80feec01882a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a731318e561c47e3aa97098946cf5a58'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:56.209636 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fb930108-d4c4-49ad-8c5a-80feec01882a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a731318e561c47e3aa97098946cf5a58'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:56.210212 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fb930108-d4c4-49ad-8c5a-80feec01882a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a731318e561c47e3aa97098946cf5a58'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:56.218847 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fb930108-d4c4-49ad-8c5a-80feec01882a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a731318e561c47e3aa97098946cf5a58'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:56.219432 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fb930108-d4c4-49ad-8c5a-80feec01882a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a731318e561c47e3aa97098946cf5a58'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:56.236659 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1075/2176] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:54:55 2021] DELETE /identity/v3/users/a731318e561c47e3aa97098946cf5a58 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:56.241146 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd71701-c998-4ab0-be78-508739e3398a None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:56.241592 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd71701-c998-4ab0-be78-508739e3398a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:56.241709 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd71701-c998-4ab0-be78-508739e3398a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:56.263804 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-5bd71701-c998-4ab0-be78-508739e3398a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:56.264963 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-5bd71701-c998-4ab0-be78-508739e3398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:56.330610 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1102/2177] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:54:56.341001 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb930108-d4c4-49ad-8c5a-80feec01882a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:56.342438 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-fb930108-d4c4-49ad-8c5a-80feec01882a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:56.408158 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb930108-d4c4-49ad-8c5a-80feec01882a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:56.411719 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392279d8-e5b6-429b-af22-a99a6d100380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:56.412299 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392279d8-e5b6-429b-af22-a99a6d100380 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:56.412605 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392279d8-e5b6-429b-af22-a99a6d100380 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:56.412890 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392279d8-e5b6-429b-af22-a99a6d100380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:56.422343 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392279d8-e5b6-429b-af22-a99a6d100380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:56.448965 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392279d8-e5b6-429b-af22-a99a6d100380 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:56.458795 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1076/2178] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:54:57.066166 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd71701-c998-4ab0-be78-508739e3398a None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:57.068274 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-5bd71701-c998-4ab0-be78-508739e3398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:57.087620 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd71701-c998-4ab0-be78-508739e3398a None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:57.092175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e09a6-9d0a-4608-892e-139634614115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:57.093398 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e09a6-9d0a-4608-892e-139634614115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:57.093820 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e09a6-9d0a-4608-892e-139634614115 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:57.094235 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e09a6-9d0a-4608-892e-139634614115 admin admin] PATH_INFO: `/v3/projects/756c5919b92048deb803a98e23115cb7` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:57.095832 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e09a6-9d0a-4608-892e-139634614115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=756c5919b92048deb803a98e23115cb7)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:57.151219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e09a6-9d0a-4608-892e-139634614115 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:57.196942 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392279d8-e5b6-429b-af22-a99a6d100380 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:57.198924 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-392279d8-e5b6-429b-af22-a99a6d100380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:57.213882 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392279d8-e5b6-429b-af22-a99a6d100380 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:57.219067 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6246c-d316-4822-9198-80642d4d943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:57.219863 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6246c-d316-4822-9198-80642d4d943c admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:57.220153 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6246c-d316-4822-9198-80642d4d943c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:57.220433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6246c-d316-4822-9198-80642d4d943c admin admin] PATH_INFO: `/v3/users/2e39ba61160a4baaafeb75292bc035ac` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:57.221691 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6246c-d316-4822-9198-80642d4d943c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e39ba61160a4baaafeb75292bc035ac)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:57.248458 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6246c-d316-4822-9198-80642d4d943c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:57.315802 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f47e09a6-9d0a-4608-892e-139634614115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '756c5919b92048deb803a98e23115cb7', 'request_id': 'req-f47e09a6-9d0a-4608-892e-139634614115'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:57.321113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f47e09a6-9d0a-4608-892e-139634614115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '756c5919b92048deb803a98e23115cb7', 'request_id': 'req-f47e09a6-9d0a-4608-892e-139634614115'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:57.332895 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f47e09a6-9d0a-4608-892e-139634614115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '756c5919b92048deb803a98e23115cb7', 'request_id': 'req-f47e09a6-9d0a-4608-892e-139634614115'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:57.412765 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f47e09a6-9d0a-4608-892e-139634614115 admin admin] The token cache is being invalidate because project 756c5919b92048deb803a98e23115cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:54:57.413087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f47e09a6-9d0a-4608-892e-139634614115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:57.413774 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f47e09a6-9d0a-4608-892e-139634614115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:57.415440 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1103/2179] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:54:57 2021] DELETE /identity/v3/projects/756c5919b92048deb803a98e23115cb7 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:57.422243 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca8a74-fe87-4255-9e84-2dca12ed715b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:57.422562 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca8a74-fe87-4255-9e84-2dca12ed715b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:57.422822 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca8a74-fe87-4255-9e84-2dca12ed715b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:57.450181 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0ba6246c-d316-4822-9198-80642d4d943c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e39ba61160a4baaafeb75292bc035ac'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:57.459752 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-f4ca8a74-fe87-4255-9e84-2dca12ed715b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:57.461075 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f4ca8a74-fe87-4255-9e84-2dca12ed715b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:57.529495 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0ba6246c-d316-4822-9198-80642d4d943c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e39ba61160a4baaafeb75292bc035ac'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:57.530206 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0ba6246c-d316-4822-9198-80642d4d943c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e39ba61160a4baaafeb75292bc035ac'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:57.530729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1104/2180] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:54:57.537977 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84b755-c0d1-45d6-be18-3a46ee0b4826 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:57.538267 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84b755-c0d1-45d6-be18-3a46ee0b4826 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:57.538539 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84b755-c0d1-45d6-be18-3a46ee0b4826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:57.544122 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0ba6246c-d316-4822-9198-80642d4d943c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e39ba61160a4baaafeb75292bc035ac'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:57.544814 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0ba6246c-d316-4822-9198-80642d4d943c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e39ba61160a4baaafeb75292bc035ac'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:57.561479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-4a84b755-c0d1-45d6-be18-3a46ee0b4826 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:57.562670 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-4a84b755-c0d1-45d6-be18-3a46ee0b4826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:57.563159 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1077/2181] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:54:57 2021] DELETE /identity/v3/users/2e39ba61160a4baaafeb75292bc035ac => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:54:57.567598 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5dd0d-5b24-4463-b494-6dcb3a423bf7 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:57.567902 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5dd0d-5b24-4463-b494-6dcb3a423bf7 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:57.568550 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5dd0d-5b24-4463-b494-6dcb3a423bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:57.593094 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-33b5dd0d-5b24-4463-b494-6dcb3a423bf7 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:57.594236 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-33b5dd0d-5b24-4463-b494-6dcb3a423bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:57.630668 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1105/2182] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:54:57.635477 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84b755-c0d1-45d6-be18-3a46ee0b4826 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:57.643989 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84b755-c0d1-45d6-be18-3a46ee0b4826 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:57.648253 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abbc18-5f4e-405c-8b6b-cc44a6dbce45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:57.648846 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abbc18-5f4e-405c-8b6b-cc44a6dbce45 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:57.649135 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abbc18-5f4e-405c-8b6b-cc44a6dbce45 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:57.649415 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abbc18-5f4e-405c-8b6b-cc44a6dbce45 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:57.650100 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abbc18-5f4e-405c-8b6b-cc44a6dbce45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:54:57.650404 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abbc18-5f4e-405c-8b6b-cc44a6dbce45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:57.659625 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1078/2183] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:57.669835 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5dd0d-5b24-4463-b494-6dcb3a423bf7 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:57.671059 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-33b5dd0d-5b24-4463-b494-6dcb3a423bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:57.675389 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abbc18-5f4e-405c-8b6b-cc44a6dbce45 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:57.689684 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1106/2184] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:54:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:54:57.694178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abbc18-5f4e-405c-8b6b-cc44a6dbce45 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:57.704012 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abbc18-5f4e-405c-8b6b-cc44a6dbce45 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:57.708726 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a736d-9c1e-487d-a48a-6fa9a2625463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:57.709077 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a736d-9c1e-487d-a48a-6fa9a2625463 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:57.709361 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a736d-9c1e-487d-a48a-6fa9a2625463 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:57.724677 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a736d-9c1e-487d-a48a-6fa9a2625463 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:57.725449 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a736d-9c1e-487d-a48a-6fa9a2625463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:57.752678 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a736d-9c1e-487d-a48a-6fa9a2625463 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:57.753035 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5dd0d-5b24-4463-b494-6dcb3a423bf7 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:57.760308 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa1b76-143b-4276-ae67-96acd2b4b293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:57.760930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa1b76-143b-4276-ae67-96acd2b4b293 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:57.761700 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa1b76-143b-4276-ae67-96acd2b4b293 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:57.761991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa1b76-143b-4276-ae67-96acd2b4b293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:57.778246 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa1b76-143b-4276-ae67-96acd2b4b293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:57.803998 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa1b76-143b-4276-ae67-96acd2b4b293 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:57.815910 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1079/2185] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:57 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:54:57.858440 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1107/2186] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:54:57 2021] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:54:57.862457 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa1b76-143b-4276-ae67-96acd2b4b293 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:57.874602 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa1b76-143b-4276-ae67-96acd2b4b293 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:57.972789 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e4962-31a8-45f8-916f-2288f5f1f9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:57.973414 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e4962-31a8-45f8-916f-2288f5f1f9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:57.973739 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e4962-31a8-45f8-916f-2288f5f1f9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:57.975334 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e4962-31a8-45f8-916f-2288f5f1f9b3 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:57.975607 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e4962-31a8-45f8-916f-2288f5f1f9b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:58.010419 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e4962-31a8-45f8-916f-2288f5f1f9b3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:58.133431 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1080/2187] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:54:57 2021] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:54:58.135950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a736d-9c1e-487d-a48a-6fa9a2625463 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:58.149416 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a736d-9c1e-487d-a48a-6fa9a2625463 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:58.154783 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856fd72-97c8-4fe1-acc2-58b7b9262baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:58.155480 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856fd72-97c8-4fe1-acc2-58b7b9262baf admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:58.155773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856fd72-97c8-4fe1-acc2-58b7b9262baf admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:58.156057 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856fd72-97c8-4fe1-acc2-58b7b9262baf admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:58.157189 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856fd72-97c8-4fe1-acc2-58b7b9262baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:58.193425 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856fd72-97c8-4fe1-acc2-58b7b9262baf admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:58.204912 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1108/2188] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:54:58 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:54:58.209238 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e4962-31a8-45f8-916f-2288f5f1f9b3 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:58.220853 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e4962-31a8-45f8-916f-2288f5f1f9b3 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:58.225939 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c630393-9a26-431b-97a2-caf7e4d51400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:58.226998 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c630393-9a26-431b-97a2-caf7e4d51400 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:58.227398 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c630393-9a26-431b-97a2-caf7e4d51400 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:58.228265 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c630393-9a26-431b-97a2-caf7e4d51400 admin admin] PATH_INFO: `/v3/projects/9804ee271dd94cb5971caa4135c91b5d/users/8cb4e11b8e5444e39e824f782fb313e4/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:58.269478 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c630393-9a26-431b-97a2-caf7e4d51400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9804ee271dd94cb5971caa4135c91b5d, user_id=8cb4e11b8e5444e39e824f782fb313e4, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:58.300591 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c630393-9a26-431b-97a2-caf7e4d51400 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:58.407901 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1081/2189] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:54:58 2021] PUT /identity/v3/projects/9804ee271dd94cb5971caa4135c91b5d/users/8cb4e11b8e5444e39e824f782fb313e4/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:54:58.419566 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d7f9a-ae1f-453d-832e-acf419d755f7 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:58.420114 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d7f9a-ae1f-453d-832e-acf419d755f7 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:58.420197 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d7f9a-ae1f-453d-832e-acf419d755f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:58.458397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-ee2d7f9a-ae1f-453d-832e-acf419d755f7 None None] MFA Rules not processed for user `8cb4e11b8e5444e39e824f782fb313e4`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:58.459665 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ee2d7f9a-ae1f-453d-832e-acf419d755f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:58.540831 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1109/2190] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:58 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:58.549534 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c630393-9a26-431b-97a2-caf7e4d51400 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:58.551498 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2c630393-9a26-431b-97a2-caf7e4d51400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:58.631296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c630393-9a26-431b-97a2-caf7e4d51400 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:58.635659 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03724ba-8421-40c3-a4d5-66ac57b9f719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:58.636345 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03724ba-8421-40c3-a4d5-66ac57b9f719 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:58.636688 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03724ba-8421-40c3-a4d5-66ac57b9f719 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:58.637005 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03724ba-8421-40c3-a4d5-66ac57b9f719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:58.646205 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03724ba-8421-40c3-a4d5-66ac57b9f719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:58.673092 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03724ba-8421-40c3-a4d5-66ac57b9f719 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:58.683899 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1082/2191] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:58 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:54:58.785421 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d7f9a-ae1f-453d-832e-acf419d755f7 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:58.786762 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ee2d7f9a-ae1f-453d-832e-acf419d755f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:58.863892 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d7f9a-ae1f-453d-832e-acf419d755f7 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:58.869723 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9965a6a-f792-410c-ab7d-cb89cda197b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:58.870633 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9965a6a-f792-410c-ab7d-cb89cda197b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:58.870923 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9965a6a-f792-410c-ab7d-cb89cda197b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:58.871200 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9965a6a-f792-410c-ab7d-cb89cda197b1 admin admin] PATH_INFO: `/v3/projects/045202c106b642ebaf6c0e54884ba074` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:58.872268 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9965a6a-f792-410c-ab7d-cb89cda197b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=045202c106b642ebaf6c0e54884ba074)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:58.900222 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9965a6a-f792-410c-ab7d-cb89cda197b1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:59.009897 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-b9965a6a-f792-410c-ab7d-cb89cda197b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '045202c106b642ebaf6c0e54884ba074', 'request_id': 'req-b9965a6a-f792-410c-ab7d-cb89cda197b1'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:59.014998 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-b9965a6a-f792-410c-ab7d-cb89cda197b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '045202c106b642ebaf6c0e54884ba074', 'request_id': 'req-b9965a6a-f792-410c-ab7d-cb89cda197b1'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:59.026092 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-b9965a6a-f792-410c-ab7d-cb89cda197b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '045202c106b642ebaf6c0e54884ba074', 'request_id': 'req-b9965a6a-f792-410c-ab7d-cb89cda197b1'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:59.117395 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-b9965a6a-f792-410c-ab7d-cb89cda197b1 admin admin] The token cache is being invalidate because project 045202c106b642ebaf6c0e54884ba074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:54:59.117608 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-b9965a6a-f792-410c-ab7d-cb89cda197b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:59.118186 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-b9965a6a-f792-410c-ab7d-cb89cda197b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:59.119604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1110/2192] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:54:58 2021] DELETE /identity/v3/projects/045202c106b642ebaf6c0e54884ba074 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:59.424021 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03724ba-8421-40c3-a4d5-66ac57b9f719 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:59.425488 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-b03724ba-8421-40c3-a4d5-66ac57b9f719 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:59.443209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03724ba-8421-40c3-a4d5-66ac57b9f719 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:54:59.521044 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21ad7f-8e8c-494d-8dda-5caefc270ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:54:59.522302 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21ad7f-8e8c-494d-8dda-5caefc270ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:59.522793 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21ad7f-8e8c-494d-8dda-5caefc270ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:59.523360 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21ad7f-8e8c-494d-8dda-5caefc270ba0 admin admin] PATH_INFO: `/v3/users/74acce49bc3842eaba64aebb49201219` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:59.525126 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21ad7f-8e8c-494d-8dda-5caefc270ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74acce49bc3842eaba64aebb49201219)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:54:59.553865 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21ad7f-8e8c-494d-8dda-5caefc270ba0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:54:59.738579 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-4b21ad7f-8e8c-494d-8dda-5caefc270ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74acce49bc3842eaba64aebb49201219'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:59.841291 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-4b21ad7f-8e8c-494d-8dda-5caefc270ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74acce49bc3842eaba64aebb49201219'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:59.841938 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-4b21ad7f-8e8c-494d-8dda-5caefc270ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74acce49bc3842eaba64aebb49201219'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:59.851654 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-4b21ad7f-8e8c-494d-8dda-5caefc270ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74acce49bc3842eaba64aebb49201219'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:59.852332 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-4b21ad7f-8e8c-494d-8dda-5caefc270ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74acce49bc3842eaba64aebb49201219'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:54:59.875311 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1083/2193] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:54:59 2021] DELETE /identity/v3/users/74acce49bc3842eaba64aebb49201219 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:54:59.881362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60509b61-9927-457b-9452-febc247f7488 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:54:59.881362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60509b61-9927-457b-9452-febc247f7488 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:54:59.881362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60509b61-9927-457b-9452-febc247f7488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:54:59.902397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-60509b61-9927-457b-9452-febc247f7488 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:54:59.903541 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-60509b61-9927-457b-9452-febc247f7488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:54:59.969790 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1111/2194] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:54:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:54:59.979842 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21ad7f-8e8c-494d-8dda-5caefc270ba0 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:54:59.981653 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4b21ad7f-8e8c-494d-8dda-5caefc270ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:00.045918 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21ad7f-8e8c-494d-8dda-5caefc270ba0 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:00.049147 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7c1b8-5aad-4300-8269-58cbdd66eaa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:00.049728 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7c1b8-5aad-4300-8269-58cbdd66eaa1 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:00.050012 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7c1b8-5aad-4300-8269-58cbdd66eaa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:00.050297 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7c1b8-5aad-4300-8269-58cbdd66eaa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:00.060022 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7c1b8-5aad-4300-8269-58cbdd66eaa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:00.085955 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7c1b8-5aad-4300-8269-58cbdd66eaa1 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:00.096377 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1084/2195] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:54:59 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:55:00.797214 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60509b61-9927-457b-9452-febc247f7488 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:00.798616 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-60509b61-9927-457b-9452-febc247f7488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:00.820026 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60509b61-9927-457b-9452-febc247f7488 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:00.831169 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e6971-31d8-4b9c-950b-0f942b17dfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:00.832087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e6971-31d8-4b9c-950b-0f942b17dfdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:00.832552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e6971-31d8-4b9c-950b-0f942b17dfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:00.832862 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e6971-31d8-4b9c-950b-0f942b17dfdb admin admin] PATH_INFO: `/v3/projects/83cf8b685cc043d2ba9b9b9183d3a040` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:00.834222 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e6971-31d8-4b9c-950b-0f942b17dfdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=83cf8b685cc043d2ba9b9b9183d3a040)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:00.870502 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e6971-31d8-4b9c-950b-0f942b17dfdb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:01.019354 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-909e6971-31d8-4b9c-950b-0f942b17dfdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83cf8b685cc043d2ba9b9b9183d3a040', 'request_id': 'req-909e6971-31d8-4b9c-950b-0f942b17dfdb'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:55:01.025230 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-909e6971-31d8-4b9c-950b-0f942b17dfdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83cf8b685cc043d2ba9b9b9183d3a040', 'request_id': 'req-909e6971-31d8-4b9c-950b-0f942b17dfdb'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:55:01.052226 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-909e6971-31d8-4b9c-950b-0f942b17dfdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83cf8b685cc043d2ba9b9b9183d3a040', 'request_id': 'req-909e6971-31d8-4b9c-950b-0f942b17dfdb'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:55:01.154616 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-909e6971-31d8-4b9c-950b-0f942b17dfdb admin admin] The token cache is being invalidate because project 83cf8b685cc043d2ba9b9b9183d3a040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:55:01.154909 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-909e6971-31d8-4b9c-950b-0f942b17dfdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:55:01.155505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-909e6971-31d8-4b9c-950b-0f942b17dfdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:55:01.156991 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1112/2196] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:55:00 2021] DELETE /identity/v3/projects/83cf8b685cc043d2ba9b9b9183d3a040 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:55:01.162767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b140a2-4758-4382-bf77-a38c912b2b0b None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:01.163223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b140a2-4758-4382-bf77-a38c912b2b0b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:01.163422 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b140a2-4758-4382-bf77-a38c912b2b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:01.188146 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-48b140a2-4758-4382-bf77-a38c912b2b0b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:55:01.189524 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-48b140a2-4758-4382-bf77-a38c912b2b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:01.256352 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1085/2197] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:55:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:55:01.264669 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f0ed8-0e0d-45a0-a979-afa5a7f9992c None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:01.264973 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f0ed8-0e0d-45a0-a979-afa5a7f9992c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:01.265272 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f0ed8-0e0d-45a0-a979-afa5a7f9992c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:01.287877 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-886f0ed8-0e0d-45a0-a979-afa5a7f9992c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:55:01.289052 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-886f0ed8-0e0d-45a0-a979-afa5a7f9992c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:01.296139 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1113/2198] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:55:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:55:01.302786 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b140a2-4758-4382-bf77-a38c912b2b0b None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:01.311485 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b140a2-4758-4382-bf77-a38c912b2b0b None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:01.315655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd33b85-a049-44c9-b517-e913f3f1b060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:01.316233 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd33b85-a049-44c9-b517-e913f3f1b060 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:01.316649 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd33b85-a049-44c9-b517-e913f3f1b060 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:01.316829 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd33b85-a049-44c9-b517-e913f3f1b060 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:01.317515 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd33b85-a049-44c9-b517-e913f3f1b060 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:55:01.317808 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd33b85-a049-44c9-b517-e913f3f1b060 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:01.343797 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd33b85-a049-44c9-b517-e913f3f1b060 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:01.362070 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1086/2199] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:55:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:55:01.362553 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f0ed8-0e0d-45a0-a979-afa5a7f9992c None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:01.374431 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f0ed8-0e0d-45a0-a979-afa5a7f9992c None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:01.379005 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ab861-1a7a-42cc-bae9-46c8a174006f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:01.380164 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ab861-1a7a-42cc-bae9-46c8a174006f admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:01.380459 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ab861-1a7a-42cc-bae9-46c8a174006f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:01.380922 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ab861-1a7a-42cc-bae9-46c8a174006f admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:01.382138 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ab861-1a7a-42cc-bae9-46c8a174006f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:01.409670 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ab861-1a7a-42cc-bae9-46c8a174006f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:01.514263 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1114/2200] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:55:01 2021] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:55:01.519944 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd33b85-a049-44c9-b517-e913f3f1b060 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:01.529550 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd33b85-a049-44c9-b517-e913f3f1b060 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:01.612841 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ab813-10ac-483c-88e5-5abe766cf139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:01.613445 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ab813-10ac-483c-88e5-5abe766cf139 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:01.613728 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ab813-10ac-483c-88e5-5abe766cf139 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:01.614023 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ab813-10ac-483c-88e5-5abe766cf139 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:01.614653 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ab813-10ac-483c-88e5-5abe766cf139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:01.641983 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ab813-10ac-483c-88e5-5abe766cf139 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:01.758056 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1087/2201] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:55:01 2021] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:55:01.762369 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ab861-1a7a-42cc-bae9-46c8a174006f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:01.772557 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ab861-1a7a-42cc-bae9-46c8a174006f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:01.777087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e94b8f-9e33-43cd-b8d1-9757f6d915d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:01.777672 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e94b8f-9e33-43cd-b8d1-9757f6d915d5 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:01.777963 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e94b8f-9e33-43cd-b8d1-9757f6d915d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:01.778349 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e94b8f-9e33-43cd-b8d1-9757f6d915d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:01.778961 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e94b8f-9e33-43cd-b8d1-9757f6d915d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:01.807642 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e94b8f-9e33-43cd-b8d1-9757f6d915d5 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:01.821927 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1115/2202] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:55:01 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:55:01.823087 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ab813-10ac-483c-88e5-5abe766cf139 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:01.832621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ab813-10ac-483c-88e5-5abe766cf139 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:01.836850 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5fcf4-e2fa-4114-a60c-6ed0894e5fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:01.837655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5fcf4-e2fa-4114-a60c-6ed0894e5fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:01.838667 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5fcf4-e2fa-4114-a60c-6ed0894e5fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:01.838667 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5fcf4-e2fa-4114-a60c-6ed0894e5fb6 admin admin] PATH_INFO: `/v3/projects/0fe01aed9b14497fb422023bf8bea00d/users/9a5a674999d04291ba10cea6cefba4b1/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:01.859311 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5fcf4-e2fa-4114-a60c-6ed0894e5fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe01aed9b14497fb422023bf8bea00d, user_id=9a5a674999d04291ba10cea6cefba4b1, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:01.886781 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5fcf4-e2fa-4114-a60c-6ed0894e5fb6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:01.971290 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1088/2203] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:55:01 2021] PUT /identity/v3/projects/0fe01aed9b14497fb422023bf8bea00d/users/9a5a674999d04291ba10cea6cefba4b1/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:55:01.978596 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a08008-14ea-49dc-b322-66c05b687d07 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:01.978890 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a08008-14ea-49dc-b322-66c05b687d07 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:01.979174 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a08008-14ea-49dc-b322-66c05b687d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:02.013567 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-15a08008-14ea-49dc-b322-66c05b687d07 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:55:02.014711 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-15a08008-14ea-49dc-b322-66c05b687d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:02.103493 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1116/2204] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:55:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:55:02.113907 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5fcf4-e2fa-4114-a60c-6ed0894e5fb6 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:02.115501 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-58d5fcf4-e2fa-4114-a60c-6ed0894e5fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:02.242120 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5fcf4-e2fa-4114-a60c-6ed0894e5fb6 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:02.255499 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c9309-3cee-4690-8138-cbd6081c143e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:02.256309 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c9309-3cee-4690-8138-cbd6081c143e service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:02.256785 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c9309-3cee-4690-8138-cbd6081c143e service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:02.257247 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c9309-3cee-4690-8138-cbd6081c143e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:02.267911 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c9309-3cee-4690-8138-cbd6081c143e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:02.294179 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c9309-3cee-4690-8138-cbd6081c143e service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:02.309943 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1089/2205] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:55:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:55:03.313851 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24772ba5-17b1-40a9-ba5c-c2e1222044ac None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:03.314366 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24772ba5-17b1-40a9-ba5c-c2e1222044ac None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:03.314499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24772ba5-17b1-40a9-ba5c-c2e1222044ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:03.336832 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-24772ba5-17b1-40a9-ba5c-c2e1222044ac None None] MFA Rules not processed for user `627bb2f869634b91973d020f20d1f4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:55:03.337983 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-24772ba5-17b1-40a9-ba5c-c2e1222044ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:03.406848 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1117/2206] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:55:03 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:55:04.032489 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c9309-3cee-4690-8138-cbd6081c143e service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:04.034035 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d96c9309-3cee-4690-8138-cbd6081c143e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:04.046875 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c9309-3cee-4690-8138-cbd6081c143e service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:04.053065 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e58b8f-1342-471c-bc4d-ee3db9f04772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:04.055045 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e58b8f-1342-471c-bc4d-ee3db9f04772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:04.056491 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e58b8f-1342-471c-bc4d-ee3db9f04772 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:04.057559 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e58b8f-1342-471c-bc4d-ee3db9f04772 admin admin] PATH_INFO: `/v3/users/8cb4e11b8e5444e39e824f782fb313e4` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:04.059436 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e58b8f-1342-471c-bc4d-ee3db9f04772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb4e11b8e5444e39e824f782fb313e4)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:04.086824 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e58b8f-1342-471c-bc4d-ee3db9f04772 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:04.439003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b9e58b8f-1342-471c-bc4d-ee3db9f04772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb4e11b8e5444e39e824f782fb313e4'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:55:04.518823 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b9e58b8f-1342-471c-bc4d-ee3db9f04772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb4e11b8e5444e39e824f782fb313e4'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:55:04.519999 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b9e58b8f-1342-471c-bc4d-ee3db9f04772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb4e11b8e5444e39e824f782fb313e4'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:55:04.532907 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b9e58b8f-1342-471c-bc4d-ee3db9f04772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb4e11b8e5444e39e824f782fb313e4'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:55:04.534717 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b9e58b8f-1342-471c-bc4d-ee3db9f04772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb4e11b8e5444e39e824f782fb313e4'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:55:04.574568 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1090/2207] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:55:04 2021] DELETE /identity/v3/users/8cb4e11b8e5444e39e824f782fb313e4 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:55:04.578829 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c7519-1e1f-447c-a275-27a300a1a934 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:04.579274 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c7519-1e1f-447c-a275-27a300a1a934 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:04.579626 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c7519-1e1f-447c-a275-27a300a1a934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:04.617313 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-243c7519-1e1f-447c-a275-27a300a1a934 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:55:04.618514 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-243c7519-1e1f-447c-a275-27a300a1a934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:04.692039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1118/2208] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:55:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:55:04.701739 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e58b8f-1342-471c-bc4d-ee3db9f04772 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:04.703204 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-b9e58b8f-1342-471c-bc4d-ee3db9f04772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:04.782173 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e58b8f-1342-471c-bc4d-ee3db9f04772 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:04.786375 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ec501-df21-4aea-bfd1-a461529eb817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:04.786961 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ec501-df21-4aea-bfd1-a461529eb817 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:04.787311 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ec501-df21-4aea-bfd1-a461529eb817 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:04.787569 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ec501-df21-4aea-bfd1-a461529eb817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:04.799324 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ec501-df21-4aea-bfd1-a461529eb817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:04.831725 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ec501-df21-4aea-bfd1-a461529eb817 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:04.843649 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1091/2209] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:55:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:55:05.516583 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c7519-1e1f-447c-a275-27a300a1a934 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:05.521386 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-243c7519-1e1f-447c-a275-27a300a1a934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:05.540594 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c7519-1e1f-447c-a275-27a300a1a934 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:05.546036 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb70e97-9eed-4b6c-9fb9-a1e25b43ebaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:05.547328 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb70e97-9eed-4b6c-9fb9-a1e25b43ebaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:05.547649 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb70e97-9eed-4b6c-9fb9-a1e25b43ebaf admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:05.547926 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb70e97-9eed-4b6c-9fb9-a1e25b43ebaf admin admin] PATH_INFO: `/v3/projects/9804ee271dd94cb5971caa4135c91b5d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:05.549392 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb70e97-9eed-4b6c-9fb9-a1e25b43ebaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9804ee271dd94cb5971caa4135c91b5d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:05.588119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb70e97-9eed-4b6c-9fb9-a1e25b43ebaf admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:05.722951 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ccb70e97-9eed-4b6c-9fb9-a1e25b43ebaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9804ee271dd94cb5971caa4135c91b5d', 'request_id': 'req-ccb70e97-9eed-4b6c-9fb9-a1e25b43ebaf'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:55:05.751417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ccb70e97-9eed-4b6c-9fb9-a1e25b43ebaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9804ee271dd94cb5971caa4135c91b5d', 'request_id': 'req-ccb70e97-9eed-4b6c-9fb9-a1e25b43ebaf'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:55:05.767101 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ccb70e97-9eed-4b6c-9fb9-a1e25b43ebaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9804ee271dd94cb5971caa4135c91b5d', 'request_id': 'req-ccb70e97-9eed-4b6c-9fb9-a1e25b43ebaf'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:55:05.865892 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ccb70e97-9eed-4b6c-9fb9-a1e25b43ebaf admin admin] The token cache is being invalidate because project 9804ee271dd94cb5971caa4135c91b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:55:05.866448 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ccb70e97-9eed-4b6c-9fb9-a1e25b43ebaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:55:05.867661 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ccb70e97-9eed-4b6c-9fb9-a1e25b43ebaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:55:05.870177 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1119/2210] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:55:05 2021] DELETE /identity/v3/projects/9804ee271dd94cb5971caa4135c91b5d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:55:09.291712 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d15ef4-fe04-477a-8bb3-78a19e0e5d81 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:09.292311 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d15ef4-fe04-477a-8bb3-78a19e0e5d81 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:09.292311 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d15ef4-fe04-477a-8bb3-78a19e0e5d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:09.358839 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-86d15ef4-fe04-477a-8bb3-78a19e0e5d81 None None] MFA Rules not processed for user `8f0dd32880d14ec9990bc09685d26326`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:55:09.360273 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-86d15ef4-fe04-477a-8bb3-78a19e0e5d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:09.457222 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1092/2211] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Aug 23 01:55:09 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:55:09.516923 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb70e97-9eed-4b6c-9fb9-a1e25b43ebaf admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:09.518432 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ccb70e97-9eed-4b6c-9fb9-a1e25b43ebaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:09.656992 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb70e97-9eed-4b6c-9fb9-a1e25b43ebaf admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:09.664540 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dd6cc-4e34-45ba-b32b-dae60d3ba45e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e4cab3c8cb4a18bf3c1a8a85d1675c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:09.666427 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dd6cc-4e34-45ba-b32b-dae60d3ba45e service swift] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:09.666886 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dd6cc-4e34-45ba-b32b-dae60d3ba45e service swift] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:09.667478 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dd6cc-4e34-45ba-b32b-dae60d3ba45e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:09.682441 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3dd6cc-4e34-45ba-b32b-dae60d3ba45e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:09.715762 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3dd6cc-4e34-45ba-b32b-dae60d3ba45e service swift] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:09.726555 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1120/2212] 10.222.0.20 () {60 vars in 1385 bytes} [Mon Aug 23 01:55:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 01:55:12.143108 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8b531-6c4a-4b99-9b04-c73f37312364 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:12.143603 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8b531-6c4a-4b99-9b04-c73f37312364 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:12.143696 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8b531-6c4a-4b99-9b04-c73f37312364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:12.193877 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-42c8b531-6c4a-4b99-9b04-c73f37312364 None None] MFA Rules not processed for user `9a5a674999d04291ba10cea6cefba4b1`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:55:12.195188 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-42c8b531-6c4a-4b99-9b04-c73f37312364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:12.308249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1093/2213] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:55:12 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:55:12.312996 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dd6cc-4e34-45ba-b32b-dae60d3ba45e service swift] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:12.315512 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-df3dd6cc-4e34-45ba-b32b-dae60d3ba45e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:12.419699 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dd6cc-4e34-45ba-b32b-dae60d3ba45e service swift] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:12.425081 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4a586-725e-4c99-b07f-d252b637d0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:12.437638 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4a586-725e-4c99-b07f-d252b637d0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:12.437638 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4a586-725e-4c99-b07f-d252b637d0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:12.437638 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4a586-725e-4c99-b07f-d252b637d0f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:12.437638 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4a586-725e-4c99-b07f-d252b637d0f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:12.457181 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4a586-725e-4c99-b07f-d252b637d0f4 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:12.557012 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1121/2214] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:55:12 2021] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:55:12.561434 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8b531-6c4a-4b99-9b04-c73f37312364 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:12.576852 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8b531-6c4a-4b99-9b04-c73f37312364 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:12.665876 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bb7cf-2fce-45f3-af0b-dcd2b6543d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:12.666802 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bb7cf-2fce-45f3-af0b-dcd2b6543d73 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:12.667383 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bb7cf-2fce-45f3-af0b-dcd2b6543d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:12.667960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bb7cf-2fce-45f3-af0b-dcd2b6543d73 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:12.670032 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bb7cf-2fce-45f3-af0b-dcd2b6543d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:12.708068 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bb7cf-2fce-45f3-af0b-dcd2b6543d73 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:12.814873 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1094/2215] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:55:12 2021] POST /identity/v3/users => generated 299 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:55:12.821730 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4a586-725e-4c99-b07f-d252b637d0f4 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:12.831711 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4a586-725e-4c99-b07f-d252b637d0f4 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:12.854354 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed625013-5126-42cb-8316-adc72b5b2962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:12.855371 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed625013-5126-42cb-8316-adc72b5b2962 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:12.855855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed625013-5126-42cb-8316-adc72b5b2962 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:12.856145 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed625013-5126-42cb-8316-adc72b5b2962 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:12.856939 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed625013-5126-42cb-8316-adc72b5b2962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:12.885640 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed625013-5126-42cb-8316-adc72b5b2962 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:12.907290 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1122/2216] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:55:12 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:55:12.907787 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bb7cf-2fce-45f3-af0b-dcd2b6543d73 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:12.923927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bb7cf-2fce-45f3-af0b-dcd2b6543d73 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:12.929196 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d832e-4c0c-4e70-8d38-801d12cd34af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:12.930046 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d832e-4c0c-4e70-8d38-801d12cd34af admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:12.930515 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d832e-4c0c-4e70-8d38-801d12cd34af admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:12.930800 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d832e-4c0c-4e70-8d38-801d12cd34af admin admin] PATH_INFO: `/v3/projects/86e95ebb2d744047be79d946e14d900e/users/8279360e15b34b93bb3ff5e17dc36b3a/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:12.958038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d832e-4c0c-4e70-8d38-801d12cd34af admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e95ebb2d744047be79d946e14d900e, user_id=8279360e15b34b93bb3ff5e17dc36b3a, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:12.993049 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d832e-4c0c-4e70-8d38-801d12cd34af admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:13.064746 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1095/2217] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:55:12 2021] PUT /identity/v3/projects/86e95ebb2d744047be79d946e14d900e/users/8279360e15b34b93bb3ff5e17dc36b3a/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:55:13.068673 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed625013-5126-42cb-8316-adc72b5b2962 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:13.080078 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed625013-5126-42cb-8316-adc72b5b2962 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:13.151937 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf3e5d-0587-42ab-9a7d-2cfb80ea410b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:13.153173 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf3e5d-0587-42ab-9a7d-2cfb80ea410b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:13.153736 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf3e5d-0587-42ab-9a7d-2cfb80ea410b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:13.154151 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf3e5d-0587-42ab-9a7d-2cfb80ea410b admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:13.155640 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf3e5d-0587-42ab-9a7d-2cfb80ea410b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:13.186384 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf3e5d-0587-42ab-9a7d-2cfb80ea410b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:13.198340 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1123/2218] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:55:13 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:55:13.202685 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d832e-4c0c-4e70-8d38-801d12cd34af admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:13.220113 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d832e-4c0c-4e70-8d38-801d12cd34af admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:13.238605 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf430e2c-5f1a-4e6a-a98d-f7b6c9a05711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:13.239483 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf430e2c-5f1a-4e6a-a98d-f7b6c9a05711 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:13.239777 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf430e2c-5f1a-4e6a-a98d-f7b6c9a05711 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:13.240063 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf430e2c-5f1a-4e6a-a98d-f7b6c9a05711 admin admin] PATH_INFO: `/v3/projects/86e95ebb2d744047be79d946e14d900e/users/8279360e15b34b93bb3ff5e17dc36b3a/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:13.244439 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf430e2c-5f1a-4e6a-a98d-f7b6c9a05711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e95ebb2d744047be79d946e14d900e, user_id=8279360e15b34b93bb3ff5e17dc36b3a, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:13.272750 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf430e2c-5f1a-4e6a-a98d-f7b6c9a05711 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:13.291971 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1096/2219] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:55:13 2021] PUT /identity/v3/projects/86e95ebb2d744047be79d946e14d900e/users/8279360e15b34b93bb3ff5e17dc36b3a/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:55:13.295792 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf3e5d-0587-42ab-9a7d-2cfb80ea410b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:13.320265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf3e5d-0587-42ab-9a7d-2cfb80ea410b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:13.540533 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06efe7-5852-48cb-b24d-372ec1108a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:13.540533 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06efe7-5852-48cb-b24d-372ec1108a40 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:13.540533 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06efe7-5852-48cb-b24d-372ec1108a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:13.540533 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06efe7-5852-48cb-b24d-372ec1108a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:13.541918 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06efe7-5852-48cb-b24d-372ec1108a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:13.588460 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06efe7-5852-48cb-b24d-372ec1108a40 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:13.607869 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1124/2220] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:55:13 2021] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:55:13.622058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf430e2c-5f1a-4e6a-a98d-f7b6c9a05711 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:13.643376 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf430e2c-5f1a-4e6a-a98d-f7b6c9a05711 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:13.663488 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f721c-4d74-4fcf-9406-5d8274de7e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:13.665990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f721c-4d74-4fcf-9406-5d8274de7e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:13.666380 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f721c-4d74-4fcf-9406-5d8274de7e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:13.666761 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f721c-4d74-4fcf-9406-5d8274de7e95 admin admin] PATH_INFO: `/v3/projects/86e95ebb2d744047be79d946e14d900e/users/8279360e15b34b93bb3ff5e17dc36b3a/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:13.669204 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f721c-4d74-4fcf-9406-5d8274de7e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e95ebb2d744047be79d946e14d900e, user_id=8279360e15b34b93bb3ff5e17dc36b3a, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:13.702353 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f721c-4d74-4fcf-9406-5d8274de7e95 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:13.823318 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1097/2221] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:55:13 2021] PUT /identity/v3/projects/86e95ebb2d744047be79d946e14d900e/users/8279360e15b34b93bb3ff5e17dc36b3a/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:55:25.254159 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ccf07-c37c-4054-99f3-9a67d410345c None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:25.254697 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ccf07-c37c-4054-99f3-9a67d410345c None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:25.254978 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ccf07-c37c-4054-99f3-9a67d410345c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:25.324806 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-c26ccf07-c37c-4054-99f3-9a67d410345c None None] MFA Rules not processed for user `8279360e15b34b93bb3ff5e17dc36b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:55:25.326145 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c26ccf07-c37c-4054-99f3-9a67d410345c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:25.418750 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1125/2222] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:55:25 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:55:25.431607 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f721c-4d74-4fcf-9406-5d8274de7e95 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:25.433523 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-043f721c-4d74-4fcf-9406-5d8274de7e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:25.501882 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f721c-4d74-4fcf-9406-5d8274de7e95 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:25.505573 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666cde4-88a0-4c90-adbb-cf6725c024bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913cd471ba494382af7dda858b9010c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:25.506336 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666cde4-88a0-4c90-adbb-cf6725c024bc service glance] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:25.506771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666cde4-88a0-4c90-adbb-cf6725c024bc service glance] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:25.507221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666cde4-88a0-4c90-adbb-cf6725c024bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:25.588054 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666cde4-88a0-4c90-adbb-cf6725c024bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:25.615624 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666cde4-88a0-4c90-adbb-cf6725c024bc service glance] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:25.625638 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1098/2223] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:55:25 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:55:25.919844 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e761478-ddda-4010-81ac-7107470f148b None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:25.923207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e761478-ddda-4010-81ac-7107470f148b None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:25.923207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e761478-ddda-4010-81ac-7107470f148b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:25.952029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-3e761478-ddda-4010-81ac-7107470f148b None None] MFA Rules not processed for user `8f0dd32880d14ec9990bc09685d26326`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:55:25.953232 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-3e761478-ddda-4010-81ac-7107470f148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:26.049196 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1126/2224] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Aug 23 01:55:25 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:55:26.057774 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666cde4-88a0-4c90-adbb-cf6725c024bc service glance] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:26.216188 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666cde4-88a0-4c90-adbb-cf6725c024bc service glance] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:26.223204 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50197cd-b41f-4cee-b97e-fc174c495ab0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e4cab3c8cb4a18bf3c1a8a85d1675c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:26.224021 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50197cd-b41f-4cee-b97e-fc174c495ab0 service swift] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:26.224437 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50197cd-b41f-4cee-b97e-fc174c495ab0 service swift] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:26.224997 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50197cd-b41f-4cee-b97e-fc174c495ab0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:26.235608 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50197cd-b41f-4cee-b97e-fc174c495ab0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:26.281898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50197cd-b41f-4cee-b97e-fc174c495ab0 service swift] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:26.295968 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1099/2225] 10.222.0.20 () {60 vars in 1385 bytes} [Mon Aug 23 01:55:26 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 01:55:36.977202 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14e206-935c-446e-99d6-f4813f28673a None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:36.978123 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14e206-935c-446e-99d6-f4813f28673a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:36.978570 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14e206-935c-446e-99d6-f4813f28673a None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:36.981058 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1127/2226] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 23 01:55:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:55:36.985829 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3071c70-1636-4ebe-a761-e66710c2ba56 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:36.986352 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3071c70-1636-4ebe-a761-e66710c2ba56 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:36.986433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3071c70-1636-4ebe-a761-e66710c2ba56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:37.019789 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-e3071c70-1636-4ebe-a761-e66710c2ba56 None None] MFA Rules not processed for user `eedaf4b880f24ac48ee6e04b75059ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:55:37.021652 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-e3071c70-1636-4ebe-a761-e66710c2ba56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:37.111440 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1100/2227] 10.222.0.20 () {58 vars in 1019 bytes} [Mon Aug 23 01:55:36 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:55:37.133878 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14e206-935c-446e-99d6-f4813f28673a None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:37.136135 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-af14e206-935c-446e-99d6-f4813f28673a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:37.154225 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14e206-935c-446e-99d6-f4813f28673a None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:37.158545 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e6871-1d3c-4674-ba8b-940e06c17e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:37.159312 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e6871-1d3c-4674-ba8b-940e06c17e16 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:37.159662 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e6871-1d3c-4674-ba8b-940e06c17e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:37.160031 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e6871-1d3c-4674-ba8b-940e06c17e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:37.170065 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e6871-1d3c-4674-ba8b-940e06c17e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:37.204202 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e6871-1d3c-4674-ba8b-940e06c17e16 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:37.215713 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1128/2228] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:55:37 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:55:40.107391 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d7b31-6216-478d-9963-8989192e49f7 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:40.108062 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d7b31-6216-478d-9963-8989192e49f7 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:40.108062 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d7b31-6216-478d-9963-8989192e49f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:40.131721 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-3a0d7b31-6216-478d-9963-8989192e49f7 None None] MFA Rules not processed for user `627bb2f869634b91973d020f20d1f4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:55:40.132885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-3a0d7b31-6216-478d-9963-8989192e49f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:40.216377 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1101/2229] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:55:40 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:55:41.027359 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4ebe6-b637-4e5f-973b-4a0d1f1b2c42 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:41.027872 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4ebe6-b637-4e5f-973b-4a0d1f1b2c42 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:41.028006 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4ebe6-b637-4e5f-973b-4a0d1f1b2c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:41.146005 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-49c4ebe6-b637-4e5f-973b-4a0d1f1b2c42 None None] MFA Rules not processed for user `9a5a674999d04291ba10cea6cefba4b1`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:55:41.147172 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-49c4ebe6-b637-4e5f-973b-4a0d1f1b2c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:41.155764 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1129/2230] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:55:41 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:55:44.492183 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d7b31-6216-478d-9963-8989192e49f7 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:44.493627 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-3a0d7b31-6216-478d-9963-8989192e49f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:44.501957 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb3074-1d85-4e19-835b-a3f5fb9dcb5e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:44.502467 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb3074-1d85-4e19-835b-a3f5fb9dcb5e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:44.502558 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb3074-1d85-4e19-835b-a3f5fb9dcb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:44.537544 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-f3fb3074-1d85-4e19-835b-a3f5fb9dcb5e None None] MFA Rules not processed for user `8f0dd32880d14ec9990bc09685d26326`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:55:44.539279 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f3fb3074-1d85-4e19-835b-a3f5fb9dcb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:44.556323 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1130/2231] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Aug 23 01:55:44 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:55:44.568939 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb3074-1d85-4e19-835b-a3f5fb9dcb5e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:44.582392 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb3074-1d85-4e19-835b-a3f5fb9dcb5e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:44.588618 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35802eda-7e85-47a4-b460-8081c20cfbf1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e4cab3c8cb4a18bf3c1a8a85d1675c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:44.589570 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35802eda-7e85-47a4-b460-8081c20cfbf1 service swift] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:44.590081 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35802eda-7e85-47a4-b460-8081c20cfbf1 service swift] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:44.590806 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35802eda-7e85-47a4-b460-8081c20cfbf1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:44.608972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35802eda-7e85-47a4-b460-8081c20cfbf1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:44.635492 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35802eda-7e85-47a4-b460-8081c20cfbf1 service swift] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:44.636138 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d7b31-6216-478d-9963-8989192e49f7 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:44.642074 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae7281-baac-4b2d-8dcc-a78f6d070859 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4a6c587fd604395908134c50ce7618d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:44.642642 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae7281-baac-4b2d-8dcc-a78f6d070859 service placement] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:44.642929 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae7281-baac-4b2d-8dcc-a78f6d070859 service placement] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:44.643208 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae7281-baac-4b2d-8dcc-a78f6d070859 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:44.645089 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2eae7281-baac-4b2d-8dcc-a78f6d070859 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:44.645485 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1131/2232] 10.222.0.20 () {60 vars in 1385 bytes} [Mon Aug 23 01:55:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 01:55:44.660692 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae7281-baac-4b2d-8dcc-a78f6d070859 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:44.687817 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae7281-baac-4b2d-8dcc-a78f6d070859 service placement] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:44.698131 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1102/2233] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:55:44 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:55:58.867241 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b812a08-5837-4dff-bb22-7df34a1e6c59 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:58.868675 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b812a08-5837-4dff-bb22-7df34a1e6c59 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:58.869126 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b812a08-5837-4dff-bb22-7df34a1e6c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:58.951575 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-1b812a08-5837-4dff-bb22-7df34a1e6c59 None None] MFA Rules not processed for user `8f0dd32880d14ec9990bc09685d26326`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:55:58.953875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1b812a08-5837-4dff-bb22-7df34a1e6c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:55:58.974865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1132/2234] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Aug 23 01:55:58 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:55:58.987299 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae7281-baac-4b2d-8dcc-a78f6d070859 service placement] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:55:59.013745 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae7281-baac-4b2d-8dcc-a78f6d070859 service placement] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:55:59.019144 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa6eea-bb21-4a13-a9d6-f8d819b97393 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e4cab3c8cb4a18bf3c1a8a85d1675c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:55:59.019905 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa6eea-bb21-4a13-a9d6-f8d819b97393 service swift] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:55:59.020358 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa6eea-bb21-4a13-a9d6-f8d819b97393 service swift] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:55:59.020974 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa6eea-bb21-4a13-a9d6-f8d819b97393 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:55:59.031664 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa6eea-bb21-4a13-a9d6-f8d819b97393 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:55:59.057658 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa6eea-bb21-4a13-a9d6-f8d819b97393 service swift] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:55:59.066991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1103/2235] 10.222.0.20 () {60 vars in 1385 bytes} [Mon Aug 23 01:55:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 01:56:27.084826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0166f-efc0-4ad4-b562-40184e4b0a87 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:27.085373 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0166f-efc0-4ad4-b562-40184e4b0a87 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:27.085860 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0166f-efc0-4ad4-b562-40184e4b0a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:27.110381 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-96d0166f-efc0-4ad4-b562-40184e4b0a87 None None] MFA Rules not processed for user `8f0dd32880d14ec9990bc09685d26326`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:56:27.112590 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-96d0166f-efc0-4ad4-b562-40184e4b0a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:56:27.130550 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1133/2236] 10.222.0.20 () {58 vars in 968 bytes} [Mon Aug 23 01:56:27 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:56:27.155960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa6eea-bb21-4a13-a9d6-f8d819b97393 service swift] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:27.166613 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa6eea-bb21-4a13-a9d6-f8d819b97393 service swift] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:27.179508 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd53dac-dbec-41cb-8b86-3d74322cdcfd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e4cab3c8cb4a18bf3c1a8a85d1675c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:27.180290 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd53dac-dbec-41cb-8b86-3d74322cdcfd service swift] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:27.180785 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd53dac-dbec-41cb-8b86-3d74322cdcfd service swift] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:27.181260 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd53dac-dbec-41cb-8b86-3d74322cdcfd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:27.192509 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd53dac-dbec-41cb-8b86-3d74322cdcfd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:27.232409 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd53dac-dbec-41cb-8b86-3d74322cdcfd service swift] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:27.243208 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1104/2237] 10.222.0.20 () {60 vars in 1385 bytes} [Mon Aug 23 01:56:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 01:56:41.768291 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0166f-efc0-4ad4-b562-40184e4b0a87 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:41.769705 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-96d0166f-efc0-4ad4-b562-40184e4b0a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:56:41.840925 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0166f-efc0-4ad4-b562-40184e4b0a87 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:41.845069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62875673-4c29-4c21-a14b-97c94e48f27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:41.845861 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62875673-4c29-4c21-a14b-97c94e48f27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:41.846149 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62875673-4c29-4c21-a14b-97c94e48f27b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:41.846427 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62875673-4c29-4c21-a14b-97c94e48f27b admin admin] PATH_INFO: `/v3/users/0d118f35f5c549908cd605a753e4f93b` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:41.847505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62875673-4c29-4c21-a14b-97c94e48f27b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d118f35f5c549908cd605a753e4f93b)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:41.874252 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62875673-4c29-4c21-a14b-97c94e48f27b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:42.086126 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-62875673-4c29-4c21-a14b-97c94e48f27b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d118f35f5c549908cd605a753e4f93b'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:56:42.086814 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-62875673-4c29-4c21-a14b-97c94e48f27b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d118f35f5c549908cd605a753e4f93b'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:56:42.181818 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-62875673-4c29-4c21-a14b-97c94e48f27b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d118f35f5c549908cd605a753e4f93b'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:56:42.190009 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-62875673-4c29-4c21-a14b-97c94e48f27b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d118f35f5c549908cd605a753e4f93b'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:56:42.190605 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-62875673-4c29-4c21-a14b-97c94e48f27b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d118f35f5c549908cd605a753e4f93b'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:56:42.208210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1134/2238] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:56:41 2021] DELETE /identity/v3/users/0d118f35f5c549908cd605a753e4f93b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:56:42.596207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd53dac-dbec-41cb-8b86-3d74322cdcfd service swift] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:42.607057 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd53dac-dbec-41cb-8b86-3d74322cdcfd service swift] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:42.668358 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19902b2b-d0ac-4afc-8c76-e5bef2c35c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:42.674005 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19902b2b-d0ac-4afc-8c76-e5bef2c35c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:42.674005 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19902b2b-d0ac-4afc-8c76-e5bef2c35c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:42.674005 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19902b2b-d0ac-4afc-8c76-e5bef2c35c5b admin admin] PATH_INFO: `/v3/projects/36b9bb2944ff41d892d03e1ae5a30cd7` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:42.674005 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19902b2b-d0ac-4afc-8c76-e5bef2c35c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b9bb2944ff41d892d03e1ae5a30cd7)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:42.696740 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19902b2b-d0ac-4afc-8c76-e5bef2c35c5b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:42.795732 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-19902b2b-d0ac-4afc-8c76-e5bef2c35c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b9bb2944ff41d892d03e1ae5a30cd7', 'request_id': 'req-19902b2b-d0ac-4afc-8c76-e5bef2c35c5b'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:56:42.800621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-19902b2b-d0ac-4afc-8c76-e5bef2c35c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b9bb2944ff41d892d03e1ae5a30cd7', 'request_id': 'req-19902b2b-d0ac-4afc-8c76-e5bef2c35c5b'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:56:42.811670 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-19902b2b-d0ac-4afc-8c76-e5bef2c35c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b9bb2944ff41d892d03e1ae5a30cd7', 'request_id': 'req-19902b2b-d0ac-4afc-8c76-e5bef2c35c5b'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:56:42.883529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-19902b2b-d0ac-4afc-8c76-e5bef2c35c5b admin admin] The token cache is being invalidate because project 36b9bb2944ff41d892d03e1ae5a30cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:56:42.883809 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-19902b2b-d0ac-4afc-8c76-e5bef2c35c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:56:42.884469 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-19902b2b-d0ac-4afc-8c76-e5bef2c35c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:56:42.886176 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1105/2239] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:56:42 2021] DELETE /identity/v3/projects/36b9bb2944ff41d892d03e1ae5a30cd7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:56:42.892393 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c98fc-7b83-4936-8bfc-3d82cef5c270 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:42.892902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c98fc-7b83-4936-8bfc-3d82cef5c270 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:42.893044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c98fc-7b83-4936-8bfc-3d82cef5c270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:42.915917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-e87c98fc-7b83-4936-8bfc-3d82cef5c270 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:56:42.917070 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e87c98fc-7b83-4936-8bfc-3d82cef5c270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:56:42.983106 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1135/2240] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:56:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:56:42.990830 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc280b9-8718-4de0-983e-681bc3b3d28c None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:42.991217 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc280b9-8718-4de0-983e-681bc3b3d28c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:42.991505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc280b9-8718-4de0-983e-681bc3b3d28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:43.013809 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-9bc280b9-8718-4de0-983e-681bc3b3d28c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:56:43.014981 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-9bc280b9-8718-4de0-983e-681bc3b3d28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:56:43.022582 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1106/2241] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:56:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:56:43.026613 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c98fc-7b83-4936-8bfc-3d82cef5c270 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:43.035767 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c98fc-7b83-4936-8bfc-3d82cef5c270 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:43.040010 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d275da1-992f-40db-a2ba-83a09034571f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:43.040609 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d275da1-992f-40db-a2ba-83a09034571f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:43.041038 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d275da1-992f-40db-a2ba-83a09034571f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:43.041202 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d275da1-992f-40db-a2ba-83a09034571f admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:43.041873 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d275da1-992f-40db-a2ba-83a09034571f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:56:43.042166 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d275da1-992f-40db-a2ba-83a09034571f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:43.067158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d275da1-992f-40db-a2ba-83a09034571f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:43.080292 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1136/2242] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:56:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:56:43.085447 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc280b9-8718-4de0-983e-681bc3b3d28c None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:43.094177 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc280b9-8718-4de0-983e-681bc3b3d28c None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:43.098370 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee60ae8-5ff3-49db-b8c1-dff30bd93b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:43.098943 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee60ae8-5ff3-49db-b8c1-dff30bd93b82 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:43.099227 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee60ae8-5ff3-49db-b8c1-dff30bd93b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:43.099506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee60ae8-5ff3-49db-b8c1-dff30bd93b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:43.100166 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee60ae8-5ff3-49db-b8c1-dff30bd93b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:43.125726 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee60ae8-5ff3-49db-b8c1-dff30bd93b82 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:43.240382 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1107/2243] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:56:43 2021] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:56:43.244378 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d275da1-992f-40db-a2ba-83a09034571f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:43.253826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d275da1-992f-40db-a2ba-83a09034571f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:43.316481 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf642d0-b46b-4a54-9e54-ca4bc9ed4b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:43.317119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf642d0-b46b-4a54-9e54-ca4bc9ed4b2c admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:43.317429 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf642d0-b46b-4a54-9e54-ca4bc9ed4b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:43.318306 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf642d0-b46b-4a54-9e54-ca4bc9ed4b2c admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:43.318948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf642d0-b46b-4a54-9e54-ca4bc9ed4b2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:43.344150 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf642d0-b46b-4a54-9e54-ca4bc9ed4b2c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:43.445195 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1137/2244] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:56:43 2021] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:56:43.449507 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee60ae8-5ff3-49db-b8c1-dff30bd93b82 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:43.459222 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee60ae8-5ff3-49db-b8c1-dff30bd93b82 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:43.463356 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a5ae8-bf96-4564-9bfb-a1648f46f397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:43.464004 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a5ae8-bf96-4564-9bfb-a1648f46f397 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:43.464355 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a5ae8-bf96-4564-9bfb-a1648f46f397 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:43.464733 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a5ae8-bf96-4564-9bfb-a1648f46f397 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:43.465522 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a5ae8-bf96-4564-9bfb-a1648f46f397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:43.491305 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a5ae8-bf96-4564-9bfb-a1648f46f397 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:43.501671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1108/2245] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:56:43 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:56:43.506692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf642d0-b46b-4a54-9e54-ca4bc9ed4b2c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:43.516056 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf642d0-b46b-4a54-9e54-ca4bc9ed4b2c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:43.520433 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5739b-90e9-4723-b73b-85447fc27a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:43.521274 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5739b-90e9-4723-b73b-85447fc27a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:43.521560 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5739b-90e9-4723-b73b-85447fc27a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:43.521841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5739b-90e9-4723-b73b-85447fc27a94 admin admin] PATH_INFO: `/v3/projects/2d3796a5f61e4ea0aa1b6d2758cc44e1/users/4e066a39278e4640a254741f41c7ae10/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:43.541244 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5739b-90e9-4723-b73b-85447fc27a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3796a5f61e4ea0aa1b6d2758cc44e1, user_id=4e066a39278e4640a254741f41c7ae10, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:43.569090 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5739b-90e9-4723-b73b-85447fc27a94 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:43.659072 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1138/2246] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:56:43 2021] PUT /identity/v3/projects/2d3796a5f61e4ea0aa1b6d2758cc44e1/users/4e066a39278e4640a254741f41c7ae10/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:56:43.670392 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdf7d2-7ad9-420d-8b94-bbf233d42bde None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:43.670899 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdf7d2-7ad9-420d-8b94-bbf233d42bde None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:43.670899 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdf7d2-7ad9-420d-8b94-bbf233d42bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:43.708838 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-43cdf7d2-7ad9-420d-8b94-bbf233d42bde None None] MFA Rules not processed for user `4e066a39278e4640a254741f41c7ae10`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:56:43.710098 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-43cdf7d2-7ad9-420d-8b94-bbf233d42bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:56:43.778845 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1109/2247] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:56:43 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:56:43.783405 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5739b-90e9-4723-b73b-85447fc27a94 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:43.851233 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5739b-90e9-4723-b73b-85447fc27a94 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:43.855394 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40a63e-7f97-44a5-bd72-ed67f590ea95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:43.855982 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40a63e-7f97-44a5-bd72-ed67f590ea95 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:43.856267 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40a63e-7f97-44a5-bd72-ed67f590ea95 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:43.856545 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40a63e-7f97-44a5-bd72-ed67f590ea95 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:43.857209 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40a63e-7f97-44a5-bd72-ed67f590ea95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:43.882967 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40a63e-7f97-44a5-bd72-ed67f590ea95 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:44.000080 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1139/2248] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:56:43 2021] POST /identity/v3/projects => generated 373 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:56:44.004299 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdf7d2-7ad9-420d-8b94-bbf233d42bde None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:44.014361 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdf7d2-7ad9-420d-8b94-bbf233d42bde None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:44.078121 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32784f13-6b7e-4c09-96ce-9f55741d3df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:44.080063 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32784f13-6b7e-4c09-96ce-9f55741d3df0 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:44.080063 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32784f13-6b7e-4c09-96ce-9f55741d3df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:44.080063 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32784f13-6b7e-4c09-96ce-9f55741d3df0 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:44.080063 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32784f13-6b7e-4c09-96ce-9f55741d3df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:44.106935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32784f13-6b7e-4c09-96ce-9f55741d3df0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:44.215983 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1110/2249] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:56:44 2021] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:56:44.220095 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40a63e-7f97-44a5-bd72-ed67f590ea95 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:44.230143 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40a63e-7f97-44a5-bd72-ed67f590ea95 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:44.234307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d72dd-9944-40bd-b1e1-b69e46f017fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:44.236947 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d72dd-9944-40bd-b1e1-b69e46f017fc admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:44.236947 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d72dd-9944-40bd-b1e1-b69e46f017fc admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:44.236947 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d72dd-9944-40bd-b1e1-b69e46f017fc admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:44.236947 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d72dd-9944-40bd-b1e1-b69e46f017fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:44.265562 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d72dd-9944-40bd-b1e1-b69e46f017fc admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:44.272673 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1140/2250] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:56:44 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:56:44.276759 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32784f13-6b7e-4c09-96ce-9f55741d3df0 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:44.286888 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32784f13-6b7e-4c09-96ce-9f55741d3df0 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:44.291080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41e7a8-717b-4d14-8f1d-23f179e692cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:44.291885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e7a8-717b-4d14-8f1d-23f179e692cf admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:44.292171 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e7a8-717b-4d14-8f1d-23f179e692cf admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:44.292446 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e7a8-717b-4d14-8f1d-23f179e692cf admin admin] PATH_INFO: `/v3/projects/90e93e75eba04d41b8e8788b952b24a1/users/500c09b3044745a2b8b48b59b00b3621/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:44.311831 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41e7a8-717b-4d14-8f1d-23f179e692cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e93e75eba04d41b8e8788b952b24a1, user_id=500c09b3044745a2b8b48b59b00b3621, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:44.338658 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41e7a8-717b-4d14-8f1d-23f179e692cf admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:44.465527 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1111/2251] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:56:44 2021] PUT /identity/v3/projects/90e93e75eba04d41b8e8788b952b24a1/users/500c09b3044745a2b8b48b59b00b3621/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:56:44.469504 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d72dd-9944-40bd-b1e1-b69e46f017fc admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:44.479864 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d72dd-9944-40bd-b1e1-b69e46f017fc admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:44.543794 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d97b45-b4b7-4da3-ad02-0f543e447cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:44.544393 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d97b45-b4b7-4da3-ad02-0f543e447cfb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:44.544722 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d97b45-b4b7-4da3-ad02-0f543e447cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:44.545000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d97b45-b4b7-4da3-ad02-0f543e447cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:44.545684 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d97b45-b4b7-4da3-ad02-0f543e447cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:44.572379 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d97b45-b4b7-4da3-ad02-0f543e447cfb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:44.582667 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1141/2252] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:56:44 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:56:44.586897 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41e7a8-717b-4d14-8f1d-23f179e692cf admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:44.597385 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41e7a8-717b-4d14-8f1d-23f179e692cf admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:44.603402 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9809b-ddac-4681-acd2-19f212f02018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:44.604222 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9809b-ddac-4681-acd2-19f212f02018 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:44.604534 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9809b-ddac-4681-acd2-19f212f02018 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:44.604845 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9809b-ddac-4681-acd2-19f212f02018 admin admin] PATH_INFO: `/v3/projects/90e93e75eba04d41b8e8788b952b24a1/users/500c09b3044745a2b8b48b59b00b3621/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:44.606615 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9809b-ddac-4681-acd2-19f212f02018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e93e75eba04d41b8e8788b952b24a1, user_id=500c09b3044745a2b8b48b59b00b3621, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:44.633763 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9809b-ddac-4681-acd2-19f212f02018 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:44.644467 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1112/2253] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:56:44 2021] PUT /identity/v3/projects/90e93e75eba04d41b8e8788b952b24a1/users/500c09b3044745a2b8b48b59b00b3621/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:56:44.648505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d97b45-b4b7-4da3-ad02-0f543e447cfb admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:44.662793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d97b45-b4b7-4da3-ad02-0f543e447cfb admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:44.723654 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976455c-cb15-456b-9272-61554e855359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:44.724267 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976455c-cb15-456b-9272-61554e855359 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:44.724575 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976455c-cb15-456b-9272-61554e855359 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:44.724864 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976455c-cb15-456b-9272-61554e855359 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:44.725556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976455c-cb15-456b-9272-61554e855359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:44.750695 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976455c-cb15-456b-9272-61554e855359 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:44.762070 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1142/2254] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:56:44 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:56:44.765816 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9809b-ddac-4681-acd2-19f212f02018 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:44.777227 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9809b-ddac-4681-acd2-19f212f02018 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:44.781776 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d226f-b755-42a3-9880-787bf094f748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:44.782657 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d226f-b755-42a3-9880-787bf094f748 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:44.783052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d226f-b755-42a3-9880-787bf094f748 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:44.783394 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d226f-b755-42a3-9880-787bf094f748 admin admin] PATH_INFO: `/v3/projects/90e93e75eba04d41b8e8788b952b24a1/users/500c09b3044745a2b8b48b59b00b3621/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:44.785304 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d226f-b755-42a3-9880-787bf094f748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e93e75eba04d41b8e8788b952b24a1, user_id=500c09b3044745a2b8b48b59b00b3621, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:44.812982 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d226f-b755-42a3-9880-787bf094f748 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:44.886344 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1113/2255] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:56:44 2021] PUT /identity/v3/projects/90e93e75eba04d41b8e8788b952b24a1/users/500c09b3044745a2b8b48b59b00b3621/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:56:44.897122 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f9ed0-e06f-4369-86e8-595b840b878d None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:44.897485 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f9ed0-e06f-4369-86e8-595b840b878d None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:44.897827 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f9ed0-e06f-4369-86e8-595b840b878d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:44.931670 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d226f-b755-42a3-9880-787bf094f748 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:44.933335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5f9d226f-b755-42a3-9880-787bf094f748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:56:44.943511 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-c34f9ed0-e06f-4369-86e8-595b840b878d None None] MFA Rules not processed for user `500c09b3044745a2b8b48b59b00b3621`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:56:44.944706 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c34f9ed0-e06f-4369-86e8-595b840b878d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:56:44.998238 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d226f-b755-42a3-9880-787bf094f748 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:45.002064 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d4d08-28b3-4f96-9eed-ae1c30903bcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:45.002290 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d4d08-28b3-4f96-9eed-ae1c30903bcd service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:45.002559 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d4d08-28b3-4f96-9eed-ae1c30903bcd service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:45.002840 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d4d08-28b3-4f96-9eed-ae1c30903bcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:45.004514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-248d4d08-28b3-4f96-9eed-ae1c30903bcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:56:45.022141 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1143/2256] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:56:44 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:56:45.036855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f9ed0-e06f-4369-86e8-595b840b878d None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:45.036855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c34f9ed0-e06f-4369-86e8-595b840b878d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:56:45.074497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d4d08-28b3-4f96-9eed-ae1c30903bcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:45.101378 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d4d08-28b3-4f96-9eed-ae1c30903bcd service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:45.111281 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1114/2257] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:56:44 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:56:45.125434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f9ed0-e06f-4369-86e8-595b840b878d None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:45.128895 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6cc55-d064-42e0-b335-6ad00f0cfcf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:45.129467 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6cc55-d064-42e0-b335-6ad00f0cfcf4 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:45.129750 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6cc55-d064-42e0-b335-6ad00f0cfcf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:45.130048 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6cc55-d064-42e0-b335-6ad00f0cfcf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:45.138671 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6cc55-d064-42e0-b335-6ad00f0cfcf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:45.166315 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6cc55-d064-42e0-b335-6ad00f0cfcf4 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:45.184903 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1144/2258] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:56:45 2021] GET /identity/v3/auth/tokens => generated 3747 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:56:45.495393 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d4d08-28b3-4f96-9eed-ae1c30903bcd service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:56:45.504726 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d4d08-28b3-4f96-9eed-ae1c30903bcd service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:56:45.508695 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffc16b-06f7-4a94-915f-4d4733e19af5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:56:45.509271 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffc16b-06f7-4a94-915f-4d4733e19af5 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:56:45.509559 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffc16b-06f7-4a94-915f-4d4733e19af5 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:56:45.509840 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffc16b-06f7-4a94-915f-4d4733e19af5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:56:45.578303 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffc16b-06f7-4a94-915f-4d4733e19af5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:56:45.604026 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffc16b-06f7-4a94-915f-4d4733e19af5 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:56:45.614976 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1115/2259] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:56:45 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:57:15.431753 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6cc55-d064-42e0-b335-6ad00f0cfcf4 service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:15.436050 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-20b6cc55-d064-42e0-b335-6ad00f0cfcf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:15.503875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6cc55-d064-42e0-b335-6ad00f0cfcf4 service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:15.508360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4664a-e99c-4c40-a4f6-f76098cda3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:15.509201 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4664a-e99c-4c40-a4f6-f76098cda3ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:15.509488 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4664a-e99c-4c40-a4f6-f76098cda3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:15.509773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4664a-e99c-4c40-a4f6-f76098cda3ed admin admin] PATH_INFO: `/v3/users/627bb2f869634b91973d020f20d1f4b0` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:15.510900 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4664a-e99c-4c40-a4f6-f76098cda3ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=627bb2f869634b91973d020f20d1f4b0)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:15.537387 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4664a-e99c-4c40-a4f6-f76098cda3ed admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:15.759179 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-9cd4664a-e99c-4c40-a4f6-f76098cda3ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627bb2f869634b91973d020f20d1f4b0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:15.759804 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-9cd4664a-e99c-4c40-a4f6-f76098cda3ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627bb2f869634b91973d020f20d1f4b0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:15.882028 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-9cd4664a-e99c-4c40-a4f6-f76098cda3ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627bb2f869634b91973d020f20d1f4b0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:15.893588 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-9cd4664a-e99c-4c40-a4f6-f76098cda3ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627bb2f869634b91973d020f20d1f4b0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:15.896039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-9cd4664a-e99c-4c40-a4f6-f76098cda3ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627bb2f869634b91973d020f20d1f4b0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:15.913349 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1145/2260] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:57:15 2021] DELETE /identity/v3/users/627bb2f869634b91973d020f20d1f4b0 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:16.448121 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffc16b-06f7-4a94-915f-4d4733e19af5 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:16.458310 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffc16b-06f7-4a94-915f-4d4733e19af5 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:16.521930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d760e53-257b-40a0-8f18-9b9276c84c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:16.522706 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d760e53-257b-40a0-8f18-9b9276c84c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:16.522992 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d760e53-257b-40a0-8f18-9b9276c84c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:16.523268 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d760e53-257b-40a0-8f18-9b9276c84c23 admin admin] PATH_INFO: `/v3/projects/a7d76269b9b84905a47232cf7b258150` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:16.524332 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d760e53-257b-40a0-8f18-9b9276c84c23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7d76269b9b84905a47232cf7b258150)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:16.550089 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d760e53-257b-40a0-8f18-9b9276c84c23 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:16.658532 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5d760e53-257b-40a0-8f18-9b9276c84c23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7d76269b9b84905a47232cf7b258150', 'request_id': 'req-5d760e53-257b-40a0-8f18-9b9276c84c23'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:16.664327 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5d760e53-257b-40a0-8f18-9b9276c84c23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7d76269b9b84905a47232cf7b258150', 'request_id': 'req-5d760e53-257b-40a0-8f18-9b9276c84c23'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:16.676306 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5d760e53-257b-40a0-8f18-9b9276c84c23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7d76269b9b84905a47232cf7b258150', 'request_id': 'req-5d760e53-257b-40a0-8f18-9b9276c84c23'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:16.775106 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5d760e53-257b-40a0-8f18-9b9276c84c23 admin admin] The token cache is being invalidate because project a7d76269b9b84905a47232cf7b258150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:57:16.775483 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5d760e53-257b-40a0-8f18-9b9276c84c23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:16.776172 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5d760e53-257b-40a0-8f18-9b9276c84c23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:16.777660 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1116/2261] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:57:16 2021] DELETE /identity/v3/projects/a7d76269b9b84905a47232cf7b258150 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:16.783376 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0fc8c-099e-4c0c-8b46-e177d556bfad None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:16.783856 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0fc8c-099e-4c0c-8b46-e177d556bfad None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:16.783971 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0fc8c-099e-4c0c-8b46-e177d556bfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:16.807684 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-bde0fc8c-099e-4c0c-8b46-e177d556bfad None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:16.808870 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-bde0fc8c-099e-4c0c-8b46-e177d556bfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:16.874597 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1146/2262] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:16.882485 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ee368-92ec-47f8-a095-86efd6c0a7e6 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:16.882805 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ee368-92ec-47f8-a095-86efd6c0a7e6 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:16.883073 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ee368-92ec-47f8-a095-86efd6c0a7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:16.904757 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-824ee368-92ec-47f8-a095-86efd6c0a7e6 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:16.905897 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-824ee368-92ec-47f8-a095-86efd6c0a7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:16.913334 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1117/2263] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:16.917368 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0fc8c-099e-4c0c-8b46-e177d556bfad None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:16.927013 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0fc8c-099e-4c0c-8b46-e177d556bfad None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:16.931482 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db6a1c-f06b-42d5-acdd-ffa003bce3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:16.932089 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db6a1c-f06b-42d5-acdd-ffa003bce3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:16.932375 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db6a1c-f06b-42d5-acdd-ffa003bce3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:16.932699 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db6a1c-f06b-42d5-acdd-ffa003bce3b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:16.933380 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db6a1c-f06b-42d5-acdd-ffa003bce3b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:57:16.933675 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db6a1c-f06b-42d5-acdd-ffa003bce3b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:16.958491 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db6a1c-f06b-42d5-acdd-ffa003bce3b9 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:16.970869 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1147/2264] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:57:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:57:16.975576 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ee368-92ec-47f8-a095-86efd6c0a7e6 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:16.984107 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ee368-92ec-47f8-a095-86efd6c0a7e6 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:16.989022 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c1748-4500-49dc-8f0b-4e3c521b28b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:16.989589 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c1748-4500-49dc-8f0b-4e3c521b28b0 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:16.989873 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c1748-4500-49dc-8f0b-4e3c521b28b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:16.990151 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c1748-4500-49dc-8f0b-4e3c521b28b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:16.990785 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c1748-4500-49dc-8f0b-4e3c521b28b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:17.016227 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c1748-4500-49dc-8f0b-4e3c521b28b0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:17.128616 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1118/2265] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:57:16 2021] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:57:17.132903 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db6a1c-f06b-42d5-acdd-ffa003bce3b9 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:17.142395 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db6a1c-f06b-42d5-acdd-ffa003bce3b9 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:17.208451 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3cb8b-7bc9-4ebe-b78d-e18f87b30f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:17.208854 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3cb8b-7bc9-4ebe-b78d-e18f87b30f31 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:17.209138 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3cb8b-7bc9-4ebe-b78d-e18f87b30f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:17.209417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3cb8b-7bc9-4ebe-b78d-e18f87b30f31 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:17.210065 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3cb8b-7bc9-4ebe-b78d-e18f87b30f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:17.235950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3cb8b-7bc9-4ebe-b78d-e18f87b30f31 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:17.353251 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1148/2266] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:57:17 2021] POST /identity/v3/users => generated 283 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:57:17.357497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c1748-4500-49dc-8f0b-4e3c521b28b0 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:17.367203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c1748-4500-49dc-8f0b-4e3c521b28b0 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:17.371459 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe7488-2026-46f9-ba30-9e2f67e50565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:17.372018 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe7488-2026-46f9-ba30-9e2f67e50565 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:17.372304 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe7488-2026-46f9-ba30-9e2f67e50565 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:17.372668 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe7488-2026-46f9-ba30-9e2f67e50565 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:17.373361 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe7488-2026-46f9-ba30-9e2f67e50565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:17.399073 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe7488-2026-46f9-ba30-9e2f67e50565 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:17.409602 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1119/2267] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:57:17 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:57:17.414432 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3cb8b-7bc9-4ebe-b78d-e18f87b30f31 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:17.423980 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3cb8b-7bc9-4ebe-b78d-e18f87b30f31 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:17.428214 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca707c2f-bf89-4879-a077-8f84a5c83894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:17.429169 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca707c2f-bf89-4879-a077-8f84a5c83894 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:17.429457 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca707c2f-bf89-4879-a077-8f84a5c83894 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:17.429738 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca707c2f-bf89-4879-a077-8f84a5c83894 admin admin] PATH_INFO: `/v3/projects/f747c69359614cb5816574fb5cc9803d/users/ddc236b9436c40cea5b49800d7371886/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:17.450710 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca707c2f-bf89-4879-a077-8f84a5c83894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f747c69359614cb5816574fb5cc9803d, user_id=ddc236b9436c40cea5b49800d7371886, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:17.477587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca707c2f-bf89-4879-a077-8f84a5c83894 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:17.581490 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1149/2268] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:57:17 2021] PUT /identity/v3/projects/f747c69359614cb5816574fb5cc9803d/users/ddc236b9436c40cea5b49800d7371886/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:57:17.592446 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23eaf5f-d12e-4d25-b8ae-d131b3904fdd None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:17.592967 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23eaf5f-d12e-4d25-b8ae-d131b3904fdd None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:17.593084 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23eaf5f-d12e-4d25-b8ae-d131b3904fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:17.627641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-f23eaf5f-d12e-4d25-b8ae-d131b3904fdd None None] MFA Rules not processed for user `ddc236b9436c40cea5b49800d7371886`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:17.629265 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-f23eaf5f-d12e-4d25-b8ae-d131b3904fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:17.698124 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1120/2269] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:17 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:17.702485 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca707c2f-bf89-4879-a077-8f84a5c83894 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:17.769307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca707c2f-bf89-4879-a077-8f84a5c83894 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:17.774156 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a2dc6-1b2d-4fbd-9f0e-b4c56852ab35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:17.774776 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a2dc6-1b2d-4fbd-9f0e-b4c56852ab35 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:17.775061 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a2dc6-1b2d-4fbd-9f0e-b4c56852ab35 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:17.775343 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a2dc6-1b2d-4fbd-9f0e-b4c56852ab35 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:17.776005 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a2dc6-1b2d-4fbd-9f0e-b4c56852ab35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:17.802071 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a2dc6-1b2d-4fbd-9f0e-b4c56852ab35 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:17.894228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1150/2270] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:57:17 2021] POST /identity/v3/projects => generated 365 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:57:17.898310 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23eaf5f-d12e-4d25-b8ae-d131b3904fdd None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:17.908381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23eaf5f-d12e-4d25-b8ae-d131b3904fdd None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:17.973233 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cc0dd-4af2-48a6-a921-eb84c7e1a479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:17.973841 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cc0dd-4af2-48a6-a921-eb84c7e1a479 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:17.974131 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cc0dd-4af2-48a6-a921-eb84c7e1a479 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:17.974465 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cc0dd-4af2-48a6-a921-eb84c7e1a479 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:17.975104 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cc0dd-4af2-48a6-a921-eb84c7e1a479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:18.000972 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cc0dd-4af2-48a6-a921-eb84c7e1a479 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:18.082229 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1121/2271] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:57:17 2021] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:57:18.088379 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a2dc6-1b2d-4fbd-9f0e-b4c56852ab35 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:18.099309 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a2dc6-1b2d-4fbd-9f0e-b4c56852ab35 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:18.103430 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c08f95-2d3d-49dd-bed1-7dd613b68bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:18.104005 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c08f95-2d3d-49dd-bed1-7dd613b68bdb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:18.104303 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c08f95-2d3d-49dd-bed1-7dd613b68bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:18.104585 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c08f95-2d3d-49dd-bed1-7dd613b68bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:18.105297 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c08f95-2d3d-49dd-bed1-7dd613b68bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:18.130595 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c08f95-2d3d-49dd-bed1-7dd613b68bdb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:18.141390 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1151/2272] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:57:18 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:57:18.146038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cc0dd-4af2-48a6-a921-eb84c7e1a479 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:18.155658 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cc0dd-4af2-48a6-a921-eb84c7e1a479 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:18.159916 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146ae98-1a7f-4a88-8f4a-5298a4e5aca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:18.161449 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146ae98-1a7f-4a88-8f4a-5298a4e5aca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:18.169308 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146ae98-1a7f-4a88-8f4a-5298a4e5aca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:18.169308 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146ae98-1a7f-4a88-8f4a-5298a4e5aca5 admin admin] PATH_INFO: `/v3/projects/76983db435694a339ecef4925dae383c/users/8642272ffbd94bbba462ff851a7bc2b5/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:18.260314 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146ae98-1a7f-4a88-8f4a-5298a4e5aca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76983db435694a339ecef4925dae383c, user_id=8642272ffbd94bbba462ff851a7bc2b5, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:18.286886 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146ae98-1a7f-4a88-8f4a-5298a4e5aca5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:18.369424 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1122/2273] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:57:18 2021] PUT /identity/v3/projects/76983db435694a339ecef4925dae383c/users/8642272ffbd94bbba462ff851a7bc2b5/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:18.373479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c08f95-2d3d-49dd-bed1-7dd613b68bdb admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:18.383750 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c08f95-2d3d-49dd-bed1-7dd613b68bdb admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:18.444764 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c40db-ed73-4263-9442-d2588e3a67af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:18.445366 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c40db-ed73-4263-9442-d2588e3a67af admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:18.445653 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c40db-ed73-4263-9442-d2588e3a67af admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:18.445934 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c40db-ed73-4263-9442-d2588e3a67af admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:18.446621 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c40db-ed73-4263-9442-d2588e3a67af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:18.472169 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c40db-ed73-4263-9442-d2588e3a67af admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:18.482498 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1152/2274] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:57:18 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:57:18.486650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146ae98-1a7f-4a88-8f4a-5298a4e5aca5 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:18.496980 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146ae98-1a7f-4a88-8f4a-5298a4e5aca5 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:18.501202 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60ff89-d7aa-4e7b-be02-0e1998d90fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:18.501996 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60ff89-d7aa-4e7b-be02-0e1998d90fba admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:18.502282 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60ff89-d7aa-4e7b-be02-0e1998d90fba admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:18.502562 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60ff89-d7aa-4e7b-be02-0e1998d90fba admin admin] PATH_INFO: `/v3/projects/76983db435694a339ecef4925dae383c/users/8642272ffbd94bbba462ff851a7bc2b5/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:18.504873 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60ff89-d7aa-4e7b-be02-0e1998d90fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=76983db435694a339ecef4925dae383c, user_id=8642272ffbd94bbba462ff851a7bc2b5, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:18.531345 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60ff89-d7aa-4e7b-be02-0e1998d90fba admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:18.541004 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1123/2275] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:57:18 2021] PUT /identity/v3/projects/76983db435694a339ecef4925dae383c/users/8642272ffbd94bbba462ff851a7bc2b5/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:57:18.544706 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c40db-ed73-4263-9442-d2588e3a67af admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:18.554498 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c40db-ed73-4263-9442-d2588e3a67af admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:18.616361 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b58db4-d996-44f3-90df-c741f4b6e903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:18.616998 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b58db4-d996-44f3-90df-c741f4b6e903 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:18.621436 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b58db4-d996-44f3-90df-c741f4b6e903 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:18.621436 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b58db4-d996-44f3-90df-c741f4b6e903 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:18.621436 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b58db4-d996-44f3-90df-c741f4b6e903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:18.644155 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b58db4-d996-44f3-90df-c741f4b6e903 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:18.654233 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1153/2276] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:57:18 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:57:18.658410 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60ff89-d7aa-4e7b-be02-0e1998d90fba admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:18.669082 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60ff89-d7aa-4e7b-be02-0e1998d90fba admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:18.673455 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c0550-2a4f-4d31-802a-545d8c5a498d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:18.674151 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c0550-2a4f-4d31-802a-545d8c5a498d admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:18.674437 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c0550-2a4f-4d31-802a-545d8c5a498d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:18.674719 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c0550-2a4f-4d31-802a-545d8c5a498d admin admin] PATH_INFO: `/v3/projects/76983db435694a339ecef4925dae383c/users/8642272ffbd94bbba462ff851a7bc2b5/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:18.677022 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c0550-2a4f-4d31-802a-545d8c5a498d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76983db435694a339ecef4925dae383c, user_id=8642272ffbd94bbba462ff851a7bc2b5, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:18.703747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c0550-2a4f-4d31-802a-545d8c5a498d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:18.768866 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1124/2277] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:57:18 2021] PUT /identity/v3/projects/76983db435694a339ecef4925dae383c/users/8642272ffbd94bbba462ff851a7bc2b5/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:18.778776 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c45d1-8234-490f-ad15-8a10b5875c17 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:18.779069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c45d1-8234-490f-ad15-8a10b5875c17 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:18.779354 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c45d1-8234-490f-ad15-8a10b5875c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:18.816112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-cb0c45d1-8234-490f-ad15-8a10b5875c17 None None] MFA Rules not processed for user `8642272ffbd94bbba462ff851a7bc2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:18.819163 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-cb0c45d1-8234-490f-ad15-8a10b5875c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:18.891317 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1154/2278] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:18 2021] POST /identity/v3/auth/tokens => generated 3739 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:18.901792 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c0550-2a4f-4d31-802a-545d8c5a498d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:18.903393 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-092c0550-2a4f-4d31-802a-545d8c5a498d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:18.971977 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c0550-2a4f-4d31-802a-545d8c5a498d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:18.975372 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f18ba6-c081-4a74-89e3-7d4099a1c223 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:18.976290 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f18ba6-c081-4a74-89e3-7d4099a1c223 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:18.976290 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f18ba6-c081-4a74-89e3-7d4099a1c223 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:18.976486 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f18ba6-c081-4a74-89e3-7d4099a1c223 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:18.985662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f18ba6-c081-4a74-89e3-7d4099a1c223 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:19.011814 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f18ba6-c081-4a74-89e3-7d4099a1c223 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:19.022249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1125/2279] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:18 2021] GET /identity/v3/auth/tokens => generated 3739 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:57:19.421476 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c45d1-8234-490f-ad15-8a10b5875c17 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:19.431460 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c45d1-8234-490f-ad15-8a10b5875c17 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:19.435980 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372572b0-f019-427c-b3b4-68b49e513225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:19.436654 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372572b0-f019-427c-b3b4-68b49e513225 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:19.436945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372572b0-f019-427c-b3b4-68b49e513225 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:19.437224 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372572b0-f019-427c-b3b4-68b49e513225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:19.513587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372572b0-f019-427c-b3b4-68b49e513225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:19.536041 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372572b0-f019-427c-b3b4-68b49e513225 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:19.545308 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1155/2280] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:19 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:57:28.078725 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f18ba6-c081-4a74-89e3-7d4099a1c223 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:28.190758 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f18ba6-c081-4a74-89e3-7d4099a1c223 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:28.194975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033080f-0e1d-4ebe-a32a-a9896a6032f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:28.195768 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033080f-0e1d-4ebe-a32a-a9896a6032f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:28.196044 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033080f-0e1d-4ebe-a32a-a9896a6032f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:28.196406 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033080f-0e1d-4ebe-a32a-a9896a6032f4 admin admin] PATH_INFO: `/v3/users/ddc236b9436c40cea5b49800d7371886` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:28.197727 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033080f-0e1d-4ebe-a32a-a9896a6032f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddc236b9436c40cea5b49800d7371886)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:28.224515 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033080f-0e1d-4ebe-a32a-a9896a6032f4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:28.538665 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b033080f-0e1d-4ebe-a32a-a9896a6032f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddc236b9436c40cea5b49800d7371886'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:28.643303 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b033080f-0e1d-4ebe-a32a-a9896a6032f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddc236b9436c40cea5b49800d7371886'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:28.644385 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b033080f-0e1d-4ebe-a32a-a9896a6032f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddc236b9436c40cea5b49800d7371886'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:28.652660 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b033080f-0e1d-4ebe-a32a-a9896a6032f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddc236b9436c40cea5b49800d7371886'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:28.653862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b033080f-0e1d-4ebe-a32a-a9896a6032f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddc236b9436c40cea5b49800d7371886'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:28.670785 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1126/2281] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:57:28 2021] DELETE /identity/v3/users/ddc236b9436c40cea5b49800d7371886 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:28.675268 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6524de4-4ff3-4529-8842-0baee9643643 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:28.675719 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6524de4-4ff3-4529-8842-0baee9643643 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:28.675828 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6524de4-4ff3-4529-8842-0baee9643643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:28.699497 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-c6524de4-4ff3-4529-8842-0baee9643643 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:28.700851 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c6524de4-4ff3-4529-8842-0baee9643643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:28.772486 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1156/2282] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:57:28.784111 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033080f-0e1d-4ebe-a32a-a9896a6032f4 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:28.785511 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-b033080f-0e1d-4ebe-a32a-a9896a6032f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:28.849003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033080f-0e1d-4ebe-a32a-a9896a6032f4 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:28.852275 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa17dc-8d2c-4f34-adee-9ea3cf5c1cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:28.852984 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa17dc-8d2c-4f34-adee-9ea3cf5c1cab service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:28.853209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa17dc-8d2c-4f34-adee-9ea3cf5c1cab service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:28.853471 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa17dc-8d2c-4f34-adee-9ea3cf5c1cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:28.862872 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa17dc-8d2c-4f34-adee-9ea3cf5c1cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:28.889157 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa17dc-8d2c-4f34-adee-9ea3cf5c1cab service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:28.900512 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1127/2283] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:57:29.485869 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6524de4-4ff3-4529-8842-0baee9643643 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:29.487183 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c6524de4-4ff3-4529-8842-0baee9643643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:29.501366 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6524de4-4ff3-4529-8842-0baee9643643 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:29.504160 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54abe2-999c-4bc1-a04c-04606b5fce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:29.513002 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54abe2-999c-4bc1-a04c-04606b5fce9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:29.513387 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54abe2-999c-4bc1-a04c-04606b5fce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:29.513755 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54abe2-999c-4bc1-a04c-04606b5fce9b admin admin] PATH_INFO: `/v3/projects/f747c69359614cb5816574fb5cc9803d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:29.514984 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54abe2-999c-4bc1-a04c-04606b5fce9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f747c69359614cb5816574fb5cc9803d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:29.541868 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54abe2-999c-4bc1-a04c-04606b5fce9b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:29.726032 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-cf54abe2-999c-4bc1-a04c-04606b5fce9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f747c69359614cb5816574fb5cc9803d', 'request_id': 'req-cf54abe2-999c-4bc1-a04c-04606b5fce9b'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:29.731437 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-cf54abe2-999c-4bc1-a04c-04606b5fce9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f747c69359614cb5816574fb5cc9803d', 'request_id': 'req-cf54abe2-999c-4bc1-a04c-04606b5fce9b'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:29.742520 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-cf54abe2-999c-4bc1-a04c-04606b5fce9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f747c69359614cb5816574fb5cc9803d', 'request_id': 'req-cf54abe2-999c-4bc1-a04c-04606b5fce9b'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:29.838896 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-cf54abe2-999c-4bc1-a04c-04606b5fce9b admin admin] The token cache is being invalidate because project f747c69359614cb5816574fb5cc9803d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:57:29.839271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-cf54abe2-999c-4bc1-a04c-04606b5fce9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:29.839989 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-cf54abe2-999c-4bc1-a04c-04606b5fce9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:29.841587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1157/2284] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:57:29 2021] DELETE /identity/v3/projects/f747c69359614cb5816574fb5cc9803d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:29.847236 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa17dc-8d2c-4f34-adee-9ea3cf5c1cab service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:29.860282 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa17dc-8d2c-4f34-adee-9ea3cf5c1cab service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:29.923844 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938a625-b91d-4fb6-bdac-c202e632c17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:29.924614 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938a625-b91d-4fb6-bdac-c202e632c17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:29.924906 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938a625-b91d-4fb6-bdac-c202e632c17f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:29.925682 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938a625-b91d-4fb6-bdac-c202e632c17f admin admin] PATH_INFO: `/v3/users/8642272ffbd94bbba462ff851a7bc2b5` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:29.926832 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938a625-b91d-4fb6-bdac-c202e632c17f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8642272ffbd94bbba462ff851a7bc2b5)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:29.954650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938a625-b91d-4fb6-bdac-c202e632c17f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:30.174816 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0938a625-b91d-4fb6-bdac-c202e632c17f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8642272ffbd94bbba462ff851a7bc2b5'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:30.295117 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0938a625-b91d-4fb6-bdac-c202e632c17f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8642272ffbd94bbba462ff851a7bc2b5'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:30.295784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0938a625-b91d-4fb6-bdac-c202e632c17f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8642272ffbd94bbba462ff851a7bc2b5'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:30.304842 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0938a625-b91d-4fb6-bdac-c202e632c17f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8642272ffbd94bbba462ff851a7bc2b5'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:30.305900 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0938a625-b91d-4fb6-bdac-c202e632c17f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8642272ffbd94bbba462ff851a7bc2b5'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:30.323094 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1128/2285] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:57:29 2021] DELETE /identity/v3/users/8642272ffbd94bbba462ff851a7bc2b5 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:31.017423 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54abe2-999c-4bc1-a04c-04606b5fce9b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:31.020770 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-cf54abe2-999c-4bc1-a04c-04606b5fce9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:31.035749 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54abe2-999c-4bc1-a04c-04606b5fce9b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:31.109560 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddac237-0544-47d8-b085-b3d2215ceb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:31.110354 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddac237-0544-47d8-b085-b3d2215ceb24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:31.110663 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddac237-0544-47d8-b085-b3d2215ceb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:31.110940 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddac237-0544-47d8-b085-b3d2215ceb24 admin admin] PATH_INFO: `/v3/projects/76983db435694a339ecef4925dae383c` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:31.111994 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddac237-0544-47d8-b085-b3d2215ceb24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76983db435694a339ecef4925dae383c)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:31.138002 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddac237-0544-47d8-b085-b3d2215ceb24 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:31.302150 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-eddac237-0544-47d8-b085-b3d2215ceb24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76983db435694a339ecef4925dae383c', 'request_id': 'req-eddac237-0544-47d8-b085-b3d2215ceb24'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:31.307978 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-eddac237-0544-47d8-b085-b3d2215ceb24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76983db435694a339ecef4925dae383c', 'request_id': 'req-eddac237-0544-47d8-b085-b3d2215ceb24'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:31.323130 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-eddac237-0544-47d8-b085-b3d2215ceb24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76983db435694a339ecef4925dae383c', 'request_id': 'req-eddac237-0544-47d8-b085-b3d2215ceb24'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:31.431065 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-eddac237-0544-47d8-b085-b3d2215ceb24 admin admin] The token cache is being invalidate because project 76983db435694a339ecef4925dae383c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:57:31.432187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-eddac237-0544-47d8-b085-b3d2215ceb24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:31.433327 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-eddac237-0544-47d8-b085-b3d2215ceb24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:31.435698 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1158/2286] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:57:31 2021] DELETE /identity/v3/projects/76983db435694a339ecef4925dae383c => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:31.441632 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035d583-d7af-4af5-9feb-70a461e04d1a None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:31.442822 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035d583-d7af-4af5-9feb-70a461e04d1a None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:31.442822 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035d583-d7af-4af5-9feb-70a461e04d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:31.467321 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-d035d583-d7af-4af5-9feb-70a461e04d1a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:31.468497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d035d583-d7af-4af5-9feb-70a461e04d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:31.535226 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1129/2287] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:31.543664 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3a556-0214-452c-9392-f3e146a30c37 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:31.543984 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3a556-0214-452c-9392-f3e146a30c37 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:31.544288 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3a556-0214-452c-9392-f3e146a30c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:31.566955 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-6fa3a556-0214-452c-9392-f3e146a30c37 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:31.569724 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-6fa3a556-0214-452c-9392-f3e146a30c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:31.575706 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1159/2288] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:57:31.579979 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035d583-d7af-4af5-9feb-70a461e04d1a None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:31.591201 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035d583-d7af-4af5-9feb-70a461e04d1a None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:31.598673 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea8f07-64b0-4871-aced-20ccaa0041f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:31.599397 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea8f07-64b0-4871-aced-20ccaa0041f0 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:31.599789 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea8f07-64b0-4871-aced-20ccaa0041f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:31.600179 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea8f07-64b0-4871-aced-20ccaa0041f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:31.601018 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea8f07-64b0-4871-aced-20ccaa0041f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:57:31.601415 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea8f07-64b0-4871-aced-20ccaa0041f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:31.635327 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea8f07-64b0-4871-aced-20ccaa0041f0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:31.649997 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1130/2289] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:57:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:57:31.656004 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3a556-0214-452c-9392-f3e146a30c37 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:31.664458 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3a556-0214-452c-9392-f3e146a30c37 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:31.669423 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8e43a-deb6-42e4-af9c-e48522431099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:31.670192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8e43a-deb6-42e4-af9c-e48522431099 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:31.670658 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8e43a-deb6-42e4-af9c-e48522431099 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:31.671125 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8e43a-deb6-42e4-af9c-e48522431099 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:31.671905 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8e43a-deb6-42e4-af9c-e48522431099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:31.698940 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8e43a-deb6-42e4-af9c-e48522431099 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:31.829296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea8f07-64b0-4871-aced-20ccaa0041f0 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:31.829555 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1160/2290] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:57:31 2021] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:57:31.840042 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea8f07-64b0-4871-aced-20ccaa0041f0 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:31.914053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e788287-497c-4bf4-aa5d-9650dfcaff16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:31.914935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e788287-497c-4bf4-aa5d-9650dfcaff16 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:31.915279 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e788287-497c-4bf4-aa5d-9650dfcaff16 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:31.915562 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e788287-497c-4bf4-aa5d-9650dfcaff16 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:31.916805 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e788287-497c-4bf4-aa5d-9650dfcaff16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:31.947444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e788287-497c-4bf4-aa5d-9650dfcaff16 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:32.049935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1131/2291] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:57:31 2021] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:57:32.054516 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8e43a-deb6-42e4-af9c-e48522431099 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:32.064944 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8e43a-deb6-42e4-af9c-e48522431099 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:32.069715 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1fd2f-f43b-458e-813e-652e17472214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:32.070394 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1fd2f-f43b-458e-813e-652e17472214 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:32.070740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1fd2f-f43b-458e-813e-652e17472214 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:32.071116 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1fd2f-f43b-458e-813e-652e17472214 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:32.071865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1fd2f-f43b-458e-813e-652e17472214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:32.098304 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1fd2f-f43b-458e-813e-652e17472214 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:32.110728 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1161/2292] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:57:32 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:57:32.120231 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e788287-497c-4bf4-aa5d-9650dfcaff16 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:32.130878 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e788287-497c-4bf4-aa5d-9650dfcaff16 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:32.135946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283bc7b-60a9-4dc4-ac58-beafe1d568d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:32.137117 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283bc7b-60a9-4dc4-ac58-beafe1d568d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:32.137479 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283bc7b-60a9-4dc4-ac58-beafe1d568d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:32.137960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283bc7b-60a9-4dc4-ac58-beafe1d568d2 admin admin] PATH_INFO: `/v3/projects/b29d5de9c3de40bbb0b7161e59747da9/users/15ca8177e11f48b1be1cbbeecaeb35c0/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:32.162318 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283bc7b-60a9-4dc4-ac58-beafe1d568d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29d5de9c3de40bbb0b7161e59747da9, user_id=15ca8177e11f48b1be1cbbeecaeb35c0, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:32.194753 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283bc7b-60a9-4dc4-ac58-beafe1d568d2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:32.341148 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1132/2293] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:57:32 2021] PUT /identity/v3/projects/b29d5de9c3de40bbb0b7161e59747da9/users/15ca8177e11f48b1be1cbbeecaeb35c0/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:32.352746 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc74aec-3557-461f-bee2-9718fcc15e2f None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:32.353041 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc74aec-3557-461f-bee2-9718fcc15e2f None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:32.353327 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc74aec-3557-461f-bee2-9718fcc15e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:32.369152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54c146-628e-4713-9e5d-6cea8c797e6b None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:32.369448 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54c146-628e-4713-9e5d-6cea8c797e6b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:32.369731 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54c146-628e-4713-9e5d-6cea8c797e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:32.395138 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-fbc74aec-3557-461f-bee2-9718fcc15e2f None None] MFA Rules not processed for user `15ca8177e11f48b1be1cbbeecaeb35c0`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:32.396423 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-fbc74aec-3557-461f-bee2-9718fcc15e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:32.400325 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-cc54c146-628e-4713-9e5d-6cea8c797e6b None None] MFA Rules not processed for user `7172c19e3f7c4f92bf53305e9f5325d6`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:32.401544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-cc54c146-628e-4713-9e5d-6cea8c797e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:32.482631 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1133/2294] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:32 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:57:32.483259 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1162/2295] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:32 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:32.489531 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54c146-628e-4713-9e5d-6cea8c797e6b None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:32.557960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54c146-628e-4713-9e5d-6cea8c797e6b None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:32.563720 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954814eb-23f6-41e9-a57c-f6db8ddd6dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:32.564411 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954814eb-23f6-41e9-a57c-f6db8ddd6dff admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:32.564757 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954814eb-23f6-41e9-a57c-f6db8ddd6dff admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:32.566830 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954814eb-23f6-41e9-a57c-f6db8ddd6dff admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:32.566830 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954814eb-23f6-41e9-a57c-f6db8ddd6dff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:32.592223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954814eb-23f6-41e9-a57c-f6db8ddd6dff admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:32.683286 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1134/2296] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:57:32 2021] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:57:32.687395 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc74aec-3557-461f-bee2-9718fcc15e2f None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:32.699091 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc74aec-3557-461f-bee2-9718fcc15e2f None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:32.761099 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f0abc-1b20-433f-a761-9aeb65686655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:32.761694 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f0abc-1b20-433f-a761-9aeb65686655 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:32.761984 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f0abc-1b20-433f-a761-9aeb65686655 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:32.762259 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f0abc-1b20-433f-a761-9aeb65686655 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:32.762884 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f0abc-1b20-433f-a761-9aeb65686655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:32.789686 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f0abc-1b20-433f-a761-9aeb65686655 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:32.876746 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c097ad-2ec5-4f57-96b4-a3ce997060cd None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:32.877151 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c097ad-2ec5-4f57-96b4-a3ce997060cd None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:32.877541 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c097ad-2ec5-4f57-96b4-a3ce997060cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:32.900117 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-83c097ad-2ec5-4f57-96b4-a3ce997060cd None None] MFA Rules not processed for user `3b6dbf69f7d344b7973747af9cb118ec`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:32.901308 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-83c097ad-2ec5-4f57-96b4-a3ce997060cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:32.954520 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1163/2297] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:57:32 2021] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:57:32.958601 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f0abc-1b20-433f-a761-9aeb65686655 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:32.964490 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1135/2298] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:32 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:57:32.968757 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f0abc-1b20-433f-a761-9aeb65686655 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:32.974095 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c8fc7-455b-46a1-b568-d89902e0948f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:32.976246 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c8fc7-455b-46a1-b568-d89902e0948f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:32.976530 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c8fc7-455b-46a1-b568-d89902e0948f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:32.976846 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c8fc7-455b-46a1-b568-d89902e0948f admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:32.977546 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c8fc7-455b-46a1-b568-d89902e0948f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:33.003248 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c8fc7-455b-46a1-b568-d89902e0948f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:33.015228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1164/2299] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:57:32 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:57:33.020010 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c097ad-2ec5-4f57-96b4-a3ce997060cd None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:33.030749 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c097ad-2ec5-4f57-96b4-a3ce997060cd None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:33.035900 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d737fc1-5fa1-4a51-b8b8-9f8a5611936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:33.040927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d737fc1-5fa1-4a51-b8b8-9f8a5611936c admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:33.040927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d737fc1-5fa1-4a51-b8b8-9f8a5611936c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:33.040927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d737fc1-5fa1-4a51-b8b8-9f8a5611936c admin admin] PATH_INFO: `/v3/projects/222409b6d37b4e35a748a4d15602d44c/users/aebbf65581914deba4c775792c07ca4a/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:33.061597 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d737fc1-5fa1-4a51-b8b8-9f8a5611936c admin admin] RBAC: Authorizing `identity:create_grant(project_id=222409b6d37b4e35a748a4d15602d44c, user_id=aebbf65581914deba4c775792c07ca4a, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:33.090307 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d737fc1-5fa1-4a51-b8b8-9f8a5611936c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:33.187148 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1136/2300] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:57:33 2021] PUT /identity/v3/projects/222409b6d37b4e35a748a4d15602d44c/users/aebbf65581914deba4c775792c07ca4a/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:57:33.191618 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c8fc7-455b-46a1-b568-d89902e0948f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:33.200962 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c8fc7-455b-46a1-b568-d89902e0948f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:33.270414 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcd565-627d-46ca-9df3-7a7c5c0c33bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:33.271010 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcd565-627d-46ca-9df3-7a7c5c0c33bf admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:33.271292 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcd565-627d-46ca-9df3-7a7c5c0c33bf admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:33.271564 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcd565-627d-46ca-9df3-7a7c5c0c33bf admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:33.272275 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcd565-627d-46ca-9df3-7a7c5c0c33bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:33.298355 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcd565-627d-46ca-9df3-7a7c5c0c33bf admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:33.310062 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1165/2301] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:57:33 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:57:33.313998 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d737fc1-5fa1-4a51-b8b8-9f8a5611936c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:33.327861 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d737fc1-5fa1-4a51-b8b8-9f8a5611936c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:33.334046 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8c7ba-4fd5-4a7c-8cd4-e2e8f41fd373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:33.335269 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8c7ba-4fd5-4a7c-8cd4-e2e8f41fd373 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:33.335269 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8c7ba-4fd5-4a7c-8cd4-e2e8f41fd373 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:33.335713 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8c7ba-4fd5-4a7c-8cd4-e2e8f41fd373 admin admin] PATH_INFO: `/v3/projects/222409b6d37b4e35a748a4d15602d44c/users/aebbf65581914deba4c775792c07ca4a/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:33.337589 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8c7ba-4fd5-4a7c-8cd4-e2e8f41fd373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=222409b6d37b4e35a748a4d15602d44c, user_id=aebbf65581914deba4c775792c07ca4a, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:33.363987 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8c7ba-4fd5-4a7c-8cd4-e2e8f41fd373 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:33.376628 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1137/2302] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:57:33 2021] PUT /identity/v3/projects/222409b6d37b4e35a748a4d15602d44c/users/aebbf65581914deba4c775792c07ca4a/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:33.379712 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcd565-627d-46ca-9df3-7a7c5c0c33bf admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:33.390565 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcd565-627d-46ca-9df3-7a7c5c0c33bf admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:33.471849 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e803d-5a07-443c-88e8-96ad3a5cc279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:33.472464 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e803d-5a07-443c-88e8-96ad3a5cc279 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:33.472783 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e803d-5a07-443c-88e8-96ad3a5cc279 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:33.473064 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e803d-5a07-443c-88e8-96ad3a5cc279 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:33.473784 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e803d-5a07-443c-88e8-96ad3a5cc279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:33.498921 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e803d-5a07-443c-88e8-96ad3a5cc279 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:33.511397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1166/2303] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:57:33 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:57:33.515644 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8c7ba-4fd5-4a7c-8cd4-e2e8f41fd373 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:33.526400 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8c7ba-4fd5-4a7c-8cd4-e2e8f41fd373 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:33.530787 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b00dc-69f9-4279-85d3-93dd86dffb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:33.531643 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b00dc-69f9-4279-85d3-93dd86dffb9f admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:33.531991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b00dc-69f9-4279-85d3-93dd86dffb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:33.532354 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b00dc-69f9-4279-85d3-93dd86dffb9f admin admin] PATH_INFO: `/v3/projects/222409b6d37b4e35a748a4d15602d44c/users/aebbf65581914deba4c775792c07ca4a/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:33.534399 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b00dc-69f9-4279-85d3-93dd86dffb9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=222409b6d37b4e35a748a4d15602d44c, user_id=aebbf65581914deba4c775792c07ca4a, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:33.564881 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b00dc-69f9-4279-85d3-93dd86dffb9f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:33.659666 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1138/2304] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:57:33 2021] PUT /identity/v3/projects/222409b6d37b4e35a748a4d15602d44c/users/aebbf65581914deba4c775792c07ca4a/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:33.670148 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db0284-edc7-4d26-8a15-cf82318e1893 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:33.670436 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db0284-edc7-4d26-8a15-cf82318e1893 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:33.670715 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db0284-edc7-4d26-8a15-cf82318e1893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:33.709132 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-62db0284-edc7-4d26-8a15-cf82318e1893 None None] MFA Rules not processed for user `aebbf65581914deba4c775792c07ca4a`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:33.710275 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-62db0284-edc7-4d26-8a15-cf82318e1893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:33.789075 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1167/2305] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:33 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:33.798317 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b00dc-69f9-4279-85d3-93dd86dffb9f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:33.800535 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-c53b00dc-69f9-4279-85d3-93dd86dffb9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:33.886208 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b00dc-69f9-4279-85d3-93dd86dffb9f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:33.898813 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2cae3-7b72-46a7-ab2e-27b8ce2e1045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:33.899545 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2cae3-7b72-46a7-ab2e-27b8ce2e1045 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:33.899839 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2cae3-7b72-46a7-ab2e-27b8ce2e1045 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:33.900122 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2cae3-7b72-46a7-ab2e-27b8ce2e1045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:33.912346 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2cae3-7b72-46a7-ab2e-27b8ce2e1045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:33.940199 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2cae3-7b72-46a7-ab2e-27b8ce2e1045 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:33.952170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1139/2306] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:33 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:57:34.747158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db0284-edc7-4d26-8a15-cf82318e1893 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:34.814472 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db0284-edc7-4d26-8a15-cf82318e1893 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:34.823645 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01c724-0eb6-466d-9de9-d9f5226ef916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:34.824478 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01c724-0eb6-466d-9de9-d9f5226ef916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:34.824812 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01c724-0eb6-466d-9de9-d9f5226ef916 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:34.825095 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01c724-0eb6-466d-9de9-d9f5226ef916 admin admin] PATH_INFO: `/v3/users/15ca8177e11f48b1be1cbbeecaeb35c0` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:34.826250 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01c724-0eb6-466d-9de9-d9f5226ef916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ca8177e11f48b1be1cbbeecaeb35c0)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:34.853809 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01c724-0eb6-466d-9de9-d9f5226ef916 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:35.045749 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1f01c724-0eb6-466d-9de9-d9f5226ef916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ca8177e11f48b1be1cbbeecaeb35c0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:35.046312 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1f01c724-0eb6-466d-9de9-d9f5226ef916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ca8177e11f48b1be1cbbeecaeb35c0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:35.155686 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1f01c724-0eb6-466d-9de9-d9f5226ef916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ca8177e11f48b1be1cbbeecaeb35c0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:35.165551 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1f01c724-0eb6-466d-9de9-d9f5226ef916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ca8177e11f48b1be1cbbeecaeb35c0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:35.166273 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1f01c724-0eb6-466d-9de9-d9f5226ef916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ca8177e11f48b1be1cbbeecaeb35c0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:35.196672 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1168/2307] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:57:34 2021] DELETE /identity/v3/users/15ca8177e11f48b1be1cbbeecaeb35c0 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:35.201285 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188254ea-19f2-481f-9763-4d536627309c None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:35.202086 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188254ea-19f2-481f-9763-4d536627309c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:35.202579 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188254ea-19f2-481f-9763-4d536627309c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:35.251789 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-188254ea-19f2-481f-9763-4d536627309c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:35.253078 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-188254ea-19f2-481f-9763-4d536627309c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:35.326660 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1140/2308] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:35.337387 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01c724-0eb6-466d-9de9-d9f5226ef916 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:35.338781 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1f01c724-0eb6-466d-9de9-d9f5226ef916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:35.417665 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01c724-0eb6-466d-9de9-d9f5226ef916 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:35.422368 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d008e6-bf08-4cbb-a204-674ae6c3ac32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:35.424643 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d008e6-bf08-4cbb-a204-674ae6c3ac32 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:35.424978 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d008e6-bf08-4cbb-a204-674ae6c3ac32 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:35.425505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d008e6-bf08-4cbb-a204-674ae6c3ac32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:35.435160 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d008e6-bf08-4cbb-a204-674ae6c3ac32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:35.462045 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d008e6-bf08-4cbb-a204-674ae6c3ac32 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:35.472520 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1169/2309] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:57:35.999429 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188254ea-19f2-481f-9763-4d536627309c None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:36.000970 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-188254ea-19f2-481f-9763-4d536627309c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:36.016185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188254ea-19f2-481f-9763-4d536627309c None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:36.021223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac654c-43d5-4950-839b-e121b386b082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:36.022092 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac654c-43d5-4950-839b-e121b386b082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:36.022380 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac654c-43d5-4950-839b-e121b386b082 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:36.022662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac654c-43d5-4950-839b-e121b386b082 admin admin] PATH_INFO: `/v3/projects/b29d5de9c3de40bbb0b7161e59747da9` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:36.023760 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac654c-43d5-4950-839b-e121b386b082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29d5de9c3de40bbb0b7161e59747da9)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:36.058215 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac654c-43d5-4950-839b-e121b386b082 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:36.178088 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-15ac654c-43d5-4950-839b-e121b386b082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29d5de9c3de40bbb0b7161e59747da9', 'request_id': 'req-15ac654c-43d5-4950-839b-e121b386b082'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:36.184677 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-15ac654c-43d5-4950-839b-e121b386b082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29d5de9c3de40bbb0b7161e59747da9', 'request_id': 'req-15ac654c-43d5-4950-839b-e121b386b082'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:36.195744 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-15ac654c-43d5-4950-839b-e121b386b082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29d5de9c3de40bbb0b7161e59747da9', 'request_id': 'req-15ac654c-43d5-4950-839b-e121b386b082'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:36.317793 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-15ac654c-43d5-4950-839b-e121b386b082 admin admin] The token cache is being invalidate because project b29d5de9c3de40bbb0b7161e59747da9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:57:36.318453 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-15ac654c-43d5-4950-839b-e121b386b082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:36.319048 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-15ac654c-43d5-4950-839b-e121b386b082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:36.320681 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1141/2310] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:57:35 2021] DELETE /identity/v3/projects/b29d5de9c3de40bbb0b7161e59747da9 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:36.324550 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d008e6-bf08-4cbb-a204-674ae6c3ac32 service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:36.334036 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d008e6-bf08-4cbb-a204-674ae6c3ac32 service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:36.510135 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9170e1-b7cc-4589-b5e8-78f7e711f994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:36.511053 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9170e1-b7cc-4589-b5e8-78f7e711f994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:36.511347 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9170e1-b7cc-4589-b5e8-78f7e711f994 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:36.511634 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9170e1-b7cc-4589-b5e8-78f7e711f994 admin admin] PATH_INFO: `/v3/users/aebbf65581914deba4c775792c07ca4a` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:36.514767 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9170e1-b7cc-4589-b5e8-78f7e711f994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aebbf65581914deba4c775792c07ca4a)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:36.559439 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9170e1-b7cc-4589-b5e8-78f7e711f994 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:36.871537 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-2f9170e1-b7cc-4589-b5e8-78f7e711f994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aebbf65581914deba4c775792c07ca4a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:36.872386 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-2f9170e1-b7cc-4589-b5e8-78f7e711f994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aebbf65581914deba4c775792c07ca4a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:36.975546 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-2f9170e1-b7cc-4589-b5e8-78f7e711f994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aebbf65581914deba4c775792c07ca4a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:36.989828 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-2f9170e1-b7cc-4589-b5e8-78f7e711f994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aebbf65581914deba4c775792c07ca4a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:36.992467 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-2f9170e1-b7cc-4589-b5e8-78f7e711f994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aebbf65581914deba4c775792c07ca4a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:37.017802 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1170/2311] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:57:36 2021] DELETE /identity/v3/users/aebbf65581914deba4c775792c07ca4a => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:38.131441 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac654c-43d5-4950-839b-e121b386b082 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:38.133275 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-15ac654c-43d5-4950-839b-e121b386b082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:38.151584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac654c-43d5-4950-839b-e121b386b082 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:38.238185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2486320-9dcb-49cd-87b3-f69054bdebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:38.239003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2486320-9dcb-49cd-87b3-f69054bdebeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:38.239293 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2486320-9dcb-49cd-87b3-f69054bdebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:38.239571 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2486320-9dcb-49cd-87b3-f69054bdebeb admin admin] PATH_INFO: `/v3/projects/222409b6d37b4e35a748a4d15602d44c` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:38.241623 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2486320-9dcb-49cd-87b3-f69054bdebeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=222409b6d37b4e35a748a4d15602d44c)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:38.272443 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2486320-9dcb-49cd-87b3-f69054bdebeb admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:38.447203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b2486320-9dcb-49cd-87b3-f69054bdebeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '222409b6d37b4e35a748a4d15602d44c', 'request_id': 'req-b2486320-9dcb-49cd-87b3-f69054bdebeb'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:38.454473 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b2486320-9dcb-49cd-87b3-f69054bdebeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '222409b6d37b4e35a748a4d15602d44c', 'request_id': 'req-b2486320-9dcb-49cd-87b3-f69054bdebeb'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:38.470608 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b2486320-9dcb-49cd-87b3-f69054bdebeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '222409b6d37b4e35a748a4d15602d44c', 'request_id': 'req-b2486320-9dcb-49cd-87b3-f69054bdebeb'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:38.580289 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b2486320-9dcb-49cd-87b3-f69054bdebeb admin admin] The token cache is being invalidate because project 222409b6d37b4e35a748a4d15602d44c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:57:38.580590 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b2486320-9dcb-49cd-87b3-f69054bdebeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:38.581848 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b2486320-9dcb-49cd-87b3-f69054bdebeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:38.587833 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1142/2312] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:57:38 2021] DELETE /identity/v3/projects/222409b6d37b4e35a748a4d15602d44c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:38.589025 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a52500-abdb-4527-a38b-df2990502239 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:38.589518 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a52500-abdb-4527-a38b-df2990502239 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:38.589615 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a52500-abdb-4527-a38b-df2990502239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:38.611291 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-51a52500-abdb-4527-a38b-df2990502239 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:38.612433 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-51a52500-abdb-4527-a38b-df2990502239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:38.718997 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1171/2313] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:38.720777 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf89b1-6ca7-4830-8588-c84e4d8b06f5 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:38.721080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf89b1-6ca7-4830-8588-c84e4d8b06f5 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:38.721370 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf89b1-6ca7-4830-8588-c84e4d8b06f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:38.763946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-28cf89b1-6ca7-4830-8588-c84e4d8b06f5 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:38.765227 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-28cf89b1-6ca7-4830-8588-c84e4d8b06f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:38.780644 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1143/2314] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:38.785264 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a52500-abdb-4527-a38b-df2990502239 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:38.797430 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a52500-abdb-4527-a38b-df2990502239 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:38.803612 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6be337-cd10-4c0f-84b7-2a5620814b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:38.804521 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6be337-cd10-4c0f-84b7-2a5620814b02 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:38.805041 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6be337-cd10-4c0f-84b7-2a5620814b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:38.805943 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6be337-cd10-4c0f-84b7-2a5620814b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:38.806915 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6be337-cd10-4c0f-84b7-2a5620814b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:57:38.807363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6be337-cd10-4c0f-84b7-2a5620814b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:38.837937 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6be337-cd10-4c0f-84b7-2a5620814b02 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:38.853641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1172/2315] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:57:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:57:38.864753 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf89b1-6ca7-4830-8588-c84e4d8b06f5 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:38.874898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf89b1-6ca7-4830-8588-c84e4d8b06f5 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:38.880190 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bea3a2-6991-458a-9fd8-ddf8161128ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:38.880860 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bea3a2-6991-458a-9fd8-ddf8161128ef admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:38.881150 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bea3a2-6991-458a-9fd8-ddf8161128ef admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:38.881426 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bea3a2-6991-458a-9fd8-ddf8161128ef admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:38.882243 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bea3a2-6991-458a-9fd8-ddf8161128ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:38.915314 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bea3a2-6991-458a-9fd8-ddf8161128ef admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:39.047741 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1144/2316] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:57:38 2021] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:57:39.051881 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6be337-cd10-4c0f-84b7-2a5620814b02 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:39.061917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6be337-cd10-4c0f-84b7-2a5620814b02 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:39.129826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a242aaa-d78d-4c11-84ac-5e6fce94fb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:39.130433 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242aaa-d78d-4c11-84ac-5e6fce94fb8d admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:39.130789 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242aaa-d78d-4c11-84ac-5e6fce94fb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:39.131158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242aaa-d78d-4c11-84ac-5e6fce94fb8d admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:39.131787 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a242aaa-d78d-4c11-84ac-5e6fce94fb8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:39.162011 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a242aaa-d78d-4c11-84ac-5e6fce94fb8d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:39.257506 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1173/2317] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:57:39 2021] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:57:39.257986 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bea3a2-6991-458a-9fd8-ddf8161128ef admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:39.277858 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bea3a2-6991-458a-9fd8-ddf8161128ef admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:39.290353 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b9e3f-3f84-4da3-b052-dc2052e77163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:39.291252 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b9e3f-3f84-4da3-b052-dc2052e77163 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:39.291730 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b9e3f-3f84-4da3-b052-dc2052e77163 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:39.292189 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b9e3f-3f84-4da3-b052-dc2052e77163 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:39.293604 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b9e3f-3f84-4da3-b052-dc2052e77163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:39.362861 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b9e3f-3f84-4da3-b052-dc2052e77163 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:39.396436 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1145/2318] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:57:39 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:57:39.401720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a242aaa-d78d-4c11-84ac-5e6fce94fb8d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:39.414926 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a242aaa-d78d-4c11-84ac-5e6fce94fb8d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:39.431898 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7de2b7-f88e-4527-b431-2deb0166cd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:39.434850 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7de2b7-f88e-4527-b431-2deb0166cd55 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:39.435148 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7de2b7-f88e-4527-b431-2deb0166cd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:39.435351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7de2b7-f88e-4527-b431-2deb0166cd55 admin admin] PATH_INFO: `/v3/projects/a62ab66b94154e3597d913ec7ae36bf2/users/4b1f696599b245f39265c7045493d92d/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:39.490117 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7de2b7-f88e-4527-b431-2deb0166cd55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a62ab66b94154e3597d913ec7ae36bf2, user_id=4b1f696599b245f39265c7045493d92d, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:39.566524 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7de2b7-f88e-4527-b431-2deb0166cd55 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:39.658119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1174/2319] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:57:39 2021] PUT /identity/v3/projects/a62ab66b94154e3597d913ec7ae36bf2/users/4b1f696599b245f39265c7045493d92d/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:39.669178 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681f86d-8305-4f36-8b59-8afd87921426 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:39.669733 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681f86d-8305-4f36-8b59-8afd87921426 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:39.670173 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681f86d-8305-4f36-8b59-8afd87921426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:39.713705 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-4681f86d-8305-4f36-8b59-8afd87921426 None None] MFA Rules not processed for user `4b1f696599b245f39265c7045493d92d`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:39.714952 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4681f86d-8305-4f36-8b59-8afd87921426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:39.810791 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1146/2320] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:39 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:39.815197 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7de2b7-f88e-4527-b431-2deb0166cd55 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:39.893155 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681f86d-8305-4f36-8b59-8afd87921426 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:39.894962 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4681f86d-8305-4f36-8b59-8afd87921426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:39.926231 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7de2b7-f88e-4527-b431-2deb0166cd55 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:39.932253 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46cdfb-b8c2-4a18-b203-847cea408a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:39.933132 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46cdfb-b8c2-4a18-b203-847cea408a4a admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:39.933568 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46cdfb-b8c2-4a18-b203-847cea408a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:39.933951 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46cdfb-b8c2-4a18-b203-847cea408a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:39.934786 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46cdfb-b8c2-4a18-b203-847cea408a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:39.982541 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46cdfb-b8c2-4a18-b203-847cea408a4a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:40.028204 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681f86d-8305-4f36-8b59-8afd87921426 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:40.040629 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd2b89-8d39-4b36-a1e0-4c944faba851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:40.041704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd2b89-8d39-4b36-a1e0-4c944faba851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:40.041912 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd2b89-8d39-4b36-a1e0-4c944faba851 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:40.042367 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd2b89-8d39-4b36-a1e0-4c944faba851 admin admin] PATH_INFO: `/v3/users/4e066a39278e4640a254741f41c7ae10` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:40.044092 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd2b89-8d39-4b36-a1e0-4c944faba851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e066a39278e4640a254741f41c7ae10)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:40.107028 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd2b89-8d39-4b36-a1e0-4c944faba851 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:40.131833 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1175/2321] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:57:39 2021] POST /identity/v3/projects => generated 381 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:57:40.135468 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46cdfb-b8c2-4a18-b203-847cea408a4a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:40.255467 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46cdfb-b8c2-4a18-b203-847cea408a4a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:40.260816 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf43357-290a-4a7d-9fda-da62fca175c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:40.261784 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf43357-290a-4a7d-9fda-da62fca175c2 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:40.262230 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf43357-290a-4a7d-9fda-da62fca175c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:40.262699 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf43357-290a-4a7d-9fda-da62fca175c2 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:40.263500 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf43357-290a-4a7d-9fda-da62fca175c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:40.315632 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf43357-290a-4a7d-9fda-da62fca175c2 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:40.392589 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f4fd2b89-8d39-4b36-a1e0-4c944faba851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e066a39278e4640a254741f41c7ae10'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:40.436096 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1176/2322] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:57:40 2021] POST /identity/v3/users => generated 297 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:57:40.437239 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf43357-290a-4a7d-9fda-da62fca175c2 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:40.448196 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf43357-290a-4a7d-9fda-da62fca175c2 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:40.452907 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bb493-ae65-416e-8e57-a8167e0e39c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:40.453617 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bb493-ae65-416e-8e57-a8167e0e39c2 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:40.453972 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bb493-ae65-416e-8e57-a8167e0e39c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:40.454259 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bb493-ae65-416e-8e57-a8167e0e39c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:40.454952 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bb493-ae65-416e-8e57-a8167e0e39c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:40.481772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bb493-ae65-416e-8e57-a8167e0e39c2 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:40.492793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1177/2323] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:57:40 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:57:40.497088 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bb493-ae65-416e-8e57-a8167e0e39c2 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:40.506663 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bb493-ae65-416e-8e57-a8167e0e39c2 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:40.510945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db0f8d-0822-40b0-945b-259f5b7a7d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:40.516465 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db0f8d-0822-40b0-945b-259f5b7a7d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:40.516465 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db0f8d-0822-40b0-945b-259f5b7a7d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:40.516465 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db0f8d-0822-40b0-945b-259f5b7a7d42 admin admin] PATH_INFO: `/v3/projects/48638672931241a58b75bb7937dd24b0/users/a514244095f54c6d9cc283a78dc20909/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:40.532150 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db0f8d-0822-40b0-945b-259f5b7a7d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48638672931241a58b75bb7937dd24b0, user_id=a514244095f54c6d9cc283a78dc20909, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:40.538269 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f4fd2b89-8d39-4b36-a1e0-4c944faba851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e066a39278e4640a254741f41c7ae10'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:40.538982 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f4fd2b89-8d39-4b36-a1e0-4c944faba851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e066a39278e4640a254741f41c7ae10'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:40.547913 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f4fd2b89-8d39-4b36-a1e0-4c944faba851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e066a39278e4640a254741f41c7ae10'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:40.548582 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f4fd2b89-8d39-4b36-a1e0-4c944faba851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e066a39278e4640a254741f41c7ae10'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:40.559503 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db0f8d-0822-40b0-945b-259f5b7a7d42 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:40.566120 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1147/2324] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:57:39 2021] DELETE /identity/v3/users/4e066a39278e4640a254741f41c7ae10 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:40.571848 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69437d6a-63fc-429f-9b81-a2323817de9f None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:40.572140 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69437d6a-63fc-429f-9b81-a2323817de9f None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:40.572422 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69437d6a-63fc-429f-9b81-a2323817de9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:40.598307 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-69437d6a-63fc-429f-9b81-a2323817de9f None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:40.599485 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-69437d6a-63fc-429f-9b81-a2323817de9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:40.627486 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1178/2325] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:57:40 2021] PUT /identity/v3/projects/48638672931241a58b75bb7937dd24b0/users/a514244095f54c6d9cc283a78dc20909/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:40.631747 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db0f8d-0822-40b0-945b-259f5b7a7d42 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:40.636937 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-a6db0f8d-0822-40b0-945b-259f5b7a7d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:40.681678 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1148/2326] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:40.713224 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69437d6a-63fc-429f-9b81-a2323817de9f None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:40.714601 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-69437d6a-63fc-429f-9b81-a2323817de9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:40.717766 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db0f8d-0822-40b0-945b-259f5b7a7d42 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:40.723177 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a0a77-1b51-4861-84d7-eab941f369ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:40.723984 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a0a77-1b51-4861-84d7-eab941f369ed admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:40.724422 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a0a77-1b51-4861-84d7-eab941f369ed admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:40.724881 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a0a77-1b51-4861-84d7-eab941f369ed admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:40.725740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a0a77-1b51-4861-84d7-eab941f369ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:40.752362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a0a77-1b51-4861-84d7-eab941f369ed admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:40.765628 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1179/2327] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:57:40 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:57:40.769322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a0a77-1b51-4861-84d7-eab941f369ed admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:40.781587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a0a77-1b51-4861-84d7-eab941f369ed admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:40.787517 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c64781-1b9c-497e-b6c7-328c7cd28e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:40.788556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c64781-1b9c-497e-b6c7-328c7cd28e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:40.788941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c64781-1b9c-497e-b6c7-328c7cd28e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:40.789294 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c64781-1b9c-497e-b6c7-328c7cd28e8a admin admin] PATH_INFO: `/v3/projects/48638672931241a58b75bb7937dd24b0/users/a514244095f54c6d9cc283a78dc20909/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:40.790326 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69437d6a-63fc-429f-9b81-a2323817de9f None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:40.794391 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c64781-1b9c-497e-b6c7-328c7cd28e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=48638672931241a58b75bb7937dd24b0, user_id=a514244095f54c6d9cc283a78dc20909, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:40.827260 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c64781-1b9c-497e-b6c7-328c7cd28e8a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:40.839895 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1180/2328] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:57:40 2021] PUT /identity/v3/projects/48638672931241a58b75bb7937dd24b0/users/a514244095f54c6d9cc283a78dc20909/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:40.843820 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c64781-1b9c-497e-b6c7-328c7cd28e8a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:40.854835 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ea4eb-edd7-4c39-a088-b8bf428a8d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:40.856454 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ea4eb-edd7-4c39-a088-b8bf428a8d92 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:40.857142 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ea4eb-edd7-4c39-a088-b8bf428a8d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:40.857730 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ea4eb-edd7-4c39-a088-b8bf428a8d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:40.870888 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ea4eb-edd7-4c39-a088-b8bf428a8d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:40.902550 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ea4eb-edd7-4c39-a088-b8bf428a8d92 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:40.915002 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1149/2329] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:57:40.918467 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c64781-1b9c-497e-b6c7-328c7cd28e8a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:40.923003 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3786d-8152-44d5-8a47-005f0bc89f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:40.923607 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3786d-8152-44d5-8a47-005f0bc89f40 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:40.923890 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3786d-8152-44d5-8a47-005f0bc89f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:40.924249 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3786d-8152-44d5-8a47-005f0bc89f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:40.925443 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3786d-8152-44d5-8a47-005f0bc89f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:40.954262 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3786d-8152-44d5-8a47-005f0bc89f40 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:40.965742 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1181/2330] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:57:40 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:57:40.969990 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ea4eb-edd7-4c39-a088-b8bf428a8d92 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:40.981182 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ea4eb-edd7-4c39-a088-b8bf428a8d92 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:40.985617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2a550-9201-47f1-8fcc-6403c0450ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:40.986600 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2a550-9201-47f1-8fcc-6403c0450ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:40.986983 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2a550-9201-47f1-8fcc-6403c0450ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:40.988226 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2a550-9201-47f1-8fcc-6403c0450ee1 admin admin] PATH_INFO: `/v3/projects/48638672931241a58b75bb7937dd24b0/users/a514244095f54c6d9cc283a78dc20909/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:40.990444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2a550-9201-47f1-8fcc-6403c0450ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48638672931241a58b75bb7937dd24b0, user_id=a514244095f54c6d9cc283a78dc20909, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:41.017631 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2a550-9201-47f1-8fcc-6403c0450ee1 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:41.070301 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3786d-8152-44d5-8a47-005f0bc89f40 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:41.118165 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1150/2331] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:57:40 2021] PUT /identity/v3/projects/48638672931241a58b75bb7937dd24b0/users/a514244095f54c6d9cc283a78dc20909/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:41.129065 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08a251-84c9-42e5-a1b1-a65a5449d068 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:41.129457 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08a251-84c9-42e5-a1b1-a65a5449d068 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:41.129631 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08a251-84c9-42e5-a1b1-a65a5449d068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:41.171656 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3786d-8152-44d5-8a47-005f0bc89f40 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:41.200486 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-4d08a251-84c9-42e5-a1b1-a65a5449d068 None None] MFA Rules not processed for user `a514244095f54c6d9cc283a78dc20909`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:41.203044 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4d08a251-84c9-42e5-a1b1-a65a5449d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:41.241317 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a5c6e-8cdf-4269-80f6-c4e595d97e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:41.242063 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a5c6e-8cdf-4269-80f6-c4e595d97e45 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:41.242428 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a5c6e-8cdf-4269-80f6-c4e595d97e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:41.242842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a5c6e-8cdf-4269-80f6-c4e595d97e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:41.246129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e65a5c6e-8cdf-4269-80f6-c4e595d97e45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:41.319942 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1151/2332] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:41 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:57:41.321201 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08a251-84c9-42e5-a1b1-a65a5449d068 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:41.327552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4d08a251-84c9-42e5-a1b1-a65a5449d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:41.340513 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08a251-84c9-42e5-a1b1-a65a5449d068 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:41.344499 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5819f8-d616-4bad-8410-befd6406ede1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:41.345129 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5819f8-d616-4bad-8410-befd6406ede1 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:41.345463 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5819f8-d616-4bad-8410-befd6406ede1 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:41.345743 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5819f8-d616-4bad-8410-befd6406ede1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:41.348681 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-0d5819f8-d616-4bad-8410-befd6406ede1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:41.394816 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a5c6e-8cdf-4269-80f6-c4e595d97e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:41.432903 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5819f8-d616-4bad-8410-befd6406ede1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:41.435304 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a5c6e-8cdf-4269-80f6-c4e595d97e45 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:41.459457 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5819f8-d616-4bad-8410-befd6406ede1 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:41.464057 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1182/2333] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:41 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:57:41.465450 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a5c6e-8cdf-4269-80f6-c4e595d97e45 service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:41.467849 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e65a5c6e-8cdf-4269-80f6-c4e595d97e45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:41.472845 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1152/2334] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:41 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:57:41.545863 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a5c6e-8cdf-4269-80f6-c4e595d97e45 service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:41.550403 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac7095-8273-4c8f-a7a8-9b63cbe599e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:41.551098 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac7095-8273-4c8f-a7a8-9b63cbe599e2 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:41.551463 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac7095-8273-4c8f-a7a8-9b63cbe599e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:41.551811 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac7095-8273-4c8f-a7a8-9b63cbe599e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:41.562663 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac7095-8273-4c8f-a7a8-9b63cbe599e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:41.589723 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac7095-8273-4c8f-a7a8-9b63cbe599e2 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:41.600596 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1183/2335] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:41 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:57:41.737139 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5819f8-d616-4bad-8410-befd6406ede1 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:41.738473 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-0d5819f8-d616-4bad-8410-befd6406ede1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:41.755176 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5819f8-d616-4bad-8410-befd6406ede1 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:41.760655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f6390-5494-45d1-a5e4-ae8f3eafa800 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:41.761528 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f6390-5494-45d1-a5e4-ae8f3eafa800 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:41.761933 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f6390-5494-45d1-a5e4-ae8f3eafa800 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:41.762314 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f6390-5494-45d1-a5e4-ae8f3eafa800 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:41.764585 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-965f6390-5494-45d1-a5e4-ae8f3eafa800 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:41.870356 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f6390-5494-45d1-a5e4-ae8f3eafa800 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:41.896136 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f6390-5494-45d1-a5e4-ae8f3eafa800 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:41.906255 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1153/2336] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:41 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:57:41.917496 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac7095-8273-4c8f-a7a8-9b63cbe599e2 service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:41.919362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-86ac7095-8273-4c8f-a7a8-9b63cbe599e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:42.015380 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac7095-8273-4c8f-a7a8-9b63cbe599e2 service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:42.025588 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba014fe-0367-48e2-9cc1-24332ab87771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:42.026521 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba014fe-0367-48e2-9cc1-24332ab87771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:42.026938 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba014fe-0367-48e2-9cc1-24332ab87771 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:42.027312 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba014fe-0367-48e2-9cc1-24332ab87771 admin admin] PATH_INFO: `/v3/projects/2d3796a5f61e4ea0aa1b6d2758cc44e1` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:42.028753 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba014fe-0367-48e2-9cc1-24332ab87771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d3796a5f61e4ea0aa1b6d2758cc44e1)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:42.056049 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba014fe-0367-48e2-9cc1-24332ab87771 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:42.171445 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8ba014fe-0367-48e2-9cc1-24332ab87771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d3796a5f61e4ea0aa1b6d2758cc44e1', 'request_id': 'req-8ba014fe-0367-48e2-9cc1-24332ab87771'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:42.178397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8ba014fe-0367-48e2-9cc1-24332ab87771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d3796a5f61e4ea0aa1b6d2758cc44e1', 'request_id': 'req-8ba014fe-0367-48e2-9cc1-24332ab87771'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:42.195129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8ba014fe-0367-48e2-9cc1-24332ab87771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d3796a5f61e4ea0aa1b6d2758cc44e1', 'request_id': 'req-8ba014fe-0367-48e2-9cc1-24332ab87771'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:42.206709 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f6390-5494-45d1-a5e4-ae8f3eafa800 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:42.216546 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f6390-5494-45d1-a5e4-ae8f3eafa800 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:42.276932 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8ba014fe-0367-48e2-9cc1-24332ab87771 admin admin] The token cache is being invalidate because project 2d3796a5f61e4ea0aa1b6d2758cc44e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:57:42.277419 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8ba014fe-0367-48e2-9cc1-24332ab87771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:42.278082 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8ba014fe-0367-48e2-9cc1-24332ab87771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:42.278227 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b6ae6-3e05-41a2-b18a-a0a27285eaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:42.279013 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b6ae6-3e05-41a2-b18a-a0a27285eaf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:42.279301 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b6ae6-3e05-41a2-b18a-a0a27285eaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:42.279562 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1184/2337] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:57:41 2021] DELETE /identity/v3/projects/2d3796a5f61e4ea0aa1b6d2758cc44e1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:42.279664 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b6ae6-3e05-41a2-b18a-a0a27285eaf9 admin admin] PATH_INFO: `/v3/users/4b1f696599b245f39265c7045493d92d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:42.280685 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b6ae6-3e05-41a2-b18a-a0a27285eaf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b1f696599b245f39265c7045493d92d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:42.283418 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba014fe-0367-48e2-9cc1-24332ab87771 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:42.284681 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-8ba014fe-0367-48e2-9cc1-24332ab87771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:42.296114 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba014fe-0367-48e2-9cc1-24332ab87771 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:42.300273 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81167c-5dde-40fe-bcdb-142a80392ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:42.301077 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81167c-5dde-40fe-bcdb-142a80392ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:42.301365 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81167c-5dde-40fe-bcdb-142a80392ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:42.301644 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81167c-5dde-40fe-bcdb-142a80392ea3 admin admin] PATH_INFO: `/v3/users/500c09b3044745a2b8b48b59b00b3621` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:42.302720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81167c-5dde-40fe-bcdb-142a80392ea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=500c09b3044745a2b8b48b59b00b3621)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:42.307076 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b6ae6-3e05-41a2-b18a-a0a27285eaf9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:42.329040 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81167c-5dde-40fe-bcdb-142a80392ea3 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:42.535965 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f11b6ae6-3e05-41a2-b18a-a0a27285eaf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b1f696599b245f39265c7045493d92d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:42.551252 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8d81167c-5dde-40fe-bcdb-142a80392ea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '500c09b3044745a2b8b48b59b00b3621'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:42.552184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8d81167c-5dde-40fe-bcdb-142a80392ea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '500c09b3044745a2b8b48b59b00b3621'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:42.642727 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f11b6ae6-3e05-41a2-b18a-a0a27285eaf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b1f696599b245f39265c7045493d92d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:42.643334 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f11b6ae6-3e05-41a2-b18a-a0a27285eaf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b1f696599b245f39265c7045493d92d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:42.651137 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f11b6ae6-3e05-41a2-b18a-a0a27285eaf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b1f696599b245f39265c7045493d92d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:42.651742 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f11b6ae6-3e05-41a2-b18a-a0a27285eaf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b1f696599b245f39265c7045493d92d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:42.668424 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1154/2338] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:57:42 2021] DELETE /identity/v3/users/4b1f696599b245f39265c7045493d92d => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:57:42.673368 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547eb3a-7439-4aa3-82b6-f4e5465c29b3 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:42.673769 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547eb3a-7439-4aa3-82b6-f4e5465c29b3 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:42.674080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547eb3a-7439-4aa3-82b6-f4e5465c29b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:42.697555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-1547eb3a-7439-4aa3-82b6-f4e5465c29b3 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:42.698601 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1547eb3a-7439-4aa3-82b6-f4e5465c29b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:42.767274 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1155/2339] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:57:42.777287 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547eb3a-7439-4aa3-82b6-f4e5465c29b3 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:42.778518 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1547eb3a-7439-4aa3-82b6-f4e5465c29b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:42.832672 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8d81167c-5dde-40fe-bcdb-142a80392ea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '500c09b3044745a2b8b48b59b00b3621'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:42.846294 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547eb3a-7439-4aa3-82b6-f4e5465c29b3 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:42.848061 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8d81167c-5dde-40fe-bcdb-142a80392ea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '500c09b3044745a2b8b48b59b00b3621'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:42.848285 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-8d81167c-5dde-40fe-bcdb-142a80392ea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '500c09b3044745a2b8b48b59b00b3621'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:42.850168 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17864ac-7ef2-4985-bb1f-13aa667e7c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:42.850813 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17864ac-7ef2-4985-bb1f-13aa667e7c4e service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:42.851167 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17864ac-7ef2-4985-bb1f-13aa667e7c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:42.851513 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17864ac-7ef2-4985-bb1f-13aa667e7c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:42.861360 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17864ac-7ef2-4985-bb1f-13aa667e7c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:42.875809 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1185/2340] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:57:42 2021] DELETE /identity/v3/users/500c09b3044745a2b8b48b59b00b3621 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:57:42.889177 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17864ac-7ef2-4985-bb1f-13aa667e7c4e service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:42.899255 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1156/2341] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:57:43.650931 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81167c-5dde-40fe-bcdb-142a80392ea3 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:43.652305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-8d81167c-5dde-40fe-bcdb-142a80392ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:43.723160 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81167c-5dde-40fe-bcdb-142a80392ea3 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:43.727682 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5688d5-7139-4b06-8920-eb1a90291cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:43.728478 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5688d5-7139-4b06-8920-eb1a90291cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:43.728915 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5688d5-7139-4b06-8920-eb1a90291cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:43.729205 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5688d5-7139-4b06-8920-eb1a90291cf8 admin admin] PATH_INFO: `/v3/projects/90e93e75eba04d41b8e8788b952b24a1` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:43.731253 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5688d5-7139-4b06-8920-eb1a90291cf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e93e75eba04d41b8e8788b952b24a1)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:43.733619 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17864ac-7ef2-4985-bb1f-13aa667e7c4e service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:43.734991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-c17864ac-7ef2-4985-bb1f-13aa667e7c4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:43.747316 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17864ac-7ef2-4985-bb1f-13aa667e7c4e service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:43.754897 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a576fe-a79e-41ae-a74e-908d28198e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:43.756910 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a576fe-a79e-41ae-a74e-908d28198e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:43.756910 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a576fe-a79e-41ae-a74e-908d28198e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:43.756910 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a576fe-a79e-41ae-a74e-908d28198e60 admin admin] PATH_INFO: `/v3/projects/a62ab66b94154e3597d913ec7ae36bf2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:43.757445 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a576fe-a79e-41ae-a74e-908d28198e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a62ab66b94154e3597d913ec7ae36bf2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:43.758349 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5688d5-7139-4b06-8920-eb1a90291cf8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:43.783542 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a576fe-a79e-41ae-a74e-908d28198e60 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:43.888787 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ce5688d5-7139-4b06-8920-eb1a90291cf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e93e75eba04d41b8e8788b952b24a1', 'request_id': 'req-ce5688d5-7139-4b06-8920-eb1a90291cf8'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:43.894528 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ce5688d5-7139-4b06-8920-eb1a90291cf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e93e75eba04d41b8e8788b952b24a1', 'request_id': 'req-ce5688d5-7139-4b06-8920-eb1a90291cf8'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:43.905752 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ce5688d5-7139-4b06-8920-eb1a90291cf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e93e75eba04d41b8e8788b952b24a1', 'request_id': 'req-ce5688d5-7139-4b06-8920-eb1a90291cf8'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:43.917261 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-68a576fe-a79e-41ae-a74e-908d28198e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a62ab66b94154e3597d913ec7ae36bf2', 'request_id': 'req-68a576fe-a79e-41ae-a74e-908d28198e60'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:43.922380 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-68a576fe-a79e-41ae-a74e-908d28198e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a62ab66b94154e3597d913ec7ae36bf2', 'request_id': 'req-68a576fe-a79e-41ae-a74e-908d28198e60'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:43.933488 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-68a576fe-a79e-41ae-a74e-908d28198e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a62ab66b94154e3597d913ec7ae36bf2', 'request_id': 'req-68a576fe-a79e-41ae-a74e-908d28198e60'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:44.002132 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ce5688d5-7139-4b06-8920-eb1a90291cf8 admin admin] The token cache is being invalidate because project 90e93e75eba04d41b8e8788b952b24a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:57:44.002413 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ce5688d5-7139-4b06-8920-eb1a90291cf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:44.003506 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ce5688d5-7139-4b06-8920-eb1a90291cf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:44.004936 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1186/2342] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:57:43 2021] DELETE /identity/v3/projects/90e93e75eba04d41b8e8788b952b24a1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:44.013429 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3bd10-b203-4ef3-a0e0-4264ca14049a None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:44.013815 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3bd10-b203-4ef3-a0e0-4264ca14049a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:44.014093 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3bd10-b203-4ef3-a0e0-4264ca14049a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:44.036300 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-26d3bd10-b203-4ef3-a0e0-4264ca14049a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:44.042690 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-26d3bd10-b203-4ef3-a0e0-4264ca14049a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:44.065091 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-68a576fe-a79e-41ae-a74e-908d28198e60 admin admin] The token cache is being invalidate because project a62ab66b94154e3597d913ec7ae36bf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:57:44.068780 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-68a576fe-a79e-41ae-a74e-908d28198e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:44.068780 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-68a576fe-a79e-41ae-a74e-908d28198e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:44.068780 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1157/2343] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:57:43 2021] DELETE /identity/v3/projects/a62ab66b94154e3597d913ec7ae36bf2 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:44.071945 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a576fe-a79e-41ae-a74e-908d28198e60 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:44.073193 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-68a576fe-a79e-41ae-a74e-908d28198e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:44.104155 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1187/2344] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:57:44.111445 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379ffc1-b92b-4c58-b32f-724ee034eedb None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:44.111740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379ffc1-b92b-4c58-b32f-724ee034eedb None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:44.112538 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379ffc1-b92b-4c58-b32f-724ee034eedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:44.145516 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-9379ffc1-b92b-4c58-b32f-724ee034eedb None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:44.145516 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-9379ffc1-b92b-4c58-b32f-724ee034eedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:44.149494 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a576fe-a79e-41ae-a74e-908d28198e60 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:44.151671 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1188/2345] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:57:44.154499 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141c8c1-8998-4812-850f-56aabec49a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:44.155403 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141c8c1-8998-4812-850f-56aabec49a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:44.155697 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141c8c1-8998-4812-850f-56aabec49a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:44.155950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379ffc1-b92b-4c58-b32f-724ee034eedb None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:44.156071 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141c8c1-8998-4812-850f-56aabec49a7e admin admin] PATH_INFO: `/v3/users/a514244095f54c6d9cc283a78dc20909` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:44.157691 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141c8c1-8998-4812-850f-56aabec49a7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a514244095f54c6d9cc283a78dc20909)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:44.165427 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379ffc1-b92b-4c58-b32f-724ee034eedb None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:44.170039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c10a2-f889-45fd-9796-7374538a79a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:44.170812 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c10a2-f889-45fd-9796-7374538a79a2 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:44.171261 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c10a2-f889-45fd-9796-7374538a79a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:44.171692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c10a2-f889-45fd-9796-7374538a79a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:44.172830 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c10a2-f889-45fd-9796-7374538a79a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:57:44.173299 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c10a2-f889-45fd-9796-7374538a79a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:44.185298 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141c8c1-8998-4812-850f-56aabec49a7e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:44.202421 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c10a2-f889-45fd-9796-7374538a79a2 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:44.215940 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1189/2346] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:57:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:57:44.220413 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c10a2-f889-45fd-9796-7374538a79a2 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:44.229853 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c10a2-f889-45fd-9796-7374538a79a2 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:44.234077 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436edd81-3db0-44d7-a2f5-a752858eb25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:44.234647 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436edd81-3db0-44d7-a2f5-a752858eb25a admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:44.234932 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436edd81-3db0-44d7-a2f5-a752858eb25a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:44.235237 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436edd81-3db0-44d7-a2f5-a752858eb25a admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:44.235895 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436edd81-3db0-44d7-a2f5-a752858eb25a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:44.262219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436edd81-3db0-44d7-a2f5-a752858eb25a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:44.365076 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1190/2347] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:57:44 2021] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:57:44.368982 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436edd81-3db0-44d7-a2f5-a752858eb25a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:44.436198 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436edd81-3db0-44d7-a2f5-a752858eb25a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:44.440740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1b75f-19f6-4934-8f3a-c6531066999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:44.441348 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1b75f-19f6-4934-8f3a-c6531066999d admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:44.441642 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1b75f-19f6-4934-8f3a-c6531066999d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:44.441927 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1b75f-19f6-4934-8f3a-c6531066999d admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:44.442565 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1b75f-19f6-4934-8f3a-c6531066999d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:44.452048 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-1141c8c1-8998-4812-850f-56aabec49a7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a514244095f54c6d9cc283a78dc20909'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:44.467750 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1b75f-19f6-4934-8f3a-c6531066999d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:44.517662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-1141c8c1-8998-4812-850f-56aabec49a7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a514244095f54c6d9cc283a78dc20909'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:44.518250 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-1141c8c1-8998-4812-850f-56aabec49a7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a514244095f54c6d9cc283a78dc20909'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:44.526174 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-1141c8c1-8998-4812-850f-56aabec49a7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a514244095f54c6d9cc283a78dc20909'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:44.526772 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-1141c8c1-8998-4812-850f-56aabec49a7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a514244095f54c6d9cc283a78dc20909'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:44.544336 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1158/2348] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:57:44 2021] DELETE /identity/v3/users/a514244095f54c6d9cc283a78dc20909 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:57:44.564059 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1191/2349] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:57:44 2021] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:57:44.576497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141c8c1-8998-4812-850f-56aabec49a7e admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:44.577967 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1141c8c1-8998-4812-850f-56aabec49a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:44.659731 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141c8c1-8998-4812-850f-56aabec49a7e admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:44.664276 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fd713-18a7-4da6-9501-51d77e6135d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:44.664966 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fd713-18a7-4da6-9501-51d77e6135d2 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:44.667544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fd713-18a7-4da6-9501-51d77e6135d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:44.667544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fd713-18a7-4da6-9501-51d77e6135d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:44.667544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fd713-18a7-4da6-9501-51d77e6135d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:44.693617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fd713-18a7-4da6-9501-51d77e6135d2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:44.705027 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1159/2350] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:57:44 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:57:44.709048 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1b75f-19f6-4934-8f3a-c6531066999d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:44.718511 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1b75f-19f6-4934-8f3a-c6531066999d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:44.724084 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c018e1-fe86-4563-92ae-eed930a9f42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:44.724926 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c018e1-fe86-4563-92ae-eed930a9f42d admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:44.725219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c018e1-fe86-4563-92ae-eed930a9f42d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:44.725501 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c018e1-fe86-4563-92ae-eed930a9f42d admin admin] PATH_INFO: `/v3/projects/9038b5acf7fb44c68267a467a252cd5a/users/917a6efd5aa54d5a855015065911738d/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:44.746116 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c018e1-fe86-4563-92ae-eed930a9f42d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9038b5acf7fb44c68267a467a252cd5a, user_id=917a6efd5aa54d5a855015065911738d, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:44.774192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c018e1-fe86-4563-92ae-eed930a9f42d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:44.913090 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1192/2351] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:57:44 2021] PUT /identity/v3/projects/9038b5acf7fb44c68267a467a252cd5a/users/917a6efd5aa54d5a855015065911738d/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:44.922992 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae98948-502f-45cc-9cbe-1a34f5dee3d0 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:44.929153 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae98948-502f-45cc-9cbe-1a34f5dee3d0 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:44.929153 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae98948-502f-45cc-9cbe-1a34f5dee3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:44.964115 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-1ae98948-502f-45cc-9cbe-1a34f5dee3d0 None None] MFA Rules not processed for user `917a6efd5aa54d5a855015065911738d`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:44.965956 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1ae98948-502f-45cc-9cbe-1a34f5dee3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:45.045039 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1160/2352] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:44 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:45.054568 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c018e1-fe86-4563-92ae-eed930a9f42d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:45.056502 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-a7c018e1-fe86-4563-92ae-eed930a9f42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:45.122061 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c018e1-fe86-4563-92ae-eed930a9f42d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:45.125553 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca849428-e428-476e-841c-ac0315bbd672 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:45.126064 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca849428-e428-476e-841c-ac0315bbd672 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:45.126294 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca849428-e428-476e-841c-ac0315bbd672 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:45.126569 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca849428-e428-476e-841c-ac0315bbd672 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:45.136114 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca849428-e428-476e-841c-ac0315bbd672 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:45.157534 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae98948-502f-45cc-9cbe-1a34f5dee3d0 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:45.159630 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1ae98948-502f-45cc-9cbe-1a34f5dee3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:45.165984 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca849428-e428-476e-841c-ac0315bbd672 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:45.175511 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1193/2353] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:45 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:57:45.195962 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca849428-e428-476e-841c-ac0315bbd672 service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:45.254247 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae98948-502f-45cc-9cbe-1a34f5dee3d0 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:45.262527 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67151f7f-2415-4e0c-8f4c-b0e6bf7e316d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:45.263377 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67151f7f-2415-4e0c-8f4c-b0e6bf7e316d admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:45.263665 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67151f7f-2415-4e0c-8f4c-b0e6bf7e316d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:45.263942 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67151f7f-2415-4e0c-8f4c-b0e6bf7e316d admin admin] PATH_INFO: `/v3/projects/48638672931241a58b75bb7937dd24b0` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:45.265069 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67151f7f-2415-4e0c-8f4c-b0e6bf7e316d admin admin] RBAC: Authorizing `identity:delete_project(project_id=48638672931241a58b75bb7937dd24b0)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:45.269468 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca849428-e428-476e-841c-ac0315bbd672 service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:45.274101 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2bad0-d8a8-4b29-852b-753963b3a8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:45.274910 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2bad0-d8a8-4b29-852b-753963b3a8a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:45.275200 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2bad0-d8a8-4b29-852b-753963b3a8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:45.275484 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2bad0-d8a8-4b29-852b-753963b3a8a9 admin admin] PATH_INFO: `/v3/users/917a6efd5aa54d5a855015065911738d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:45.276591 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2bad0-d8a8-4b29-852b-753963b3a8a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=917a6efd5aa54d5a855015065911738d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:45.291942 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67151f7f-2415-4e0c-8f4c-b0e6bf7e316d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:45.303931 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2bad0-d8a8-4b29-852b-753963b3a8a9 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:45.432251 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-67151f7f-2415-4e0c-8f4c-b0e6bf7e316d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48638672931241a58b75bb7937dd24b0', 'request_id': 'req-67151f7f-2415-4e0c-8f4c-b0e6bf7e316d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:45.448096 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-67151f7f-2415-4e0c-8f4c-b0e6bf7e316d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48638672931241a58b75bb7937dd24b0', 'request_id': 'req-67151f7f-2415-4e0c-8f4c-b0e6bf7e316d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:45.463054 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-67151f7f-2415-4e0c-8f4c-b0e6bf7e316d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48638672931241a58b75bb7937dd24b0', 'request_id': 'req-67151f7f-2415-4e0c-8f4c-b0e6bf7e316d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:45.533505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-67a2bad0-d8a8-4b29-852b-753963b3a8a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917a6efd5aa54d5a855015065911738d'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:45.534197 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-67a2bad0-d8a8-4b29-852b-753963b3a8a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917a6efd5aa54d5a855015065911738d'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:45.555506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-67151f7f-2415-4e0c-8f4c-b0e6bf7e316d admin admin] The token cache is being invalidate because project 48638672931241a58b75bb7937dd24b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:57:45.556788 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-67151f7f-2415-4e0c-8f4c-b0e6bf7e316d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:45.558194 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-67151f7f-2415-4e0c-8f4c-b0e6bf7e316d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:45.560809 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1161/2354] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:57:45 2021] DELETE /identity/v3/projects/48638672931241a58b75bb7937dd24b0 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:57:45.566961 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc3225-0793-42b5-9446-571003918801 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:45.567640 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc3225-0793-42b5-9446-571003918801 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:45.568246 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc3225-0793-42b5-9446-571003918801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:45.607291 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-a3bc3225-0793-42b5-9446-571003918801 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:45.608460 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a3bc3225-0793-42b5-9446-571003918801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:45.624587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-67a2bad0-d8a8-4b29-852b-753963b3a8a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917a6efd5aa54d5a855015065911738d'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:45.635077 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-67a2bad0-d8a8-4b29-852b-753963b3a8a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917a6efd5aa54d5a855015065911738d'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:45.636121 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-67a2bad0-d8a8-4b29-852b-753963b3a8a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917a6efd5aa54d5a855015065911738d'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:45.660581 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1194/2355] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:57:45 2021] DELETE /identity/v3/users/917a6efd5aa54d5a855015065911738d => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:57:45.665230 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7442f4-5ab0-49a7-a362-82340457ce43 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:45.665536 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7442f4-5ab0-49a7-a362-82340457ce43 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:45.666121 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7442f4-5ab0-49a7-a362-82340457ce43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:45.689668 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-3a7442f4-5ab0-49a7-a362-82340457ce43 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:45.691526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-3a7442f4-5ab0-49a7-a362-82340457ce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:45.701180 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1162/2356] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:45.702975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7fd17-6875-4b50-9e5f-c104a9cd0e13 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:45.703356 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7fd17-6875-4b50-9e5f-c104a9cd0e13 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:45.703920 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7fd17-6875-4b50-9e5f-c104a9cd0e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:45.730353 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-43b7fd17-6875-4b50-9e5f-c104a9cd0e13 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:45.731685 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-43b7fd17-6875-4b50-9e5f-c104a9cd0e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:45.760062 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1195/2357] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:45.770621 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7442f4-5ab0-49a7-a362-82340457ce43 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:45.771882 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-3a7442f4-5ab0-49a7-a362-82340457ce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:45.810101 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1163/2358] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:57:45.813777 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7fd17-6875-4b50-9e5f-c104a9cd0e13 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:45.825311 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7fd17-6875-4b50-9e5f-c104a9cd0e13 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:45.830467 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c60ce-ae69-4ef0-840f-f8d6136b4930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:45.831247 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c60ce-ae69-4ef0-840f-f8d6136b4930 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:45.831535 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c60ce-ae69-4ef0-840f-f8d6136b4930 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:45.831815 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c60ce-ae69-4ef0-840f-f8d6136b4930 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:45.832506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c60ce-ae69-4ef0-840f-f8d6136b4930 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:57:45.832836 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c60ce-ae69-4ef0-840f-f8d6136b4930 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:45.835606 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7442f4-5ab0-49a7-a362-82340457ce43 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:45.838906 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce7783-bed7-491b-9136-d6073c25e8d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:45.839475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce7783-bed7-491b-9136-d6073c25e8d4 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:45.839762 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce7783-bed7-491b-9136-d6073c25e8d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:45.840039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce7783-bed7-491b-9136-d6073c25e8d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:45.849085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce7783-bed7-491b-9136-d6073c25e8d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:45.858609 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c60ce-ae69-4ef0-840f-f8d6136b4930 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:45.874702 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce7783-bed7-491b-9136-d6073c25e8d4 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:45.880602 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1164/2359] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:57:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:57:45.883964 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c60ce-ae69-4ef0-840f-f8d6136b4930 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:45.885792 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1196/2360] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:45 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:57:45.893905 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c60ce-ae69-4ef0-840f-f8d6136b4930 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:45.898473 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b89166-d17b-4523-b2ee-455aa6459b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:45.899420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b89166-d17b-4523-b2ee-455aa6459b64 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:45.899860 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b89166-d17b-4523-b2ee-455aa6459b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:45.900303 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b89166-d17b-4523-b2ee-455aa6459b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:45.901134 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b89166-d17b-4523-b2ee-455aa6459b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:45.927906 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b89166-d17b-4523-b2ee-455aa6459b64 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:46.059825 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1165/2361] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:57:45 2021] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:57:46.064294 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce7783-bed7-491b-9136-d6073c25e8d4 service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:46.073653 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce7783-bed7-491b-9136-d6073c25e8d4 service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:46.144765 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91c0c3-d30f-4f61-a04c-ce0a89ed7cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:46.145378 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91c0c3-d30f-4f61-a04c-ce0a89ed7cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:46.145665 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91c0c3-d30f-4f61-a04c-ce0a89ed7cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:46.145947 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91c0c3-d30f-4f61-a04c-ce0a89ed7cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:46.146579 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91c0c3-d30f-4f61-a04c-ce0a89ed7cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:46.173426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91c0c3-d30f-4f61-a04c-ce0a89ed7cd8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:46.249392 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1197/2362] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:57:46 2021] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:57:46.253466 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b89166-d17b-4523-b2ee-455aa6459b64 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:46.263348 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b89166-d17b-4523-b2ee-455aa6459b64 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:46.267763 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f26f86-1067-47b5-9bca-61813191d8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:46.269665 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f26f86-1067-47b5-9bca-61813191d8fc admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:46.269665 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f26f86-1067-47b5-9bca-61813191d8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:46.269665 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f26f86-1067-47b5-9bca-61813191d8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:46.270119 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f26f86-1067-47b5-9bca-61813191d8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:46.295359 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f26f86-1067-47b5-9bca-61813191d8fc admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:46.306327 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1166/2363] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:57:46 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:57:46.310525 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91c0c3-d30f-4f61-a04c-ce0a89ed7cd8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:46.319847 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91c0c3-d30f-4f61-a04c-ce0a89ed7cd8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:46.324207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f8ca1-f8eb-4ecb-b1f9-f7d72b9a339b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:46.325038 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f8ca1-f8eb-4ecb-b1f9-f7d72b9a339b admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:46.325324 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f8ca1-f8eb-4ecb-b1f9-f7d72b9a339b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:46.325602 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f8ca1-f8eb-4ecb-b1f9-f7d72b9a339b admin admin] PATH_INFO: `/v3/projects/e8f6d9e7b11d49b083d606c833a2ab49/users/4b2d7d6a773840d99ed391fb4a4def19/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:46.345097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f8ca1-f8eb-4ecb-b1f9-f7d72b9a339b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f6d9e7b11d49b083d606c833a2ab49, user_id=4b2d7d6a773840d99ed391fb4a4def19, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:46.373329 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f8ca1-f8eb-4ecb-b1f9-f7d72b9a339b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:46.399843 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f26f86-1067-47b5-9bca-61813191d8fc admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:46.401776 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-46f26f86-1067-47b5-9bca-61813191d8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:46.414562 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f26f86-1067-47b5-9bca-61813191d8fc admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:46.419284 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d4412-8153-4438-9492-371f4370a1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:46.420178 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d4412-8153-4438-9492-371f4370a1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:46.420446 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d4412-8153-4438-9492-371f4370a1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:46.420775 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d4412-8153-4438-9492-371f4370a1b2 admin admin] PATH_INFO: `/v3/projects/9038b5acf7fb44c68267a467a252cd5a` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:46.421910 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d4412-8153-4438-9492-371f4370a1b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9038b5acf7fb44c68267a467a252cd5a)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:46.448954 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d4412-8153-4438-9492-371f4370a1b2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:46.466576 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1198/2364] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:57:46 2021] PUT /identity/v3/projects/e8f6d9e7b11d49b083d606c833a2ab49/users/4b2d7d6a773840d99ed391fb4a4def19/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:57:46.471612 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc801d-b85a-4662-a952-4e01faebb170 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:46.471906 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc801d-b85a-4662-a952-4e01faebb170 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:46.472187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc801d-b85a-4662-a952-4e01faebb170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:46.495677 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-27dc801d-b85a-4662-a952-4e01faebb170 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:46.496772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-27dc801d-b85a-4662-a952-4e01faebb170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:46.558849 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1199/2365] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:46.569487 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc801d-b85a-4662-a952-4e01faebb170 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:46.570720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-27dc801d-b85a-4662-a952-4e01faebb170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:46.586759 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-a07d4412-8153-4438-9492-371f4370a1b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9038b5acf7fb44c68267a467a252cd5a', 'request_id': 'req-a07d4412-8153-4438-9492-371f4370a1b2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:46.591615 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-a07d4412-8153-4438-9492-371f4370a1b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9038b5acf7fb44c68267a467a252cd5a', 'request_id': 'req-a07d4412-8153-4438-9492-371f4370a1b2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:46.602323 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-a07d4412-8153-4438-9492-371f4370a1b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9038b5acf7fb44c68267a467a252cd5a', 'request_id': 'req-a07d4412-8153-4438-9492-371f4370a1b2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:46.633347 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc801d-b85a-4662-a952-4e01faebb170 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:46.688890 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd02261-5df5-4688-99a7-630802da56d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:46.689485 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd02261-5df5-4688-99a7-630802da56d6 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:46.689775 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd02261-5df5-4688-99a7-630802da56d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:46.690194 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd02261-5df5-4688-99a7-630802da56d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:46.693855 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-a07d4412-8153-4438-9492-371f4370a1b2 admin admin] The token cache is being invalidate because project 9038b5acf7fb44c68267a467a252cd5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:57:46.698951 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-a07d4412-8153-4438-9492-371f4370a1b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:46.698951 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-a07d4412-8153-4438-9492-371f4370a1b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:57:46.698951 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1167/2366] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:57:46 2021] DELETE /identity/v3/projects/9038b5acf7fb44c68267a467a252cd5a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:57:46.702080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c0879-6a04-4930-a672-99fa75f0a853 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:46.702484 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c0879-6a04-4930-a672-99fa75f0a853 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:46.702864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c0879-6a04-4930-a672-99fa75f0a853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:46.725737 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-935c0879-6a04-4930-a672-99fa75f0a853 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:46.726995 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-935c0879-6a04-4930-a672-99fa75f0a853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:46.762370 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd02261-5df5-4688-99a7-630802da56d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:46.787668 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd02261-5df5-4688-99a7-630802da56d6 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:46.797673 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1200/2367] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:46 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:57:46.809850 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1168/2368] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:57:46.818067 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d43541-8bdb-499f-bffc-705e1696508d None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:46.818560 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d43541-8bdb-499f-bffc-705e1696508d None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:46.819128 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d43541-8bdb-499f-bffc-705e1696508d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:46.850531 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-52d43541-8bdb-499f-bffc-705e1696508d None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:46.851773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-52d43541-8bdb-499f-bffc-705e1696508d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:46.860078 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1201/2369] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:46.864603 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c0879-6a04-4930-a672-99fa75f0a853 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:46.874057 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c0879-6a04-4930-a672-99fa75f0a853 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:46.879032 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732779d-40c2-464d-a162-b780150c0cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:46.879695 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732779d-40c2-464d-a162-b780150c0cce admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:46.880052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732779d-40c2-464d-a162-b780150c0cce admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:46.880404 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732779d-40c2-464d-a162-b780150c0cce admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:46.881240 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732779d-40c2-464d-a162-b780150c0cce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:57:46.881652 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732779d-40c2-464d-a162-b780150c0cce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:46.910723 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732779d-40c2-464d-a162-b780150c0cce admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:46.925181 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1169/2370] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:57:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:57:46.926754 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d43541-8bdb-499f-bffc-705e1696508d None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:46.936296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d43541-8bdb-499f-bffc-705e1696508d None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:46.941061 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27dfd5-89f8-4380-acea-29f2f773b4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:46.941724 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27dfd5-89f8-4380-acea-29f2f773b4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:46.942192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27dfd5-89f8-4380-acea-29f2f773b4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:46.942535 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27dfd5-89f8-4380-acea-29f2f773b4e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:46.943179 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27dfd5-89f8-4380-acea-29f2f773b4e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:46.969105 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27dfd5-89f8-4380-acea-29f2f773b4e9 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:47.078407 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1202/2371] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:57:46 2021] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:57:47.083393 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732779d-40c2-464d-a162-b780150c0cce admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:47.093476 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732779d-40c2-464d-a162-b780150c0cce admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:47.166797 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73f1e2-f07e-49f7-9183-bdd4140a10f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:47.167415 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73f1e2-f07e-49f7-9183-bdd4140a10f0 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:47.167709 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73f1e2-f07e-49f7-9183-bdd4140a10f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:47.167989 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73f1e2-f07e-49f7-9183-bdd4140a10f0 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:47.168835 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73f1e2-f07e-49f7-9183-bdd4140a10f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:47.212917 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73f1e2-f07e-49f7-9183-bdd4140a10f0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:47.311191 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1170/2372] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:57:47 2021] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:57:47.314991 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27dfd5-89f8-4380-acea-29f2f773b4e9 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:47.335743 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27dfd5-89f8-4380-acea-29f2f773b4e9 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:47.335743 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac942b8-a0b5-404e-8d62-4ab283c2fc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:47.335743 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac942b8-a0b5-404e-8d62-4ab283c2fc5d admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:47.335743 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac942b8-a0b5-404e-8d62-4ab283c2fc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:47.336351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac942b8-a0b5-404e-8d62-4ab283c2fc5d admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:47.336351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac942b8-a0b5-404e-8d62-4ab283c2fc5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:47.358876 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac942b8-a0b5-404e-8d62-4ab283c2fc5d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:47.369170 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1203/2373] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:57:47 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:57:47.373248 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73f1e2-f07e-49f7-9183-bdd4140a10f0 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:47.382689 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73f1e2-f07e-49f7-9183-bdd4140a10f0 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:47.387332 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405138e9-ba44-4d75-9626-dc376c1d3ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:47.388202 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405138e9-ba44-4d75-9626-dc376c1d3ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:47.388553 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405138e9-ba44-4d75-9626-dc376c1d3ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:47.388922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405138e9-ba44-4d75-9626-dc376c1d3ab1 admin admin] PATH_INFO: `/v3/projects/41f591fc2ed0460697e96be9ff50f0a5/users/15d311469aff4599a0bc2739e1edf93f/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:47.410254 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405138e9-ba44-4d75-9626-dc376c1d3ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f591fc2ed0460697e96be9ff50f0a5, user_id=15d311469aff4599a0bc2739e1edf93f, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:47.437478 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405138e9-ba44-4d75-9626-dc376c1d3ab1 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:47.533740 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1171/2374] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:57:47 2021] PUT /identity/v3/projects/41f591fc2ed0460697e96be9ff50f0a5/users/15d311469aff4599a0bc2739e1edf93f/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:57:47.544821 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b4895-3526-4095-964f-fd220586104e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:47.545120 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b4895-3526-4095-964f-fd220586104e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:47.545405 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b4895-3526-4095-964f-fd220586104e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:47.584078 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-478b4895-3526-4095-964f-fd220586104e None None] MFA Rules not processed for user `15d311469aff4599a0bc2739e1edf93f`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:47.585219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-478b4895-3526-4095-964f-fd220586104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:47.664178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1204/2375] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:47 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:47.673473 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405138e9-ba44-4d75-9626-dc376c1d3ab1 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:47.675092 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-405138e9-ba44-4d75-9626-dc376c1d3ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:47.738115 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405138e9-ba44-4d75-9626-dc376c1d3ab1 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:47.741545 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb02fc-c0a7-4ac0-932c-994a2cc74ff6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:47.742121 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb02fc-c0a7-4ac0-932c-994a2cc74ff6 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:47.742414 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb02fc-c0a7-4ac0-932c-994a2cc74ff6 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:47.742701 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb02fc-c0a7-4ac0-932c-994a2cc74ff6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:47.751097 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb02fc-c0a7-4ac0-932c-994a2cc74ff6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:47.779731 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb02fc-c0a7-4ac0-932c-994a2cc74ff6 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:47.790676 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1172/2376] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:47 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:57:48.700861 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f315eb7-60a9-43f5-9131-0cecb74764b6 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:48.701317 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f315eb7-60a9-43f5-9131-0cecb74764b6 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:48.701586 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f315eb7-60a9-43f5-9131-0cecb74764b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:48.748247 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-5f315eb7-60a9-43f5-9131-0cecb74764b6 None None] MFA Rules not processed for user `4b2d7d6a773840d99ed391fb4a4def19`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:48.749687 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-5f315eb7-60a9-43f5-9131-0cecb74764b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:48.834328 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1205/2377] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:48 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:48.839365 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb02fc-c0a7-4ac0-932c-994a2cc74ff6 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:48.840759 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-c5bb02fc-c0a7-4ac0-932c-994a2cc74ff6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:48.852881 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb02fc-c0a7-4ac0-932c-994a2cc74ff6 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:48.857310 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519928d-a534-4603-ac01-ef0a2ade7929 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:48.857310 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519928d-a534-4603-ac01-ef0a2ade7929 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:48.857613 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519928d-a534-4603-ac01-ef0a2ade7929 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:48.857833 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519928d-a534-4603-ac01-ef0a2ade7929 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:48.868298 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519928d-a534-4603-ac01-ef0a2ade7929 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:48.894003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519928d-a534-4603-ac01-ef0a2ade7929 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:48.903466 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1173/2378] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:48 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:57:50.864473 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc935b1-3674-4a2e-8caa-e9ed37501861 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:50.865664 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc935b1-3674-4a2e-8caa-e9ed37501861 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:50.866717 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc935b1-3674-4a2e-8caa-e9ed37501861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:50.895788 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-fbc935b1-3674-4a2e-8caa-e9ed37501861 None None] MFA Rules not processed for user `4b2d7d6a773840d99ed391fb4a4def19`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:57:50.897128 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-fbc935b1-3674-4a2e-8caa-e9ed37501861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:50.907743 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1206/2379] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:57:50 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:57:51.612014 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519928d-a534-4603-ac01-ef0a2ade7929 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:51.614994 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2519928d-a534-4603-ac01-ef0a2ade7929 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:51.716050 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519928d-a534-4603-ac01-ef0a2ade7929 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:51.720282 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fde06d-2218-48c0-b383-dd461323fb8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:51.721178 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fde06d-2218-48c0-b383-dd461323fb8b service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:51.722290 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fde06d-2218-48c0-b383-dd461323fb8b service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:51.722831 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fde06d-2218-48c0-b383-dd461323fb8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:51.724929 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a8fde06d-2218-48c0-b383-dd461323fb8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:51.736169 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fde06d-2218-48c0-b383-dd461323fb8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:51.764803 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fde06d-2218-48c0-b383-dd461323fb8b service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:51.777783 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1174/2380] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:51 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:57:52.542648 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc935b1-3674-4a2e-8caa-e9ed37501861 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:52.544595 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-fbc935b1-3674-4a2e-8caa-e9ed37501861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:52.656663 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc935b1-3674-4a2e-8caa-e9ed37501861 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:52.673062 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a480f-95f2-4d1d-82f3-6039798b33a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4a6c587fd604395908134c50ce7618d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:52.673787 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a480f-95f2-4d1d-82f3-6039798b33a2 service placement] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:52.675047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a480f-95f2-4d1d-82f3-6039798b33a2 service placement] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:52.675475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a480f-95f2-4d1d-82f3-6039798b33a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:52.678291 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-7d0a480f-95f2-4d1d-82f3-6039798b33a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:52.699660 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a480f-95f2-4d1d-82f3-6039798b33a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:52.736417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a480f-95f2-4d1d-82f3-6039798b33a2 service placement] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:52.747414 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1207/2381] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:52 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:57:52.854090 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fde06d-2218-48c0-b383-dd461323fb8b service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:52.855527 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a8fde06d-2218-48c0-b383-dd461323fb8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:52.869979 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fde06d-2218-48c0-b383-dd461323fb8b service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:52.886497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6af42-a08c-46c3-8f04-ce524aec1178 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4a6c587fd604395908134c50ce7618d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:52.886497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6af42-a08c-46c3-8f04-ce524aec1178 service placement] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:52.886497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6af42-a08c-46c3-8f04-ce524aec1178 service placement] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:52.886497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6af42-a08c-46c3-8f04-ce524aec1178 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:52.886924 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-e3f6af42-a08c-46c3-8f04-ce524aec1178 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:52.888025 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6af42-a08c-46c3-8f04-ce524aec1178 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:52.913331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6af42-a08c-46c3-8f04-ce524aec1178 service placement] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:52.922900 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1175/2382] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:52 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:57:58.052590 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a480f-95f2-4d1d-82f3-6039798b33a2 service placement] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:58.054429 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-7d0a480f-95f2-4d1d-82f3-6039798b33a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:58.133772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a480f-95f2-4d1d-82f3-6039798b33a2 service placement] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:58.138800 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffffc1-9446-475e-b253-c8b7817d29c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:58.139377 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffffc1-9446-475e-b253-c8b7817d29c1 service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:58.139663 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffffc1-9446-475e-b253-c8b7817d29c1 service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:58.139940 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffffc1-9446-475e-b253-c8b7817d29c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:58.141584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-86ffffc1-9446-475e-b253-c8b7817d29c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:58.289719 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffffc1-9446-475e-b253-c8b7817d29c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:58.317910 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffffc1-9446-475e-b253-c8b7817d29c1 service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:58.327929 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1208/2383] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:58 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:57:58.909998 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6af42-a08c-46c3-8f04-ce524aec1178 service placement] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:57:58.921654 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6af42-a08c-46c3-8f04-ce524aec1178 service placement] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:57:58.926712 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997d00a-3e3c-40bf-ae6c-5a63b435818e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:57:58.927277 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997d00a-3e3c-40bf-ae6c-5a63b435818e service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:57:58.927565 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997d00a-3e3c-40bf-ae6c-5a63b435818e service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:57:58.927892 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997d00a-3e3c-40bf-ae6c-5a63b435818e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:57:58.929563 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-3997d00a-3e3c-40bf-ae6c-5a63b435818e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:57:58.997751 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997d00a-3e3c-40bf-ae6c-5a63b435818e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:57:59.026459 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997d00a-3e3c-40bf-ae6c-5a63b435818e service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:57:59.038237 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1176/2384] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:57:58 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:58:00.509981 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffffc1-9446-475e-b253-c8b7817d29c1 service nova] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:00.576190 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffffc1-9446-475e-b253-c8b7817d29c1 service nova] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:00.580892 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9face-27c2-4695-9b23-314a323f6a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:00.581682 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9face-27c2-4695-9b23-314a323f6a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:00.581964 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9face-27c2-4695-9b23-314a323f6a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:00.582241 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9face-27c2-4695-9b23-314a323f6a8e admin admin] PATH_INFO: `/v3/users/15d311469aff4599a0bc2739e1edf93f` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:00.583318 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9face-27c2-4695-9b23-314a323f6a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d311469aff4599a0bc2739e1edf93f)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:00.609151 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9face-27c2-4695-9b23-314a323f6a8e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:00.805202 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-e1d9face-27c2-4695-9b23-314a323f6a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d311469aff4599a0bc2739e1edf93f'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:00.806007 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-e1d9face-27c2-4695-9b23-314a323f6a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d311469aff4599a0bc2739e1edf93f'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:00.909633 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-e1d9face-27c2-4695-9b23-314a323f6a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d311469aff4599a0bc2739e1edf93f'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:00.917685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-e1d9face-27c2-4695-9b23-314a323f6a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d311469aff4599a0bc2739e1edf93f'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:00.918271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-e1d9face-27c2-4695-9b23-314a323f6a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d311469aff4599a0bc2739e1edf93f'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:00.936639 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1209/2385] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:58:00 2021] DELETE /identity/v3/users/15d311469aff4599a0bc2739e1edf93f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:58:00.941022 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17218617-fd4e-4907-80eb-e5a03d13fbcc None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:00.941511 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17218617-fd4e-4907-80eb-e5a03d13fbcc None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:00.941611 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17218617-fd4e-4907-80eb-e5a03d13fbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:00.963184 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-17218617-fd4e-4907-80eb-e5a03d13fbcc None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:58:00.964423 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-17218617-fd4e-4907-80eb-e5a03d13fbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:01.028822 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1177/2386] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:58:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:58:01.039140 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9face-27c2-4695-9b23-314a323f6a8e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:01.040455 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e1d9face-27c2-4695-9b23-314a323f6a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:01.102256 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9face-27c2-4695-9b23-314a323f6a8e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:01.105472 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bce41-9f9d-46e8-aa01-b7981222795f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:01.106038 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bce41-9f9d-46e8-aa01-b7981222795f service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:01.106323 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bce41-9f9d-46e8-aa01-b7981222795f service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:01.106602 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bce41-9f9d-46e8-aa01-b7981222795f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:01.115701 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bce41-9f9d-46e8-aa01-b7981222795f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:01.141180 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bce41-9f9d-46e8-aa01-b7981222795f service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:01.149932 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1210/2387] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:58:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:58:01.691136 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17218617-fd4e-4907-80eb-e5a03d13fbcc None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:01.692516 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-17218617-fd4e-4907-80eb-e5a03d13fbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:01.703974 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17218617-fd4e-4907-80eb-e5a03d13fbcc None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:01.708279 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c20a5-f068-4473-9fcd-a7bf9b3f7fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:01.709194 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c20a5-f068-4473-9fcd-a7bf9b3f7fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:01.709544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c20a5-f068-4473-9fcd-a7bf9b3f7fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:01.709887 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c20a5-f068-4473-9fcd-a7bf9b3f7fa2 admin admin] PATH_INFO: `/v3/projects/41f591fc2ed0460697e96be9ff50f0a5` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:01.711025 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c20a5-f068-4473-9fcd-a7bf9b3f7fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41f591fc2ed0460697e96be9ff50f0a5)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:01.738768 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c20a5-f068-4473-9fcd-a7bf9b3f7fa2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:01.842227 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-220c20a5-f068-4473-9fcd-a7bf9b3f7fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41f591fc2ed0460697e96be9ff50f0a5', 'request_id': 'req-220c20a5-f068-4473-9fcd-a7bf9b3f7fa2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:01.848415 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-220c20a5-f068-4473-9fcd-a7bf9b3f7fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41f591fc2ed0460697e96be9ff50f0a5', 'request_id': 'req-220c20a5-f068-4473-9fcd-a7bf9b3f7fa2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:01.858982 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-220c20a5-f068-4473-9fcd-a7bf9b3f7fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41f591fc2ed0460697e96be9ff50f0a5', 'request_id': 'req-220c20a5-f068-4473-9fcd-a7bf9b3f7fa2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:01.948922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-220c20a5-f068-4473-9fcd-a7bf9b3f7fa2 admin admin] The token cache is being invalidate because project 41f591fc2ed0460697e96be9ff50f0a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:58:01.949561 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-220c20a5-f068-4473-9fcd-a7bf9b3f7fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:01.949766 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-220c20a5-f068-4473-9fcd-a7bf9b3f7fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:01.951193 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1178/2388] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:58:01 2021] DELETE /identity/v3/projects/41f591fc2ed0460697e96be9ff50f0a5 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:58:01.957162 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fab859-1684-45cf-bd12-e9fc41a4254a None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:01.957771 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fab859-1684-45cf-bd12-e9fc41a4254a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:01.957771 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fab859-1684-45cf-bd12-e9fc41a4254a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:01.981458 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-b2fab859-1684-45cf-bd12-e9fc41a4254a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:58:01.982924 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-b2fab859-1684-45cf-bd12-e9fc41a4254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:02.049536 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1211/2389] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:58:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:58:02.057505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a8b87-2434-4c97-a1ab-0cdc21f675f3 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:02.057799 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a8b87-2434-4c97-a1ab-0cdc21f675f3 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:02.058088 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a8b87-2434-4c97-a1ab-0cdc21f675f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:02.082542 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-b73a8b87-2434-4c97-a1ab-0cdc21f675f3 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:58:02.083671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-b73a8b87-2434-4c97-a1ab-0cdc21f675f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:02.091028 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1179/2390] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:58:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:58:02.095165 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fab859-1684-45cf-bd12-e9fc41a4254a None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:02.104812 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fab859-1684-45cf-bd12-e9fc41a4254a None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:02.108996 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39d8d0-6367-4a42-ae52-9ee0e6dd7c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:02.109593 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39d8d0-6367-4a42-ae52-9ee0e6dd7c09 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:02.109880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39d8d0-6367-4a42-ae52-9ee0e6dd7c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:02.110157 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39d8d0-6367-4a42-ae52-9ee0e6dd7c09 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:02.110826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39d8d0-6367-4a42-ae52-9ee0e6dd7c09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:58:02.111123 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39d8d0-6367-4a42-ae52-9ee0e6dd7c09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:02.136023 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39d8d0-6367-4a42-ae52-9ee0e6dd7c09 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:02.149195 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1212/2391] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:58:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:58:02.153320 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a8b87-2434-4c97-a1ab-0cdc21f675f3 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:02.162693 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a8b87-2434-4c97-a1ab-0cdc21f675f3 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:02.167223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8584a66-5fad-49d1-8cbd-82e43c019c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:02.167791 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8584a66-5fad-49d1-8cbd-82e43c019c5a admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:02.168089 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8584a66-5fad-49d1-8cbd-82e43c019c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:02.168349 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8584a66-5fad-49d1-8cbd-82e43c019c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:02.169010 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8584a66-5fad-49d1-8cbd-82e43c019c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:02.194785 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8584a66-5fad-49d1-8cbd-82e43c019c5a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:02.301433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1180/2392] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:58:02 2021] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:58:02.306475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39d8d0-6367-4a42-ae52-9ee0e6dd7c09 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:02.316142 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39d8d0-6367-4a42-ae52-9ee0e6dd7c09 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:02.380079 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff77e8-a462-43f6-aa01-ead77a2eb909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:02.380716 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff77e8-a462-43f6-aa01-ead77a2eb909 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:02.381002 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff77e8-a462-43f6-aa01-ead77a2eb909 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:02.381277 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff77e8-a462-43f6-aa01-ead77a2eb909 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:02.381901 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff77e8-a462-43f6-aa01-ead77a2eb909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:02.408208 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff77e8-a462-43f6-aa01-ead77a2eb909 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:02.497917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1213/2393] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:58:02 2021] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:58:02.499119 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8584a66-5fad-49d1-8cbd-82e43c019c5a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:02.509588 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8584a66-5fad-49d1-8cbd-82e43c019c5a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:02.513972 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ab89d-4c50-4eb6-8a04-2d064e2b526a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:02.514648 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ab89d-4c50-4eb6-8a04-2d064e2b526a admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:02.515011 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ab89d-4c50-4eb6-8a04-2d064e2b526a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:02.515302 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ab89d-4c50-4eb6-8a04-2d064e2b526a admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:02.516011 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ab89d-4c50-4eb6-8a04-2d064e2b526a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:02.542112 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ab89d-4c50-4eb6-8a04-2d064e2b526a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:02.552346 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1181/2394] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:58:02 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:58:02.557116 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff77e8-a462-43f6-aa01-ead77a2eb909 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:02.567565 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff77e8-a462-43f6-aa01-ead77a2eb909 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:02.571883 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975780a-04d5-4421-9af1-29e698bbd457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:02.573936 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975780a-04d5-4421-9af1-29e698bbd457 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:02.573936 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975780a-04d5-4421-9af1-29e698bbd457 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:02.573936 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975780a-04d5-4421-9af1-29e698bbd457 admin admin] PATH_INFO: `/v3/projects/e97a243b107d49e88f0a17cbd77bce63/users/e0b1425fe2b640cdadd6d4bba510e813/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:02.595217 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975780a-04d5-4421-9af1-29e698bbd457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97a243b107d49e88f0a17cbd77bce63, user_id=e0b1425fe2b640cdadd6d4bba510e813, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:02.621278 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975780a-04d5-4421-9af1-29e698bbd457 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:02.683682 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1214/2395] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:58:02 2021] PUT /identity/v3/projects/e97a243b107d49e88f0a17cbd77bce63/users/e0b1425fe2b640cdadd6d4bba510e813/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:58:02.688982 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e413d10-2ef7-4dfc-ae17-65865df86f30 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:02.689302 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e413d10-2ef7-4dfc-ae17-65865df86f30 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:02.689723 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e413d10-2ef7-4dfc-ae17-65865df86f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:02.712427 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-4e413d10-2ef7-4dfc-ae17-65865df86f30 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:58:02.713678 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4e413d10-2ef7-4dfc-ae17-65865df86f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:02.784288 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1182/2396] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:58:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:58:02.793694 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975780a-04d5-4421-9af1-29e698bbd457 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:02.795221 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c975780a-04d5-4421-9af1-29e698bbd457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:02.856937 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975780a-04d5-4421-9af1-29e698bbd457 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:02.860277 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bd362-24ea-4b7f-b050-90e088b351fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:02.860893 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bd362-24ea-4b7f-b050-90e088b351fe service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:02.861179 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bd362-24ea-4b7f-b050-90e088b351fe service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:02.861501 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bd362-24ea-4b7f-b050-90e088b351fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:02.870287 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bd362-24ea-4b7f-b050-90e088b351fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:02.895233 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bd362-24ea-4b7f-b050-90e088b351fe service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:02.904023 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1215/2397] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:58:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:58:04.619073 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c0bae-892c-4ae9-b09b-778cfe352b96 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:04.619627 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c0bae-892c-4ae9-b09b-778cfe352b96 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:04.619627 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c0bae-892c-4ae9-b09b-778cfe352b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:04.656003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-d59c0bae-892c-4ae9-b09b-778cfe352b96 None None] MFA Rules not processed for user `e0b1425fe2b640cdadd6d4bba510e813`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:58:04.657189 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d59c0bae-892c-4ae9-b09b-778cfe352b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:04.732262 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1183/2398] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:58:04 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:58:04.741717 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bd362-24ea-4b7f-b050-90e088b351fe service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:04.743122 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e65bd362-24ea-4b7f-b050-90e088b351fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:04.816733 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bd362-24ea-4b7f-b050-90e088b351fe service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:04.820344 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad747b-05f0-4473-b304-4fba7649109f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:04.821166 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad747b-05f0-4473-b304-4fba7649109f service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:04.821524 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad747b-05f0-4473-b304-4fba7649109f service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:04.821883 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad747b-05f0-4473-b304-4fba7649109f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:04.831463 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad747b-05f0-4473-b304-4fba7649109f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:04.856235 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad747b-05f0-4473-b304-4fba7649109f service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:04.865503 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1216/2399] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:58:04 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:58:05.715961 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c0bae-892c-4ae9-b09b-778cfe352b96 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:05.727848 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c0bae-892c-4ae9-b09b-778cfe352b96 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:05.738397 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cc5c2-7ef1-4c2a-b526-323fe9b93f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:05.738992 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cc5c2-7ef1-4c2a-b526-323fe9b93f72 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:05.739278 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cc5c2-7ef1-4c2a-b526-323fe9b93f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:05.739558 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cc5c2-7ef1-4c2a-b526-323fe9b93f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:05.741265 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-966cc5c2-7ef1-4c2a-b526-323fe9b93f72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:05.750975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cc5c2-7ef1-4c2a-b526-323fe9b93f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:05.776173 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cc5c2-7ef1-4c2a-b526-323fe9b93f72 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:05.786701 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1184/2400] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:58:05 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:58:06.836401 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad6651-e196-4046-a610-e5198a578d22 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:06.836924 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad6651-e196-4046-a610-e5198a578d22 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:06.837019 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad6651-e196-4046-a610-e5198a578d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:06.859131 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-98ad6651-e196-4046-a610-e5198a578d22 None None] MFA Rules not processed for user `e0b1425fe2b640cdadd6d4bba510e813`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:58:06.860267 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-98ad6651-e196-4046-a610-e5198a578d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:06.866467 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1217/2401] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:58:06 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:58:12.498507 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cc5c2-7ef1-4c2a-b526-323fe9b93f72 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:12.500950 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-966cc5c2-7ef1-4c2a-b526-323fe9b93f72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:12.582867 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cc5c2-7ef1-4c2a-b526-323fe9b93f72 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:12.587741 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e4311-4fd4-488d-b881-0c6f5e2f6c44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:12.588317 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e4311-4fd4-488d-b881-0c6f5e2f6c44 service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:12.588634 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e4311-4fd4-488d-b881-0c6f5e2f6c44 service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:12.588919 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e4311-4fd4-488d-b881-0c6f5e2f6c44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:12.590549 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-b33e4311-4fd4-488d-b881-0c6f5e2f6c44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:12.602442 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e4311-4fd4-488d-b881-0c6f5e2f6c44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:12.627328 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e4311-4fd4-488d-b881-0c6f5e2f6c44 service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:12.637890 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1185/2402] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:58:12 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:58:14.859996 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d7f11-1c6a-48b5-a89b-b4188c24d89e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:14.860528 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d7f11-1c6a-48b5-a89b-b4188c24d89e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:14.860769 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d7f11-1c6a-48b5-a89b-b4188c24d89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:14.882768 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-6b7d7f11-1c6a-48b5-a89b-b4188c24d89e None None] MFA Rules not processed for user `4b2d7d6a773840d99ed391fb4a4def19`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:58:14.883924 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-6b7d7f11-1c6a-48b5-a89b-b4188c24d89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:14.944040 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1218/2403] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:58:14 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:58:15.353026 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e4311-4fd4-488d-b881-0c6f5e2f6c44 service nova] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:15.354442 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-b33e4311-4fd4-488d-b881-0c6f5e2f6c44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:15.364932 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e4311-4fd4-488d-b881-0c6f5e2f6c44 service nova] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:15.368188 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10948923-d060-4d3e-b155-19494cb7ce6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:15.368782 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10948923-d060-4d3e-b155-19494cb7ce6e service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:15.369068 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10948923-d060-4d3e-b155-19494cb7ce6e service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:15.369343 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10948923-d060-4d3e-b155-19494cb7ce6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:15.371456 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-10948923-d060-4d3e-b155-19494cb7ce6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:15.381426 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10948923-d060-4d3e-b155-19494cb7ce6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:15.406550 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10948923-d060-4d3e-b155-19494cb7ce6e service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:15.415125 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1186/2404] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:58:15 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:58:22.437156 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d7f11-1c6a-48b5-a89b-b4188c24d89e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:22.460194 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d7f11-1c6a-48b5-a89b-b4188c24d89e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:22.465605 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a653587-555d-40d3-baad-d74f58e456ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:22.466296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a653587-555d-40d3-baad-d74f58e456ba service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:22.466684 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a653587-555d-40d3-baad-d74f58e456ba service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:22.467004 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a653587-555d-40d3-baad-d74f58e456ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:22.468800 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1a653587-555d-40d3-baad-d74f58e456ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:22.484841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a653587-555d-40d3-baad-d74f58e456ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:22.514432 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a653587-555d-40d3-baad-d74f58e456ba service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:22.540465 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1219/2405] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:58:22 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:58:27.390186 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10948923-d060-4d3e-b155-19494cb7ce6e service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:27.391539 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-10948923-d060-4d3e-b155-19494cb7ce6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:27.406433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10948923-d060-4d3e-b155-19494cb7ce6e service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:27.412306 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77870c4-333b-4149-9b04-4a0b43acd093 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:27.416837 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77870c4-333b-4149-9b04-4a0b43acd093 service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:27.417336 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77870c4-333b-4149-9b04-4a0b43acd093 service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:27.417834 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77870c4-333b-4149-9b04-4a0b43acd093 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:27.419781 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-f77870c4-333b-4149-9b04-4a0b43acd093 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:27.433003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77870c4-333b-4149-9b04-4a0b43acd093 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:27.461730 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77870c4-333b-4149-9b04-4a0b43acd093 service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:27.472289 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1187/2406] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:58:27 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:58:34.909352 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d44532-a026-4684-8cd2-c1664f8daa4a None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:34.909843 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d44532-a026-4684-8cd2-c1664f8daa4a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:34.913726 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d44532-a026-4684-8cd2-c1664f8daa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:34.935540 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-f1d44532-a026-4684-8cd2-c1664f8daa4a None None] MFA Rules not processed for user `8f0dd32880d14ec9990bc09685d26326`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:58:34.936820 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f1d44532-a026-4684-8cd2-c1664f8daa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:35.000846 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1220/2407] 10.222.0.20 () {58 vars in 968 bytes} [Mon Aug 23 01:58:34 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:58:35.199734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77870c4-333b-4149-9b04-4a0b43acd093 service nova] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:35.202375 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-f77870c4-333b-4149-9b04-4a0b43acd093 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:35.309885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77870c4-333b-4149-9b04-4a0b43acd093 service nova] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:35.315125 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470310f-cd5f-494a-9006-3caba49c6445 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e4cab3c8cb4a18bf3c1a8a85d1675c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:35.315763 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470310f-cd5f-494a-9006-3caba49c6445 service swift] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:35.319911 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470310f-cd5f-494a-9006-3caba49c6445 service swift] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:35.319911 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470310f-cd5f-494a-9006-3caba49c6445 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:35.325098 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470310f-cd5f-494a-9006-3caba49c6445 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:35.350734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470310f-cd5f-494a-9006-3caba49c6445 service swift] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:35.359369 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1188/2408] 10.222.0.20 () {60 vars in 1385 bytes} [Mon Aug 23 01:58:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 01:58:44.817945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2ef2a-4bf0-4e48-9bc8-b4ec507daf44 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:44.817945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2ef2a-4bf0-4e48-9bc8-b4ec507daf44 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:44.817945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2ef2a-4bf0-4e48-9bc8-b4ec507daf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:44.842920 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-c7a2ef2a-4bf0-4e48-9bc8-b4ec507daf44 None None] MFA Rules not processed for user `8f0dd32880d14ec9990bc09685d26326`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:58:44.844156 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c7a2ef2a-4bf0-4e48-9bc8-b4ec507daf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:44.851253 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1221/2409] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Aug 23 01:58:44 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:58:44.865190 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470310f-cd5f-494a-9006-3caba49c6445 service swift] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:44.878833 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470310f-cd5f-494a-9006-3caba49c6445 service swift] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:44.883811 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589d7ea-6d9c-4b62-9138-18fe47d6354c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e4cab3c8cb4a18bf3c1a8a85d1675c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:44.884455 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589d7ea-6d9c-4b62-9138-18fe47d6354c service swift] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:44.884998 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589d7ea-6d9c-4b62-9138-18fe47d6354c service swift] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:44.885490 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589d7ea-6d9c-4b62-9138-18fe47d6354c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:44.894584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589d7ea-6d9c-4b62-9138-18fe47d6354c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:44.922120 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589d7ea-6d9c-4b62-9138-18fe47d6354c service swift] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:44.931499 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1189/2410] 10.222.0.20 () {60 vars in 1385 bytes} [Mon Aug 23 01:58:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 01:58:52.047812 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2ef2a-4bf0-4e48-9bc8-b4ec507daf44 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:52.050154 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c7a2ef2a-4bf0-4e48-9bc8-b4ec507daf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:52.067242 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2ef2a-4bf0-4e48-9bc8-b4ec507daf44 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:52.075298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa6d26-b0ec-4259-8d3b-030635ad1992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:52.079488 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa6d26-b0ec-4259-8d3b-030635ad1992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:52.079488 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa6d26-b0ec-4259-8d3b-030635ad1992 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:52.079488 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa6d26-b0ec-4259-8d3b-030635ad1992 admin admin] PATH_INFO: `/v3/users/9a5a674999d04291ba10cea6cefba4b1` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:52.079488 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa6d26-b0ec-4259-8d3b-030635ad1992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a5a674999d04291ba10cea6cefba4b1)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:52.106902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa6d26-b0ec-4259-8d3b-030635ad1992 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:52.377994 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-6baa6d26-b0ec-4259-8d3b-030635ad1992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a5a674999d04291ba10cea6cefba4b1'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:52.378950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-6baa6d26-b0ec-4259-8d3b-030635ad1992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a5a674999d04291ba10cea6cefba4b1'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:52.464812 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-6baa6d26-b0ec-4259-8d3b-030635ad1992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a5a674999d04291ba10cea6cefba4b1'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:52.475951 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-6baa6d26-b0ec-4259-8d3b-030635ad1992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a5a674999d04291ba10cea6cefba4b1'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:52.479705 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-6baa6d26-b0ec-4259-8d3b-030635ad1992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a5a674999d04291ba10cea6cefba4b1'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:52.520196 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1222/2411] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:58:52 2021] DELETE /identity/v3/users/9a5a674999d04291ba10cea6cefba4b1 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:58:53.265136 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589d7ea-6d9c-4b62-9138-18fe47d6354c service swift] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:53.276239 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589d7ea-6d9c-4b62-9138-18fe47d6354c service swift] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:53.344505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e33cfe-eda5-4354-bb19-be964f5d29fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:53.345330 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e33cfe-eda5-4354-bb19-be964f5d29fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:53.345625 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e33cfe-eda5-4354-bb19-be964f5d29fd admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:53.345909 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e33cfe-eda5-4354-bb19-be964f5d29fd admin admin] PATH_INFO: `/v3/projects/0fe01aed9b14497fb422023bf8bea00d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:53.347020 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e33cfe-eda5-4354-bb19-be964f5d29fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe01aed9b14497fb422023bf8bea00d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:53.376055 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e33cfe-eda5-4354-bb19-be964f5d29fd admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:53.490706 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-54e33cfe-eda5-4354-bb19-be964f5d29fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe01aed9b14497fb422023bf8bea00d', 'request_id': 'req-54e33cfe-eda5-4354-bb19-be964f5d29fd'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:53.498704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-54e33cfe-eda5-4354-bb19-be964f5d29fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe01aed9b14497fb422023bf8bea00d', 'request_id': 'req-54e33cfe-eda5-4354-bb19-be964f5d29fd'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:53.513114 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-54e33cfe-eda5-4354-bb19-be964f5d29fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe01aed9b14497fb422023bf8bea00d', 'request_id': 'req-54e33cfe-eda5-4354-bb19-be964f5d29fd'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:53.597700 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-54e33cfe-eda5-4354-bb19-be964f5d29fd admin admin] The token cache is being invalidate because project 0fe01aed9b14497fb422023bf8bea00d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:58:53.598118 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-54e33cfe-eda5-4354-bb19-be964f5d29fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:53.598797 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-54e33cfe-eda5-4354-bb19-be964f5d29fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:53.602201 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1190/2412] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:58:53 2021] DELETE /identity/v3/projects/0fe01aed9b14497fb422023bf8bea00d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:58:53.610065 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa6d26-b0ec-4259-8d3b-030635ad1992 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:53.613840 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-6baa6d26-b0ec-4259-8d3b-030635ad1992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:53.638161 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa6d26-b0ec-4259-8d3b-030635ad1992 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:53.749138 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c93153-5451-404d-9f1b-f7e3e8d470c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:53.750659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c93153-5451-404d-9f1b-f7e3e8d470c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:53.751187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c93153-5451-404d-9f1b-f7e3e8d470c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:53.751733 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c93153-5451-404d-9f1b-f7e3e8d470c1 admin admin] PATH_INFO: `/v3/users/8279360e15b34b93bb3ff5e17dc36b3a` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:53.754508 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c93153-5451-404d-9f1b-f7e3e8d470c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8279360e15b34b93bb3ff5e17dc36b3a)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:53.784883 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c93153-5451-404d-9f1b-f7e3e8d470c1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:54.021265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-13c93153-5451-404d-9f1b-f7e3e8d470c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8279360e15b34b93bb3ff5e17dc36b3a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:54.021806 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-13c93153-5451-404d-9f1b-f7e3e8d470c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8279360e15b34b93bb3ff5e17dc36b3a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:54.099108 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-13c93153-5451-404d-9f1b-f7e3e8d470c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8279360e15b34b93bb3ff5e17dc36b3a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:54.110000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-13c93153-5451-404d-9f1b-f7e3e8d470c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8279360e15b34b93bb3ff5e17dc36b3a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:54.110876 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-13c93153-5451-404d-9f1b-f7e3e8d470c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8279360e15b34b93bb3ff5e17dc36b3a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:54.130821 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1223/2413] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:58:53 2021] DELETE /identity/v3/users/8279360e15b34b93bb3ff5e17dc36b3a => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:58:54.477715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e33cfe-eda5-4354-bb19-be964f5d29fd admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:54.479655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-54e33cfe-eda5-4354-bb19-be964f5d29fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:54.494957 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e33cfe-eda5-4354-bb19-be964f5d29fd admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:54.576082 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1fdf8-2190-4e69-a220-2ec1030c847f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:54.577241 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1fdf8-2190-4e69-a220-2ec1030c847f admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:54.577772 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1fdf8-2190-4e69-a220-2ec1030c847f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:54.578767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1fdf8-2190-4e69-a220-2ec1030c847f admin admin] PATH_INFO: `/v3/projects/86e95ebb2d744047be79d946e14d900e` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:54.580537 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1fdf8-2190-4e69-a220-2ec1030c847f admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e95ebb2d744047be79d946e14d900e)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:54.618143 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1fdf8-2190-4e69-a220-2ec1030c847f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:54.775516 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5ff1fdf8-2190-4e69-a220-2ec1030c847f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e95ebb2d744047be79d946e14d900e', 'request_id': 'req-5ff1fdf8-2190-4e69-a220-2ec1030c847f'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:54.782410 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5ff1fdf8-2190-4e69-a220-2ec1030c847f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e95ebb2d744047be79d946e14d900e', 'request_id': 'req-5ff1fdf8-2190-4e69-a220-2ec1030c847f'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:54.795566 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5ff1fdf8-2190-4e69-a220-2ec1030c847f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e95ebb2d744047be79d946e14d900e', 'request_id': 'req-5ff1fdf8-2190-4e69-a220-2ec1030c847f'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:54.888370 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5ff1fdf8-2190-4e69-a220-2ec1030c847f admin admin] The token cache is being invalidate because project 86e95ebb2d744047be79d946e14d900e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:58:54.888956 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5ff1fdf8-2190-4e69-a220-2ec1030c847f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:54.889731 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5ff1fdf8-2190-4e69-a220-2ec1030c847f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:58:54.892037 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1191/2414] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:58:54 2021] DELETE /identity/v3/projects/86e95ebb2d744047be79d946e14d900e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:58:54.900137 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456314c7-bd95-402d-8a7b-9b1a0563c560 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:54.901016 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456314c7-bd95-402d-8a7b-9b1a0563c560 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:54.901016 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456314c7-bd95-402d-8a7b-9b1a0563c560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:54.930125 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-456314c7-bd95-402d-8a7b-9b1a0563c560 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:58:54.931775 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-456314c7-bd95-402d-8a7b-9b1a0563c560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:55.001185 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1224/2415] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:58:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:58:55.009663 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b92cd-5830-4f57-b72a-8b0e4f2fc1a7 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:55.009967 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b92cd-5830-4f57-b72a-8b0e4f2fc1a7 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:55.010253 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b92cd-5830-4f57-b72a-8b0e4f2fc1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:55.034153 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-012b92cd-5830-4f57-b72a-8b0e4f2fc1a7 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:58:55.035456 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-012b92cd-5830-4f57-b72a-8b0e4f2fc1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:55.051114 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1192/2416] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:58:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:58:55.052539 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456314c7-bd95-402d-8a7b-9b1a0563c560 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:55.063928 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456314c7-bd95-402d-8a7b-9b1a0563c560 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:55.071226 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83af819-1a19-4f17-96aa-21668fd95377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:55.073265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83af819-1a19-4f17-96aa-21668fd95377 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:55.073956 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83af819-1a19-4f17-96aa-21668fd95377 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:55.074410 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83af819-1a19-4f17-96aa-21668fd95377 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:55.075428 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83af819-1a19-4f17-96aa-21668fd95377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:58:55.075870 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83af819-1a19-4f17-96aa-21668fd95377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:55.104263 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83af819-1a19-4f17-96aa-21668fd95377 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:55.118877 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1225/2417] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:58:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:58:55.124363 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b92cd-5830-4f57-b72a-8b0e4f2fc1a7 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:55.134850 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b92cd-5830-4f57-b72a-8b0e4f2fc1a7 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:55.140163 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4bd75-4509-4d9e-ab81-bfd1b1c74e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:55.141722 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4bd75-4509-4d9e-ab81-bfd1b1c74e7c admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:55.142086 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4bd75-4509-4d9e-ab81-bfd1b1c74e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:55.142468 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4bd75-4509-4d9e-ab81-bfd1b1c74e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:55.143408 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4bd75-4509-4d9e-ab81-bfd1b1c74e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:55.172584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4bd75-4509-4d9e-ab81-bfd1b1c74e7c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:55.261140 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1193/2418] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:58:55 2021] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:58:55.265674 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83af819-1a19-4f17-96aa-21668fd95377 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:55.279222 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83af819-1a19-4f17-96aa-21668fd95377 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:55.373902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb76bef-9696-4d9c-bfc3-2fd602e21641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:55.374694 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb76bef-9696-4d9c-bfc3-2fd602e21641 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:55.375047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb76bef-9696-4d9c-bfc3-2fd602e21641 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:55.375390 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb76bef-9696-4d9c-bfc3-2fd602e21641 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:55.376139 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb76bef-9696-4d9c-bfc3-2fd602e21641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:55.412526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb76bef-9696-4d9c-bfc3-2fd602e21641 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:55.492648 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1226/2419] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:58:55 2021] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:58:55.496354 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4bd75-4509-4d9e-ab81-bfd1b1c74e7c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:55.507661 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4bd75-4509-4d9e-ab81-bfd1b1c74e7c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:55.512333 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca343e-40f8-456f-91d2-51ec8f60ffc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:55.513014 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca343e-40f8-456f-91d2-51ec8f60ffc6 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:55.513334 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca343e-40f8-456f-91d2-51ec8f60ffc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:55.513618 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca343e-40f8-456f-91d2-51ec8f60ffc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:55.514312 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca343e-40f8-456f-91d2-51ec8f60ffc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:55.542619 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca343e-40f8-456f-91d2-51ec8f60ffc6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:55.554473 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1194/2420] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:58:55 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:58:55.558490 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb76bef-9696-4d9c-bfc3-2fd602e21641 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:55.574089 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb76bef-9696-4d9c-bfc3-2fd602e21641 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:55.587185 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4a5a8-58fb-4305-a8bc-7918de4164d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:55.587791 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4a5a8-58fb-4305-a8bc-7918de4164d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:55.588192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4a5a8-58fb-4305-a8bc-7918de4164d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:55.588620 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4a5a8-58fb-4305-a8bc-7918de4164d6 admin admin] PATH_INFO: `/v3/projects/382ca8f9b14441659267fc49d336434f/users/9a8e4253a98b44659801d40e83cf8f75/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:55.622074 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4a5a8-58fb-4305-a8bc-7918de4164d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=382ca8f9b14441659267fc49d336434f, user_id=9a8e4253a98b44659801d40e83cf8f75, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:55.651986 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4a5a8-58fb-4305-a8bc-7918de4164d6 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:55.806724 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1227/2421] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:58:55 2021] PUT /identity/v3/projects/382ca8f9b14441659267fc49d336434f/users/9a8e4253a98b44659801d40e83cf8f75/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:58:55.812353 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4333e-948a-4204-9985-613f08d91579 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:55.813366 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4333e-948a-4204-9985-613f08d91579 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:55.813933 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4333e-948a-4204-9985-613f08d91579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:55.847574 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-7de4333e-948a-4204-9985-613f08d91579 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:58:55.848892 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-7de4333e-948a-4204-9985-613f08d91579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:55.969684 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1195/2422] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:58:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:58:55.981008 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4a5a8-58fb-4305-a8bc-7918de4164d6 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:55.982979 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ede4a5a8-58fb-4305-a8bc-7918de4164d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:56.150930 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4a5a8-58fb-4305-a8bc-7918de4164d6 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:56.157200 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44bd2b-a736-4cbd-8c83-f69e2ed101b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:56.157912 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44bd2b-a736-4cbd-8c83-f69e2ed101b3 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:56.158330 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44bd2b-a736-4cbd-8c83-f69e2ed101b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:56.158692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44bd2b-a736-4cbd-8c83-f69e2ed101b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:56.170674 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44bd2b-a736-4cbd-8c83-f69e2ed101b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:56.198789 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44bd2b-a736-4cbd-8c83-f69e2ed101b3 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:56.215415 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1228/2423] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:58:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:58:57.199655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fd692-5b60-4397-985c-0b280da16363 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:57.200183 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fd692-5b60-4397-985c-0b280da16363 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:57.200843 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fd692-5b60-4397-985c-0b280da16363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:57.229498 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-d75fd692-5b60-4397-985c-0b280da16363 None None] MFA Rules not processed for user `8f0dd32880d14ec9990bc09685d26326`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:58:57.230676 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d75fd692-5b60-4397-985c-0b280da16363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:57.316606 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1196/2424] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Aug 23 01:58:57 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:58:57.331777 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44bd2b-a736-4cbd-8c83-f69e2ed101b3 service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:58:57.331777 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-5e44bd2b-a736-4cbd-8c83-f69e2ed101b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:58:57.430571 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44bd2b-a736-4cbd-8c83-f69e2ed101b3 service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:58:57.436349 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e0f68-2b6a-48cc-af71-f87bd734e5fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e4cab3c8cb4a18bf3c1a8a85d1675c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:58:57.437221 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e0f68-2b6a-48cc-af71-f87bd734e5fb service swift] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:58:57.437650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e0f68-2b6a-48cc-af71-f87bd734e5fb service swift] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:58:57.438025 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e0f68-2b6a-48cc-af71-f87bd734e5fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:58:57.449529 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e0f68-2b6a-48cc-af71-f87bd734e5fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:58:57.482855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e0f68-2b6a-48cc-af71-f87bd734e5fb service swift] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:58:57.493433 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1229/2425] 10.222.0.20 () {60 vars in 1385 bytes} [Mon Aug 23 01:58:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 01:59:08.284335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c90a32-0fa5-4d9c-9d8d-cfb158aa2e27 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:08.284942 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c90a32-0fa5-4d9c-9d8d-cfb158aa2e27 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:08.284942 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c90a32-0fa5-4d9c-9d8d-cfb158aa2e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:08.334631 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-82c90a32-0fa5-4d9c-9d8d-cfb158aa2e27 None None] MFA Rules not processed for user `9a8e4253a98b44659801d40e83cf8f75`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:08.336831 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-82c90a32-0fa5-4d9c-9d8d-cfb158aa2e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:08.636824 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1197/2426] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:59:08 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:59:08.637952 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e0f68-2b6a-48cc-af71-f87bd734e5fb service swift] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:08.650134 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e0f68-2b6a-48cc-af71-f87bd734e5fb service swift] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:08.673375 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4591399-1161-4a5e-ab39-d8a8b279a732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:08.674362 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4591399-1161-4a5e-ab39-d8a8b279a732 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:08.674817 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4591399-1161-4a5e-ab39-d8a8b279a732 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:08.681371 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4591399-1161-4a5e-ab39-d8a8b279a732 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:08.681371 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4591399-1161-4a5e-ab39-d8a8b279a732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:08.768866 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4591399-1161-4a5e-ab39-d8a8b279a732 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:08.963417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1230/2427] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:59:08 2021] POST /identity/v3/projects => generated 379 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:59:08.967477 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c90a32-0fa5-4d9c-9d8d-cfb158aa2e27 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:08.979984 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c90a32-0fa5-4d9c-9d8d-cfb158aa2e27 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:09.133071 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da294f50-ca28-4188-88cd-babf449f1f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:09.133817 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da294f50-ca28-4188-88cd-babf449f1f5b admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:09.134209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da294f50-ca28-4188-88cd-babf449f1f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:09.134591 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da294f50-ca28-4188-88cd-babf449f1f5b admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:09.135335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da294f50-ca28-4188-88cd-babf449f1f5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:09.165620 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da294f50-ca28-4188-88cd-babf449f1f5b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:09.281292 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1198/2428] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:59:08 2021] POST /identity/v3/users => generated 296 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:59:09.281465 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4591399-1161-4a5e-ab39-d8a8b279a732 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:09.298219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4591399-1161-4a5e-ab39-d8a8b279a732 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:09.333528 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43f86e-d6db-451d-a620-d4a22af343a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:09.335740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43f86e-d6db-451d-a620-d4a22af343a6 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:09.338033 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43f86e-d6db-451d-a620-d4a22af343a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:09.338852 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43f86e-d6db-451d-a620-d4a22af343a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:09.339952 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43f86e-d6db-451d-a620-d4a22af343a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:09.467546 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43f86e-d6db-451d-a620-d4a22af343a6 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:09.467546 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1231/2429] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:59:09 2021] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:59:09.469034 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da294f50-ca28-4188-88cd-babf449f1f5b admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:09.482367 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da294f50-ca28-4188-88cd-babf449f1f5b admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:09.487411 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654bef9-287a-4a9e-91c6-5997598f97c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:09.488284 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654bef9-287a-4a9e-91c6-5997598f97c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:09.488628 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654bef9-287a-4a9e-91c6-5997598f97c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:09.488923 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654bef9-287a-4a9e-91c6-5997598f97c1 admin admin] PATH_INFO: `/v3/projects/56e253c94fb54dc3867572ce45ab0914/users/0b0ceb645da84a6faf4c758a0f1a4922/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:09.511594 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654bef9-287a-4a9e-91c6-5997598f97c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e253c94fb54dc3867572ce45ab0914, user_id=0b0ceb645da84a6faf4c758a0f1a4922, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:09.542073 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654bef9-287a-4a9e-91c6-5997598f97c1 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:09.961777 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1199/2430] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:59:09 2021] PUT /identity/v3/projects/56e253c94fb54dc3867572ce45ab0914/users/0b0ceb645da84a6faf4c758a0f1a4922/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:59:09.965688 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43f86e-d6db-451d-a620-d4a22af343a6 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:09.976063 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43f86e-d6db-451d-a620-d4a22af343a6 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:10.054297 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf0f54-c75d-4592-86be-a55a56a5d6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:10.054914 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf0f54-c75d-4592-86be-a55a56a5d6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:10.055202 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf0f54-c75d-4592-86be-a55a56a5d6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:10.055482 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf0f54-c75d-4592-86be-a55a56a5d6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:10.056204 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf0f54-c75d-4592-86be-a55a56a5d6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:10.094350 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf0f54-c75d-4592-86be-a55a56a5d6a0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:10.110382 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1232/2431] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:59:09 2021] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:59:10.114259 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654bef9-287a-4a9e-91c6-5997598f97c1 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:10.122296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654bef9-287a-4a9e-91c6-5997598f97c1 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:10.127420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9972f1-b5df-41c9-904f-17a4e45f39a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:10.128331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9972f1-b5df-41c9-904f-17a4e45f39a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:10.128722 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9972f1-b5df-41c9-904f-17a4e45f39a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:10.129075 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9972f1-b5df-41c9-904f-17a4e45f39a2 admin admin] PATH_INFO: `/v3/projects/56e253c94fb54dc3867572ce45ab0914/users/0b0ceb645da84a6faf4c758a0f1a4922/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:10.131597 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9972f1-b5df-41c9-904f-17a4e45f39a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e253c94fb54dc3867572ce45ab0914, user_id=0b0ceb645da84a6faf4c758a0f1a4922, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:10.159853 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9972f1-b5df-41c9-904f-17a4e45f39a2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:10.180412 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf0f54-c75d-4592-86be-a55a56a5d6a0 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:10.183077 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1200/2432] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:59:10 2021] PUT /identity/v3/projects/56e253c94fb54dc3867572ce45ab0914/users/0b0ceb645da84a6faf4c758a0f1a4922/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:59:10.191421 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf0f54-c75d-4592-86be-a55a56a5d6a0 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:10.280109 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381a1af-02b9-4a2d-bebb-535f8e21f3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:10.285048 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381a1af-02b9-4a2d-bebb-535f8e21f3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:10.286561 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381a1af-02b9-4a2d-bebb-535f8e21f3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:10.287675 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381a1af-02b9-4a2d-bebb-535f8e21f3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:10.288481 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381a1af-02b9-4a2d-bebb-535f8e21f3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:10.337487 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381a1af-02b9-4a2d-bebb-535f8e21f3c3 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:10.351319 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1233/2433] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:59:10 2021] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:59:10.355157 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9972f1-b5df-41c9-904f-17a4e45f39a2 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:10.365975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9972f1-b5df-41c9-904f-17a4e45f39a2 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:10.370819 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017a8c8-490d-4121-a0e3-03850b74ce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:10.371642 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017a8c8-490d-4121-a0e3-03850b74ce50 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:10.371935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017a8c8-490d-4121-a0e3-03850b74ce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:10.372296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017a8c8-490d-4121-a0e3-03850b74ce50 admin admin] PATH_INFO: `/v3/projects/56e253c94fb54dc3867572ce45ab0914/users/0b0ceb645da84a6faf4c758a0f1a4922/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:10.374260 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017a8c8-490d-4121-a0e3-03850b74ce50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e253c94fb54dc3867572ce45ab0914, user_id=0b0ceb645da84a6faf4c758a0f1a4922, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:10.414018 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017a8c8-490d-4121-a0e3-03850b74ce50 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:10.518708 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1201/2434] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:59:10 2021] PUT /identity/v3/projects/56e253c94fb54dc3867572ce45ab0914/users/0b0ceb645da84a6faf4c758a0f1a4922/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:59:11.656585 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab018ea-0726-48ae-ac52-d5bd85cde4bd None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:11.657661 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab018ea-0726-48ae-ac52-d5bd85cde4bd None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:11.658009 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab018ea-0726-48ae-ac52-d5bd85cde4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:11.685466 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-dab018ea-0726-48ae-ac52-d5bd85cde4bd None None] MFA Rules not processed for user `8f0dd32880d14ec9990bc09685d26326`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:11.687172 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-dab018ea-0726-48ae-ac52-d5bd85cde4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:11.779634 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1234/2435] 10.222.0.20 () {58 vars in 968 bytes} [Mon Aug 23 01:59:11 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:59:11.796993 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017a8c8-490d-4121-a0e3-03850b74ce50 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:11.908686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017a8c8-490d-4121-a0e3-03850b74ce50 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:11.913912 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef567f3-34f5-4676-bfb0-086ba1ce81db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e4cab3c8cb4a18bf3c1a8a85d1675c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:11.914674 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef567f3-34f5-4676-bfb0-086ba1ce81db service swift] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:11.915113 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef567f3-34f5-4676-bfb0-086ba1ce81db service swift] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:11.915543 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef567f3-34f5-4676-bfb0-086ba1ce81db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:11.929053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef567f3-34f5-4676-bfb0-086ba1ce81db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:11.962044 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef567f3-34f5-4676-bfb0-086ba1ce81db service swift] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:11.972011 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1202/2436] 10.222.0.20 () {60 vars in 1385 bytes} [Mon Aug 23 01:59:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 01:59:16.840253 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab018ea-0726-48ae-ac52-d5bd85cde4bd None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:16.842899 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-dab018ea-0726-48ae-ac52-d5bd85cde4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:17.017783 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab018ea-0726-48ae-ac52-d5bd85cde4bd None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:17.025221 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059f5c6-6770-4b4e-a27a-cd4253077963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:17.026040 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059f5c6-6770-4b4e-a27a-cd4253077963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:17.026333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059f5c6-6770-4b4e-a27a-cd4253077963 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:17.026662 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059f5c6-6770-4b4e-a27a-cd4253077963 admin admin] PATH_INFO: `/v3/users/4b2d7d6a773840d99ed391fb4a4def19` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:17.029419 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059f5c6-6770-4b4e-a27a-cd4253077963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b2d7d6a773840d99ed391fb4a4def19)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:17.057366 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059f5c6-6770-4b4e-a27a-cd4253077963 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:17.376983 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-6059f5c6-6770-4b4e-a27a-cd4253077963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b2d7d6a773840d99ed391fb4a4def19'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:17.378066 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-6059f5c6-6770-4b4e-a27a-cd4253077963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b2d7d6a773840d99ed391fb4a4def19'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:17.464176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-6059f5c6-6770-4b4e-a27a-cd4253077963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b2d7d6a773840d99ed391fb4a4def19'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:17.483885 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-6059f5c6-6770-4b4e-a27a-cd4253077963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b2d7d6a773840d99ed391fb4a4def19'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:17.488897 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-6059f5c6-6770-4b4e-a27a-cd4253077963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b2d7d6a773840d99ed391fb4a4def19'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:17.510104 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1235/2437] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:59:16 2021] DELETE /identity/v3/users/4b2d7d6a773840d99ed391fb4a4def19 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:59:18.094528 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef567f3-34f5-4676-bfb0-086ba1ce81db service swift] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:18.105241 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef567f3-34f5-4676-bfb0-086ba1ce81db service swift] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:18.175728 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d06637-650a-4b64-a314-89905e60a659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:18.176433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d06637-650a-4b64-a314-89905e60a659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:18.176757 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d06637-650a-4b64-a314-89905e60a659 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:18.177042 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d06637-650a-4b64-a314-89905e60a659 admin admin] PATH_INFO: `/v3/projects/e8f6d9e7b11d49b083d606c833a2ab49` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:18.178775 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d06637-650a-4b64-a314-89905e60a659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f6d9e7b11d49b083d606c833a2ab49)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:18.208865 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d06637-650a-4b64-a314-89905e60a659 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:18.367637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-36d06637-650a-4b64-a314-89905e60a659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f6d9e7b11d49b083d606c833a2ab49', 'request_id': 'req-36d06637-650a-4b64-a314-89905e60a659'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:18.372707 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-36d06637-650a-4b64-a314-89905e60a659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f6d9e7b11d49b083d606c833a2ab49', 'request_id': 'req-36d06637-650a-4b64-a314-89905e60a659'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:18.384666 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-36d06637-650a-4b64-a314-89905e60a659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f6d9e7b11d49b083d606c833a2ab49', 'request_id': 'req-36d06637-650a-4b64-a314-89905e60a659'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:18.502604 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-36d06637-650a-4b64-a314-89905e60a659 admin admin] The token cache is being invalidate because project e8f6d9e7b11d49b083d606c833a2ab49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:59:18.502846 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-36d06637-650a-4b64-a314-89905e60a659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:18.503456 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-36d06637-650a-4b64-a314-89905e60a659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:18.504930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1203/2438] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:59:18 2021] DELETE /identity/v3/projects/e8f6d9e7b11d49b083d606c833a2ab49 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:59:18.512068 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2c3f6-4e20-48d2-99ed-4e5e1def2b29 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:18.512556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2c3f6-4e20-48d2-99ed-4e5e1def2b29 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:18.514486 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2c3f6-4e20-48d2-99ed-4e5e1def2b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:18.535318 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-0eb2c3f6-4e20-48d2-99ed-4e5e1def2b29 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:18.536475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0eb2c3f6-4e20-48d2-99ed-4e5e1def2b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:18.603995 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1236/2439] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:59:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:59:18.611205 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7aff-aebc-4ca5-8a15-d41f9dc591a1 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:18.611499 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7aff-aebc-4ca5-8a15-d41f9dc591a1 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:18.611782 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7aff-aebc-4ca5-8a15-d41f9dc591a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:18.634547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-10bc7aff-aebc-4ca5-8a15-d41f9dc591a1 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:18.635769 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-10bc7aff-aebc-4ca5-8a15-d41f9dc591a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:18.643679 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1204/2440] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:59:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:59:18.647822 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2c3f6-4e20-48d2-99ed-4e5e1def2b29 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:18.657266 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2c3f6-4e20-48d2-99ed-4e5e1def2b29 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:18.661598 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be744b20-3e8d-4108-a401-797f94093cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:18.662267 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be744b20-3e8d-4108-a401-797f94093cfd admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:18.662625 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be744b20-3e8d-4108-a401-797f94093cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:18.662976 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be744b20-3e8d-4108-a401-797f94093cfd admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:18.663719 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be744b20-3e8d-4108-a401-797f94093cfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:59:18.664085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be744b20-3e8d-4108-a401-797f94093cfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:18.690722 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be744b20-3e8d-4108-a401-797f94093cfd admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:18.704001 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1237/2441] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:59:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:59:18.708463 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc7aff-aebc-4ca5-8a15-d41f9dc591a1 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:18.717537 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc7aff-aebc-4ca5-8a15-d41f9dc591a1 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:18.721895 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec40670-0ab1-484f-8f99-c1a42036c429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:18.722493 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec40670-0ab1-484f-8f99-c1a42036c429 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:18.722788 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec40670-0ab1-484f-8f99-c1a42036c429 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:18.723069 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec40670-0ab1-484f-8f99-c1a42036c429 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:18.723700 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec40670-0ab1-484f-8f99-c1a42036c429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:18.750483 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec40670-0ab1-484f-8f99-c1a42036c429 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:18.860002 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1205/2442] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:59:18 2021] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:59:18.864235 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be744b20-3e8d-4108-a401-797f94093cfd admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:18.873902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be744b20-3e8d-4108-a401-797f94093cfd admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:18.940165 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2cb12-c99d-4689-b2f6-84b48af55d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:18.940957 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2cb12-c99d-4689-b2f6-84b48af55d36 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:18.941346 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2cb12-c99d-4689-b2f6-84b48af55d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:18.941631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2cb12-c99d-4689-b2f6-84b48af55d36 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:18.942266 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2cb12-c99d-4689-b2f6-84b48af55d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:18.970016 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2cb12-c99d-4689-b2f6-84b48af55d36 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:19.109424 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1238/2443] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:59:18 2021] POST /identity/v3/users => generated 285 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:59:19.113658 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec40670-0ab1-484f-8f99-c1a42036c429 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:19.125473 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec40670-0ab1-484f-8f99-c1a42036c429 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:19.133090 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3afac-25ff-4fe4-8c3e-e8542d291204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:19.133993 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3afac-25ff-4fe4-8c3e-e8542d291204 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:19.134481 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3afac-25ff-4fe4-8c3e-e8542d291204 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:19.135106 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3afac-25ff-4fe4-8c3e-e8542d291204 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:19.136011 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3afac-25ff-4fe4-8c3e-e8542d291204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:19.165767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3afac-25ff-4fe4-8c3e-e8542d291204 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:19.177820 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1206/2444] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:59:19 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:59:19.182085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2cb12-c99d-4689-b2f6-84b48af55d36 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:19.193480 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2cb12-c99d-4689-b2f6-84b48af55d36 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:19.198870 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3e7b5-a8a8-4e05-ad1d-2fe3cd9f92c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:19.199851 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3e7b5-a8a8-4e05-ad1d-2fe3cd9f92c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:19.200403 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3e7b5-a8a8-4e05-ad1d-2fe3cd9f92c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:19.200883 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3e7b5-a8a8-4e05-ad1d-2fe3cd9f92c0 admin admin] PATH_INFO: `/v3/projects/d4b175cd3af34d2bb6d83ab69ed4c546/users/08939bdcd46b412d9abf88829400c3c6/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:19.225811 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3e7b5-a8a8-4e05-ad1d-2fe3cd9f92c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b175cd3af34d2bb6d83ab69ed4c546, user_id=08939bdcd46b412d9abf88829400c3c6, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:19.257961 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3e7b5-a8a8-4e05-ad1d-2fe3cd9f92c0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:19.360945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1239/2445] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:59:19 2021] PUT /identity/v3/projects/d4b175cd3af34d2bb6d83ab69ed4c546/users/08939bdcd46b412d9abf88829400c3c6/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:59:19.368827 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6c779-7530-49ba-b229-172a89aa6020 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:19.369260 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6c779-7530-49ba-b229-172a89aa6020 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:19.369671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6c779-7530-49ba-b229-172a89aa6020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:19.423864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-00b6c779-7530-49ba-b229-172a89aa6020 None None] MFA Rules not processed for user `08939bdcd46b412d9abf88829400c3c6`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:19.425185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-00b6c779-7530-49ba-b229-172a89aa6020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:19.520302 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1207/2446] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:59:19 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:59:19.531727 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237b479-8236-45d5-8284-451ee2c1cd62 None None] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:19.532264 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237b479-8236-45d5-8284-451ee2c1cd62 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:19.532502 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237b479-8236-45d5-8284-451ee2c1cd62 None None] PATH_INFO: `/` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:19.534629 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1240/2447] 10.222.0.20 () {54 vars in 962 bytes} [Mon Aug 23 01:59:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 01:59:19.539501 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f7654-9c80-4387-be6c-1a971a0446b4 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:19.539800 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f7654-9c80-4387-be6c-1a971a0446b4 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:19.540084 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f7654-9c80-4387-be6c-1a971a0446b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:19.718995 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-716f7654-9c80-4387-be6c-1a971a0446b4 None None] MFA Rules not processed for user `913cd471ba494382af7dda858b9010c2`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:19.720305 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-716f7654-9c80-4387-be6c-1a971a0446b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:19.809661 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1208/2448] 10.222.0.20 () {58 vars in 1060 bytes} [Mon Aug 23 01:59:19 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:59:19.817555 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237b479-8236-45d5-8284-451ee2c1cd62 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:19.833917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237b479-8236-45d5-8284-451ee2c1cd62 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:19.839613 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35de78b-60b8-44e9-8783-f8467b8be77e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913cd471ba494382af7dda858b9010c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:19.841151 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35de78b-60b8-44e9-8783-f8467b8be77e service glance] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:19.841609 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35de78b-60b8-44e9-8783-f8467b8be77e service glance] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:19.841900 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35de78b-60b8-44e9-8783-f8467b8be77e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:19.851669 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35de78b-60b8-44e9-8783-f8467b8be77e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:19.877674 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35de78b-60b8-44e9-8783-f8467b8be77e service glance] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:19.888490 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1241/2449] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:59:19 2021] GET /identity/v3/auth/tokens => generated 3676 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 01:59:20.670617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d5d1-98ec-423d-b28f-0eebc048d724 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:20.671695 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d5d1-98ec-423d-b28f-0eebc048d724 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:20.671906 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d5d1-98ec-423d-b28f-0eebc048d724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:20.737628 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-ed24d5d1-98ec-423d-b28f-0eebc048d724 None None] MFA Rules not processed for user `0b0ceb645da84a6faf4c758a0f1a4922`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:20.739024 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-ed24d5d1-98ec-423d-b28f-0eebc048d724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:20.927524 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1209/2450] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:59:20 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:59:20.963608 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35de78b-60b8-44e9-8783-f8467b8be77e service glance] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:20.966011 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-b35de78b-60b8-44e9-8783-f8467b8be77e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:21.054199 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35de78b-60b8-44e9-8783-f8467b8be77e service glance] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:21.059449 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e733e06-516f-428b-ac62-959a0831b8ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:21.069950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e733e06-516f-428b-ac62-959a0831b8ba service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:21.069950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e733e06-516f-428b-ac62-959a0831b8ba service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:21.069950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e733e06-516f-428b-ac62-959a0831b8ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:21.069950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-2e733e06-516f-428b-ac62-959a0831b8ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:21.150725 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e733e06-516f-428b-ac62-959a0831b8ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:21.179549 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e733e06-516f-428b-ac62-959a0831b8ba service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:21.190002 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1242/2451] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:59:20 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:59:31.072274 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24d5d1-98ec-423d-b28f-0eebc048d724 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:31.073730 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-ed24d5d1-98ec-423d-b28f-0eebc048d724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:31.137077 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24d5d1-98ec-423d-b28f-0eebc048d724 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:31.141611 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfebb9-570a-42ce-ab93-13c346a63929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:31.142659 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfebb9-570a-42ce-ab93-13c346a63929 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:31.143460 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfebb9-570a-42ce-ab93-13c346a63929 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:31.143748 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfebb9-570a-42ce-ab93-13c346a63929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:31.145967 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2cbfebb9-570a-42ce-ab93-13c346a63929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:31.218024 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfebb9-570a-42ce-ab93-13c346a63929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:31.243643 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfebb9-570a-42ce-ab93-13c346a63929 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:31.253594 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1210/2452] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:59:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:59:33.596299 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a41e4e-c95a-4e0a-a160-221ecab552e2 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:33.596801 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a41e4e-c95a-4e0a-a160-221ecab552e2 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:33.597033 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a41e4e-c95a-4e0a-a160-221ecab552e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:33.619633 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-b6a41e4e-c95a-4e0a-a160-221ecab552e2 None None] MFA Rules not processed for user `8f0dd32880d14ec9990bc09685d26326`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:33.620904 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-b6a41e4e-c95a-4e0a-a160-221ecab552e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:33.683560 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1243/2453] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Aug 23 01:59:33 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:59:33.695477 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfebb9-570a-42ce-ab93-13c346a63929 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:33.696988 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2cbfebb9-570a-42ce-ab93-13c346a63929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:33.775038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfebb9-570a-42ce-ab93-13c346a63929 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:33.779766 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b604c7c-fd01-48de-9f56-0b6cfc5d6fed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e4cab3c8cb4a18bf3c1a8a85d1675c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:33.780960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b604c7c-fd01-48de-9f56-0b6cfc5d6fed service swift] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:33.785111 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b604c7c-fd01-48de-9f56-0b6cfc5d6fed service swift] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:33.785111 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b604c7c-fd01-48de-9f56-0b6cfc5d6fed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:33.789693 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b604c7c-fd01-48de-9f56-0b6cfc5d6fed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:33.816938 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b604c7c-fd01-48de-9f56-0b6cfc5d6fed service swift] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:33.825660 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1211/2454] 10.222.0.20 () {60 vars in 1385 bytes} [Mon Aug 23 01:59:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 01:59:38.839233 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a41e4e-c95a-4e0a-a160-221ecab552e2 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:38.840773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-b6a41e4e-c95a-4e0a-a160-221ecab552e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:38.854881 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a41e4e-c95a-4e0a-a160-221ecab552e2 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:38.872336 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abe08e-aab6-4def-afed-507f284cabc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:38.873495 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abe08e-aab6-4def-afed-507f284cabc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:38.876248 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abe08e-aab6-4def-afed-507f284cabc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:38.876824 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abe08e-aab6-4def-afed-507f284cabc0 admin admin] PATH_INFO: `/v3/users/3b6dbf69f7d344b7973747af9cb118ec` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:38.878210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abe08e-aab6-4def-afed-507f284cabc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b6dbf69f7d344b7973747af9cb118ec)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:38.924470 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abe08e-aab6-4def-afed-507f284cabc0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:39.117935 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-84abe08e-aab6-4def-afed-507f284cabc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b6dbf69f7d344b7973747af9cb118ec'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:39.118590 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-84abe08e-aab6-4def-afed-507f284cabc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b6dbf69f7d344b7973747af9cb118ec'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:39.235513 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-84abe08e-aab6-4def-afed-507f284cabc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b6dbf69f7d344b7973747af9cb118ec'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:39.243552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-84abe08e-aab6-4def-afed-507f284cabc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b6dbf69f7d344b7973747af9cb118ec'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:39.244179 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-84abe08e-aab6-4def-afed-507f284cabc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b6dbf69f7d344b7973747af9cb118ec'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:39.261851 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1244/2455] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:59:38 2021] DELETE /identity/v3/users/3b6dbf69f7d344b7973747af9cb118ec => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:59:39.650436 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b604c7c-fd01-48de-9f56-0b6cfc5d6fed service swift] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:39.661299 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b604c7c-fd01-48de-9f56-0b6cfc5d6fed service swift] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:39.728633 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45071d-ae5b-4703-8ec2-f122a220731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:39.729337 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45071d-ae5b-4703-8ec2-f122a220731b admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:39.729624 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45071d-ae5b-4703-8ec2-f122a220731b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:39.729903 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45071d-ae5b-4703-8ec2-f122a220731b admin admin] PATH_INFO: `/v3/projects/3e8a365a2ff64421bef434d3568b128e` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:39.730966 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45071d-ae5b-4703-8ec2-f122a220731b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e8a365a2ff64421bef434d3568b128e)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:39.756965 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45071d-ae5b-4703-8ec2-f122a220731b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:39.870885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fa45071d-ae5b-4703-8ec2-f122a220731b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e8a365a2ff64421bef434d3568b128e', 'request_id': 'req-fa45071d-ae5b-4703-8ec2-f122a220731b'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:39.877088 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fa45071d-ae5b-4703-8ec2-f122a220731b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e8a365a2ff64421bef434d3568b128e', 'request_id': 'req-fa45071d-ae5b-4703-8ec2-f122a220731b'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:39.895868 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fa45071d-ae5b-4703-8ec2-f122a220731b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e8a365a2ff64421bef434d3568b128e', 'request_id': 'req-fa45071d-ae5b-4703-8ec2-f122a220731b'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:39.967160 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fa45071d-ae5b-4703-8ec2-f122a220731b admin admin] The token cache is being invalidate because project 3e8a365a2ff64421bef434d3568b128e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:59:39.970395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fa45071d-ae5b-4703-8ec2-f122a220731b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:39.970395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fa45071d-ae5b-4703-8ec2-f122a220731b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:39.970395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1212/2456] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:59:39 2021] DELETE /identity/v3/projects/3e8a365a2ff64421bef434d3568b128e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:59:39.976124 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda8507-311f-460d-9357-5b88a28d1f96 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:39.977091 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda8507-311f-460d-9357-5b88a28d1f96 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:39.977379 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda8507-311f-460d-9357-5b88a28d1f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:40.023500 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-9fda8507-311f-460d-9357-5b88a28d1f96 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:40.024692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-9fda8507-311f-460d-9357-5b88a28d1f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:40.121754 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1245/2457] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:59:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:59:40.129768 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386ef69-ebe3-465f-8d0c-dd804d3fa3fa None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:40.130080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386ef69-ebe3-465f-8d0c-dd804d3fa3fa None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:40.130366 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386ef69-ebe3-465f-8d0c-dd804d3fa3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:40.161204 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-b386ef69-ebe3-465f-8d0c-dd804d3fa3fa None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:40.163245 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-b386ef69-ebe3-465f-8d0c-dd804d3fa3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:40.171634 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1213/2458] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:59:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:59:40.175653 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda8507-311f-460d-9357-5b88a28d1f96 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:40.186631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda8507-311f-460d-9357-5b88a28d1f96 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:40.190803 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4263a11-3c09-4809-829b-dbc67dd5a347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:40.191391 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4263a11-3c09-4809-829b-dbc67dd5a347 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:40.191676 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4263a11-3c09-4809-829b-dbc67dd5a347 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:40.191956 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4263a11-3c09-4809-829b-dbc67dd5a347 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:40.192722 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4263a11-3c09-4809-829b-dbc67dd5a347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:59:40.193047 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4263a11-3c09-4809-829b-dbc67dd5a347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:40.219541 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4263a11-3c09-4809-829b-dbc67dd5a347 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:40.234246 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1246/2459] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:59:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 01:59:40.242161 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386ef69-ebe3-465f-8d0c-dd804d3fa3fa None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:40.262145 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386ef69-ebe3-465f-8d0c-dd804d3fa3fa None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:40.274124 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708754f4-f89e-4c4b-b44d-bb3bd72407bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:40.274795 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708754f4-f89e-4c4b-b44d-bb3bd72407bd admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:40.275084 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708754f4-f89e-4c4b-b44d-bb3bd72407bd admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:40.275565 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708754f4-f89e-4c4b-b44d-bb3bd72407bd admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:40.276374 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708754f4-f89e-4c4b-b44d-bb3bd72407bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:40.307994 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708754f4-f89e-4c4b-b44d-bb3bd72407bd admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:40.408647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1214/2460] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:59:40 2021] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:59:40.409798 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4263a11-3c09-4809-829b-dbc67dd5a347 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:40.426285 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4263a11-3c09-4809-829b-dbc67dd5a347 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:40.497584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d31086-29de-400c-8a3b-fc1ad029599e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:40.498107 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d31086-29de-400c-8a3b-fc1ad029599e admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:40.499033 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d31086-29de-400c-8a3b-fc1ad029599e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:40.499322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d31086-29de-400c-8a3b-fc1ad029599e admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:40.499950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d31086-29de-400c-8a3b-fc1ad029599e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:40.526217 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d31086-29de-400c-8a3b-fc1ad029599e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:40.635270 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1247/2461] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:59:40 2021] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:59:40.639944 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708754f4-f89e-4c4b-b44d-bb3bd72407bd admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:40.649935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708754f4-f89e-4c4b-b44d-bb3bd72407bd admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:40.654160 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f95338-0cc8-4e3e-aabc-070e81075b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:40.655810 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f95338-0cc8-4e3e-aabc-070e81075b15 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:40.655810 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f95338-0cc8-4e3e-aabc-070e81075b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:40.655966 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f95338-0cc8-4e3e-aabc-070e81075b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:40.656590 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f95338-0cc8-4e3e-aabc-070e81075b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:40.682341 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f95338-0cc8-4e3e-aabc-070e81075b15 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:40.695405 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1215/2462] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:59:40 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:59:40.699757 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d31086-29de-400c-8a3b-fc1ad029599e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:40.709955 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d31086-29de-400c-8a3b-fc1ad029599e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:40.714764 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40fed8-4c4b-4305-8ffd-632df7265d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:40.715603 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40fed8-4c4b-4305-8ffd-632df7265d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:40.715893 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40fed8-4c4b-4305-8ffd-632df7265d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:40.716177 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40fed8-4c4b-4305-8ffd-632df7265d18 admin admin] PATH_INFO: `/v3/projects/3ebd607cee3745cda2d50c2159c98c81/users/55fb182d7faa4231ae6c21a885bb0c2d/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:40.743867 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40fed8-4c4b-4305-8ffd-632df7265d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ebd607cee3745cda2d50c2159c98c81, user_id=55fb182d7faa4231ae6c21a885bb0c2d, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:40.775914 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40fed8-4c4b-4305-8ffd-632df7265d18 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:40.862904 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1248/2463] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:59:40 2021] PUT /identity/v3/projects/3ebd607cee3745cda2d50c2159c98c81/users/55fb182d7faa4231ae6c21a885bb0c2d/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:59:40.873088 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853e01d-7044-44aa-8253-bd182da2f4bd None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:40.873916 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853e01d-7044-44aa-8253-bd182da2f4bd None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:40.874204 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853e01d-7044-44aa-8253-bd182da2f4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:40.923887 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-7853e01d-7044-44aa-8253-bd182da2f4bd None None] MFA Rules not processed for user `55fb182d7faa4231ae6c21a885bb0c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:40.925460 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-7853e01d-7044-44aa-8253-bd182da2f4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:41.004245 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1216/2464] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:59:40 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:59:41.015891 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40fed8-4c4b-4305-8ffd-632df7265d18 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:41.019772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1b40fed8-4c4b-4305-8ffd-632df7265d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:41.065090 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3da53d-d546-4214-9b83-6290d76843c1 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:41.065413 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3da53d-d546-4214-9b83-6290d76843c1 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:41.065696 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3da53d-d546-4214-9b83-6290d76843c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:41.091576 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-7d3da53d-d546-4214-9b83-6290d76843c1 None None] MFA Rules not processed for user `e0b1425fe2b640cdadd6d4bba510e813`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:41.092969 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-7d3da53d-d546-4214-9b83-6290d76843c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:41.105881 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40fed8-4c4b-4305-8ffd-632df7265d18 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:41.111966 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e779ef1-503d-4621-bddd-70563818bcfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:41.112988 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e779ef1-503d-4621-bddd-70563818bcfc service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:41.113537 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e779ef1-503d-4621-bddd-70563818bcfc service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:41.113987 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e779ef1-503d-4621-bddd-70563818bcfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:41.123049 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e779ef1-503d-4621-bddd-70563818bcfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:41.149838 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e779ef1-503d-4621-bddd-70563818bcfc service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:41.159493 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1249/2465] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:59:41 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:59:41.184108 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1217/2466] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:59:41 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:59:46.189996 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e779ef1-503d-4621-bddd-70563818bcfc service nova] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:46.266155 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e779ef1-503d-4621-bddd-70563818bcfc service nova] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:46.270750 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b008181-7c64-4566-9cff-530462133fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:46.271558 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b008181-7c64-4566-9cff-530462133fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:46.271842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b008181-7c64-4566-9cff-530462133fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:46.272122 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b008181-7c64-4566-9cff-530462133fd7 admin admin] PATH_INFO: `/v3/users/55fb182d7faa4231ae6c21a885bb0c2d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:46.273347 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b008181-7c64-4566-9cff-530462133fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55fb182d7faa4231ae6c21a885bb0c2d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:46.300108 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b008181-7c64-4566-9cff-530462133fd7 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:46.546597 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4b008181-7c64-4566-9cff-530462133fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55fb182d7faa4231ae6c21a885bb0c2d'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:46.547204 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4b008181-7c64-4566-9cff-530462133fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55fb182d7faa4231ae6c21a885bb0c2d'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:46.623566 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4b008181-7c64-4566-9cff-530462133fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55fb182d7faa4231ae6c21a885bb0c2d'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:46.631566 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4b008181-7c64-4566-9cff-530462133fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55fb182d7faa4231ae6c21a885bb0c2d'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:46.632161 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4b008181-7c64-4566-9cff-530462133fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55fb182d7faa4231ae6c21a885bb0c2d'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:46.650164 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1250/2467] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 01:59:46 2021] DELETE /identity/v3/users/55fb182d7faa4231ae6c21a885bb0c2d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:59:46.655899 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de817ce1-a77f-44b7-a5e8-5ee55c6ae06c None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:46.655899 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de817ce1-a77f-44b7-a5e8-5ee55c6ae06c None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:46.656393 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de817ce1-a77f-44b7-a5e8-5ee55c6ae06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:46.676975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-de817ce1-a77f-44b7-a5e8-5ee55c6ae06c None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:46.678482 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-de817ce1-a77f-44b7-a5e8-5ee55c6ae06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:46.766514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1218/2468] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:59:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:59:46.777240 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b008181-7c64-4566-9cff-530462133fd7 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:46.778826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-4b008181-7c64-4566-9cff-530462133fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:46.861484 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b008181-7c64-4566-9cff-530462133fd7 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:46.865434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792bbba-c42a-4805-a408-f3f663ef63e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:46.865434 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792bbba-c42a-4805-a408-f3f663ef63e8 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:46.865673 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792bbba-c42a-4805-a408-f3f663ef63e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:46.865905 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792bbba-c42a-4805-a408-f3f663ef63e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:46.875325 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792bbba-c42a-4805-a408-f3f663ef63e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:46.901349 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792bbba-c42a-4805-a408-f3f663ef63e8 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:46.911146 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1251/2469] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:59:46 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:59:47.485112 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de817ce1-a77f-44b7-a5e8-5ee55c6ae06c None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:47.486602 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-de817ce1-a77f-44b7-a5e8-5ee55c6ae06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:47.497921 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de817ce1-a77f-44b7-a5e8-5ee55c6ae06c None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:47.505641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a26d2a-418e-498d-869f-e509662e1ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:47.506493 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26d2a-418e-498d-869f-e509662e1ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:47.506751 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26d2a-418e-498d-869f-e509662e1ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:47.507009 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26d2a-418e-498d-869f-e509662e1ef9 admin admin] PATH_INFO: `/v3/projects/3ebd607cee3745cda2d50c2159c98c81` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:47.508515 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a26d2a-418e-498d-869f-e509662e1ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ebd607cee3745cda2d50c2159c98c81)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:47.539001 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a26d2a-418e-498d-869f-e509662e1ef9 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:47.667975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b5a26d2a-418e-498d-869f-e509662e1ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ebd607cee3745cda2d50c2159c98c81', 'request_id': 'req-b5a26d2a-418e-498d-869f-e509662e1ef9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:47.674773 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b5a26d2a-418e-498d-869f-e509662e1ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ebd607cee3745cda2d50c2159c98c81', 'request_id': 'req-b5a26d2a-418e-498d-869f-e509662e1ef9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:47.688001 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b5a26d2a-418e-498d-869f-e509662e1ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ebd607cee3745cda2d50c2159c98c81', 'request_id': 'req-b5a26d2a-418e-498d-869f-e509662e1ef9'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:47.772265 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b5a26d2a-418e-498d-869f-e509662e1ef9 admin admin] The token cache is being invalidate because project 3ebd607cee3745cda2d50c2159c98c81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 01:59:47.772587 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b5a26d2a-418e-498d-869f-e509662e1ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:47.773272 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-b5a26d2a-418e-498d-869f-e509662e1ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 01:59:47.774805 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1219/2470] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 01:59:47 2021] DELETE /identity/v3/projects/3ebd607cee3745cda2d50c2159c98c81 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:59:47.781301 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3af35-7bff-4179-84fe-d0e279ae4172 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:47.781855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3af35-7bff-4179-84fe-d0e279ae4172 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:47.781855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3af35-7bff-4179-84fe-d0e279ae4172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:47.806222 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-78a3af35-7bff-4179-84fe-d0e279ae4172 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:47.807371 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-78a3af35-7bff-4179-84fe-d0e279ae4172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:47.885590 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1252/2471] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:59:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 01:59:47.885957 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d613ba8-d527-48f4-858b-930a4b8a00c1 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:47.886258 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d613ba8-d527-48f4-858b-930a4b8a00c1 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:47.886541 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d613ba8-d527-48f4-858b-930a4b8a00c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:47.916666 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-4d613ba8-d527-48f4-858b-930a4b8a00c1 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:47.917927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4d613ba8-d527-48f4-858b-930a4b8a00c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:47.932454 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3af35-7bff-4179-84fe-d0e279ae4172 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:47.938765 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1220/2472] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:59:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:59:47.941986 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3af35-7bff-4179-84fe-d0e279ae4172 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:47.946456 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04852c-4e24-4610-bda7-35637785810f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:47.947181 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04852c-4e24-4610-bda7-35637785810f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:47.947689 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04852c-4e24-4610-bda7-35637785810f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:47.947970 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04852c-4e24-4610-bda7-35637785810f admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:47.948705 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04852c-4e24-4610-bda7-35637785810f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 01:59:47.949008 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04852c-4e24-4610-bda7-35637785810f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:47.975550 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04852c-4e24-4610-bda7-35637785810f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:47.993272 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d613ba8-d527-48f4-858b-930a4b8a00c1 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:47.996756 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1253/2473] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 01:59:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 01:59:48.002597 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d613ba8-d527-48f4-858b-930a4b8a00c1 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:48.007209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da004096-0e36-49d2-a7f7-0735d79e6aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:48.008052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da004096-0e36-49d2-a7f7-0735d79e6aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:48.008528 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da004096-0e36-49d2-a7f7-0735d79e6aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:48.009176 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da004096-0e36-49d2-a7f7-0735d79e6aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:48.010024 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da004096-0e36-49d2-a7f7-0735d79e6aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:48.038054 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da004096-0e36-49d2-a7f7-0735d79e6aa2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:48.152001 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1221/2474] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:59:47 2021] POST /identity/v3/projects => generated 357 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 01:59:48.156450 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04852c-4e24-4610-bda7-35637785810f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:48.166074 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04852c-4e24-4610-bda7-35637785810f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:48.242147 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2e79f-b90a-44fe-9993-6e5e76794842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:48.243411 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2e79f-b90a-44fe-9993-6e5e76794842 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:48.243411 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2e79f-b90a-44fe-9993-6e5e76794842 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:48.244343 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2e79f-b90a-44fe-9993-6e5e76794842 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:48.245201 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2e79f-b90a-44fe-9993-6e5e76794842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:48.275513 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2e79f-b90a-44fe-9993-6e5e76794842 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:48.363631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1254/2475] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:59:48 2021] POST /identity/v3/users => generated 279 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:59:48.367542 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da004096-0e36-49d2-a7f7-0735d79e6aa2 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:48.380621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da004096-0e36-49d2-a7f7-0735d79e6aa2 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:48.397623 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818cafb-bcb0-408e-9ad3-e55e469716e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:48.398221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818cafb-bcb0-408e-9ad3-e55e469716e8 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:48.398517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818cafb-bcb0-408e-9ad3-e55e469716e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:48.398954 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818cafb-bcb0-408e-9ad3-e55e469716e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:48.399663 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818cafb-bcb0-408e-9ad3-e55e469716e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:48.435338 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818cafb-bcb0-408e-9ad3-e55e469716e8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:48.450724 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1222/2476] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:59:48 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:59:48.452165 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2e79f-b90a-44fe-9993-6e5e76794842 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:48.465598 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2e79f-b90a-44fe-9993-6e5e76794842 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:48.475865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bb901-17d1-4c15-97a8-58d070bc8748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:48.477023 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bb901-17d1-4c15-97a8-58d070bc8748 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:48.479876 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bb901-17d1-4c15-97a8-58d070bc8748 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:48.480254 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bb901-17d1-4c15-97a8-58d070bc8748 admin admin] PATH_INFO: `/v3/projects/f44d365af0a64e35856fb1d8f793581a/users/802f44f483374c2984b1db06ce7244b0/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:48.526643 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bb901-17d1-4c15-97a8-58d070bc8748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44d365af0a64e35856fb1d8f793581a, user_id=802f44f483374c2984b1db06ce7244b0, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:48.554894 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bb901-17d1-4c15-97a8-58d070bc8748 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:48.646591 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1255/2477] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:59:48 2021] PUT /identity/v3/projects/f44d365af0a64e35856fb1d8f793581a/users/802f44f483374c2984b1db06ce7244b0/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:59:48.658314 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728b366-7002-4290-a577-90429dccaa6f None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:48.658614 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728b366-7002-4290-a577-90429dccaa6f None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:48.658898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728b366-7002-4290-a577-90429dccaa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:48.700547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-8728b366-7002-4290-a577-90429dccaa6f None None] MFA Rules not processed for user `802f44f483374c2984b1db06ce7244b0`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:48.701937 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-8728b366-7002-4290-a577-90429dccaa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:48.776659 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1223/2478] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:59:48 2021] POST /identity/v3/auth/tokens => generated 3664 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:59:48.781321 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bb901-17d1-4c15-97a8-58d070bc8748 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:48.850788 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bb901-17d1-4c15-97a8-58d070bc8748 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:48.855556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d5a16-a215-4340-bfea-466fe7a1f98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:48.858158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d5a16-a215-4340-bfea-466fe7a1f98b admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:48.858158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d5a16-a215-4340-bfea-466fe7a1f98b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:48.858158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d5a16-a215-4340-bfea-466fe7a1f98b admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:48.858158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d5a16-a215-4340-bfea-466fe7a1f98b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:48.884029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d5a16-a215-4340-bfea-466fe7a1f98b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:48.958228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1256/2479] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 01:59:48 2021] POST /identity/v3/projects => generated 357 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:59:48.962092 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728b366-7002-4290-a577-90429dccaa6f None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:48.974068 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728b366-7002-4290-a577-90429dccaa6f None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:49.050139 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bca20-61a6-4494-a1ae-0d66682410f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:49.050739 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bca20-61a6-4494-a1ae-0d66682410f2 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:49.051026 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bca20-61a6-4494-a1ae-0d66682410f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:49.051306 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bca20-61a6-4494-a1ae-0d66682410f2 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:49.051974 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bca20-61a6-4494-a1ae-0d66682410f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:49.079465 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bca20-61a6-4494-a1ae-0d66682410f2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:49.246681 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1224/2480] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 01:59:48 2021] POST /identity/v3/users => generated 285 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 01:59:49.251140 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d5a16-a215-4340-bfea-466fe7a1f98b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:49.260956 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d5a16-a215-4340-bfea-466fe7a1f98b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:49.265743 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597edfdb-9cea-4e6b-a7b4-d0b3f4fdd0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:49.266320 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597edfdb-9cea-4e6b-a7b4-d0b3f4fdd0cd admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:49.266604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597edfdb-9cea-4e6b-a7b4-d0b3f4fdd0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:49.266879 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597edfdb-9cea-4e6b-a7b4-d0b3f4fdd0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:49.267557 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597edfdb-9cea-4e6b-a7b4-d0b3f4fdd0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:49.292752 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597edfdb-9cea-4e6b-a7b4-d0b3f4fdd0cd admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:49.304978 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1257/2481] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:59:49 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 01:59:49.309100 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bca20-61a6-4494-a1ae-0d66682410f2 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:49.319437 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bca20-61a6-4494-a1ae-0d66682410f2 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:49.323816 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4020a-fc8a-4ebf-86b7-6383df548213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:49.324694 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4020a-fc8a-4ebf-86b7-6383df548213 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:49.325018 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4020a-fc8a-4ebf-86b7-6383df548213 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:49.325300 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4020a-fc8a-4ebf-86b7-6383df548213 admin admin] PATH_INFO: `/v3/projects/cb0883fa7351456c92e90dcfad6d6e4c/users/a8633c7e52a34cfb88cbbc6ee750dd5e/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:49.345718 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4020a-fc8a-4ebf-86b7-6383df548213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb0883fa7351456c92e90dcfad6d6e4c, user_id=a8633c7e52a34cfb88cbbc6ee750dd5e, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:49.372590 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4020a-fc8a-4ebf-86b7-6383df548213 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:49.449625 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1225/2482] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:59:49 2021] PUT /identity/v3/projects/cb0883fa7351456c92e90dcfad6d6e4c/users/a8633c7e52a34cfb88cbbc6ee750dd5e/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:59:49.450876 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597edfdb-9cea-4e6b-a7b4-d0b3f4fdd0cd admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:49.460553 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597edfdb-9cea-4e6b-a7b4-d0b3f4fdd0cd admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:49.530976 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59129e77-62d4-4368-9b0b-e57933a5b0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:49.531581 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59129e77-62d4-4368-9b0b-e57933a5b0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:49.531987 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59129e77-62d4-4368-9b0b-e57933a5b0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:49.532263 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59129e77-62d4-4368-9b0b-e57933a5b0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:49.533049 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59129e77-62d4-4368-9b0b-e57933a5b0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:49.559477 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59129e77-62d4-4368-9b0b-e57933a5b0e8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:49.574530 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1258/2483] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:59:49 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:59:49.577824 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4020a-fc8a-4ebf-86b7-6383df548213 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:49.590902 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4020a-fc8a-4ebf-86b7-6383df548213 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:49.597453 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297dbe4-fcdb-444c-a91b-b63c62a95619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:49.598462 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297dbe4-fcdb-444c-a91b-b63c62a95619 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:49.599087 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297dbe4-fcdb-444c-a91b-b63c62a95619 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:49.599437 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297dbe4-fcdb-444c-a91b-b63c62a95619 admin admin] PATH_INFO: `/v3/projects/cb0883fa7351456c92e90dcfad6d6e4c/users/a8633c7e52a34cfb88cbbc6ee750dd5e/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:49.601308 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297dbe4-fcdb-444c-a91b-b63c62a95619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb0883fa7351456c92e90dcfad6d6e4c, user_id=a8633c7e52a34cfb88cbbc6ee750dd5e, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:49.655819 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297dbe4-fcdb-444c-a91b-b63c62a95619 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:49.689235 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1226/2484] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:59:49 2021] PUT /identity/v3/projects/cb0883fa7351456c92e90dcfad6d6e4c/users/a8633c7e52a34cfb88cbbc6ee750dd5e/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 01:59:49.690571 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59129e77-62d4-4368-9b0b-e57933a5b0e8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:49.703740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59129e77-62d4-4368-9b0b-e57933a5b0e8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:49.780485 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8dd34-bf56-414e-b593-996bb8ab97b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:49.781282 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8dd34-bf56-414e-b593-996bb8ab97b0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:49.781570 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8dd34-bf56-414e-b593-996bb8ab97b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:49.782113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8dd34-bf56-414e-b593-996bb8ab97b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:49.782636 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8dd34-bf56-414e-b593-996bb8ab97b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:49.814238 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8dd34-bf56-414e-b593-996bb8ab97b0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:49.824930 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1259/2485] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 01:59:49 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 01:59:49.829232 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297dbe4-fcdb-444c-a91b-b63c62a95619 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:49.849444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297dbe4-fcdb-444c-a91b-b63c62a95619 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:49.849444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef97fd4-d81f-45fa-a8e9-b4a8c876caff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:49.849444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef97fd4-d81f-45fa-a8e9-b4a8c876caff admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:49.849444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef97fd4-d81f-45fa-a8e9-b4a8c876caff admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:49.849895 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef97fd4-d81f-45fa-a8e9-b4a8c876caff admin admin] PATH_INFO: `/v3/projects/cb0883fa7351456c92e90dcfad6d6e4c/users/a8633c7e52a34cfb88cbbc6ee750dd5e/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:49.850266 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef97fd4-d81f-45fa-a8e9-b4a8c876caff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb0883fa7351456c92e90dcfad6d6e4c, user_id=a8633c7e52a34cfb88cbbc6ee750dd5e, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:49.878069 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef97fd4-d81f-45fa-a8e9-b4a8c876caff admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:49.947266 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1227/2486] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 01:59:49 2021] PUT /identity/v3/projects/cb0883fa7351456c92e90dcfad6d6e4c/users/a8633c7e52a34cfb88cbbc6ee750dd5e/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 01:59:49.955262 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6f4f8-bd4e-4cfd-899b-87489da1d387 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:49.955656 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6f4f8-bd4e-4cfd-899b-87489da1d387 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:49.956049 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6f4f8-bd4e-4cfd-899b-87489da1d387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:49.996891 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-70d6f4f8-bd4e-4cfd-899b-87489da1d387 None None] MFA Rules not processed for user `a8633c7e52a34cfb88cbbc6ee750dd5e`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:49.998178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-70d6f4f8-bd4e-4cfd-899b-87489da1d387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:50.129783 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1260/2487] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:59:49 2021] POST /identity/v3/auth/tokens => generated 3731 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:59:50.145032 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef97fd4-d81f-45fa-a8e9-b4a8c876caff admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:50.146713 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-7ef97fd4-d81f-45fa-a8e9-b4a8c876caff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:50.250402 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef97fd4-d81f-45fa-a8e9-b4a8c876caff admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:50.254055 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd0d46-96ff-4219-ab5f-ef9dc67c5a6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:50.254641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd0d46-96ff-4219-ab5f-ef9dc67c5a6b service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:50.254927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd0d46-96ff-4219-ab5f-ef9dc67c5a6b service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:50.255209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd0d46-96ff-4219-ab5f-ef9dc67c5a6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:50.265544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd0d46-96ff-4219-ab5f-ef9dc67c5a6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:50.293928 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd0d46-96ff-4219-ab5f-ef9dc67c5a6b service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:50.304267 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1228/2488] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:59:50 2021] GET /identity/v3/auth/tokens => generated 3731 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:59:50.577529 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6f4f8-bd4e-4cfd-899b-87489da1d387 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:50.587069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6f4f8-bd4e-4cfd-899b-87489da1d387 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:50.590368 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93497fda-423a-478d-941b-a1aabd4200f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:50.590939 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93497fda-423a-478d-941b-a1aabd4200f4 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:50.591225 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93497fda-423a-478d-941b-a1aabd4200f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:50.592186 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93497fda-423a-478d-941b-a1aabd4200f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:50.656856 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93497fda-423a-478d-941b-a1aabd4200f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:50.683142 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93497fda-423a-478d-941b-a1aabd4200f4 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:50.693086 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1261/2489] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 01:59:50 2021] GET /identity/v3/auth/tokens => generated 3664 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 01:59:54.964829 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba33ae1-90f5-4787-bef6-d6c90ce1df98 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:54.966142 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba33ae1-90f5-4787-bef6-d6c90ce1df98 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:54.966142 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba33ae1-90f5-4787-bef6-d6c90ce1df98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:54.991800 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-3ba33ae1-90f5-4787-bef6-d6c90ce1df98 None None] MFA Rules not processed for user `8f0dd32880d14ec9990bc09685d26326`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:54.994265 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-3ba33ae1-90f5-4787-bef6-d6c90ce1df98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:55.059351 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1229/2490] 10.222.0.20 () {58 vars in 968 bytes} [Mon Aug 23 01:59:54 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 01:59:55.089401 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93497fda-423a-478d-941b-a1aabd4200f4 service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 01:59:55.089401 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-93497fda-423a-478d-941b-a1aabd4200f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:55.170491 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93497fda-423a-478d-941b-a1aabd4200f4 service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 01:59:55.175016 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90880392-2163-4b22-99a9-0d11ba82c58a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e4cab3c8cb4a18bf3c1a8a85d1675c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 01:59:55.175593 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90880392-2163-4b22-99a9-0d11ba82c58a service swift] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:55.175883 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90880392-2163-4b22-99a9-0d11ba82c58a service swift] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:55.176164 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90880392-2163-4b22-99a9-0d11ba82c58a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:55.184388 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90880392-2163-4b22-99a9-0d11ba82c58a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 01:59:55.211667 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90880392-2163-4b22-99a9-0d11ba82c58a service swift] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 01:59:55.220345 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1262/2491] 10.222.0.20 () {60 vars in 1385 bytes} [Mon Aug 23 01:59:55 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 01:59:55.706109 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc2313-8476-4ab3-8813-58eb2afa9681 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 01:59:55.707058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc2313-8476-4ab3-8813-58eb2afa9681 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 01:59:55.707058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc2313-8476-4ab3-8813-58eb2afa9681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 01:59:55.728291 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-2bcc2313-8476-4ab3-8813-58eb2afa9681 None None] MFA Rules not processed for user `9a8e4253a98b44659801d40e83cf8f75`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 01:59:55.729453 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2bcc2313-8476-4ab3-8813-58eb2afa9681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 01:59:55.792725 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1230/2492] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 01:59:55 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:00:00.243768 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90880392-2163-4b22-99a9-0d11ba82c58a service swift] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:00.246685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-90880392-2163-4b22-99a9-0d11ba82c58a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:00.339987 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90880392-2163-4b22-99a9-0d11ba82c58a service swift] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:00.344961 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652ef96-8ac8-4534-b65d-27e86eeb559c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:00.345777 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652ef96-8ac8-4534-b65d-27e86eeb559c admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:00.346085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652ef96-8ac8-4534-b65d-27e86eeb559c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:00.346372 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652ef96-8ac8-4534-b65d-27e86eeb559c admin admin] PATH_INFO: `/v3/users/08939bdcd46b412d9abf88829400c3c6` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:00.347558 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652ef96-8ac8-4534-b65d-27e86eeb559c admin admin] RBAC: Authorizing `identity:delete_user(user_id=08939bdcd46b412d9abf88829400c3c6)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:00.387701 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652ef96-8ac8-4534-b65d-27e86eeb559c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:00.598211 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-3652ef96-8ac8-4534-b65d-27e86eeb559c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08939bdcd46b412d9abf88829400c3c6'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:00.598830 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-3652ef96-8ac8-4534-b65d-27e86eeb559c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08939bdcd46b412d9abf88829400c3c6'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:00.663383 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-3652ef96-8ac8-4534-b65d-27e86eeb559c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08939bdcd46b412d9abf88829400c3c6'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:00.672537 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-3652ef96-8ac8-4534-b65d-27e86eeb559c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08939bdcd46b412d9abf88829400c3c6'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:00.673297 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-3652ef96-8ac8-4534-b65d-27e86eeb559c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08939bdcd46b412d9abf88829400c3c6'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:00.692177 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1263/2493] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:00:00 2021] DELETE /identity/v3/users/08939bdcd46b412d9abf88829400c3c6 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:00:00.696614 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f323da-3377-44ec-9e57-81e29188e998 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:00.697235 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f323da-3377-44ec-9e57-81e29188e998 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:00.697481 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f323da-3377-44ec-9e57-81e29188e998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:00.728319 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-a2f323da-3377-44ec-9e57-81e29188e998 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:00:00.729727 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a2f323da-3377-44ec-9e57-81e29188e998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:00.795628 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1231/2494] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:00:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:00:00.806436 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652ef96-8ac8-4534-b65d-27e86eeb559c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:00.807764 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-3652ef96-8ac8-4534-b65d-27e86eeb559c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:00.882055 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652ef96-8ac8-4534-b65d-27e86eeb559c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:00.885968 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06834f0b-1286-48cd-ac96-f57041e756fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:00.886811 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06834f0b-1286-48cd-ac96-f57041e756fa service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:00.887281 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06834f0b-1286-48cd-ac96-f57041e756fa service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:00.887690 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06834f0b-1286-48cd-ac96-f57041e756fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:00.896976 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06834f0b-1286-48cd-ac96-f57041e756fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:00.936633 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06834f0b-1286-48cd-ac96-f57041e756fa service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:00.950062 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1264/2495] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:00:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 02:00:01.708544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f323da-3377-44ec-9e57-81e29188e998 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:01.710249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a2f323da-3377-44ec-9e57-81e29188e998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:01.722722 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f323da-3377-44ec-9e57-81e29188e998 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:01.729100 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064224d-b64d-4ac1-b0a0-0ee9442e2095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:01.730087 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064224d-b64d-4ac1-b0a0-0ee9442e2095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:01.730374 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064224d-b64d-4ac1-b0a0-0ee9442e2095 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:01.730653 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064224d-b64d-4ac1-b0a0-0ee9442e2095 admin admin] PATH_INFO: `/v3/projects/d4b175cd3af34d2bb6d83ab69ed4c546` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:01.731714 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064224d-b64d-4ac1-b0a0-0ee9442e2095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b175cd3af34d2bb6d83ab69ed4c546)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:01.757593 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064224d-b64d-4ac1-b0a0-0ee9442e2095 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:01.873792 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d064224d-b64d-4ac1-b0a0-0ee9442e2095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b175cd3af34d2bb6d83ab69ed4c546', 'request_id': 'req-d064224d-b64d-4ac1-b0a0-0ee9442e2095'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:01.879136 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d064224d-b64d-4ac1-b0a0-0ee9442e2095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b175cd3af34d2bb6d83ab69ed4c546', 'request_id': 'req-d064224d-b64d-4ac1-b0a0-0ee9442e2095'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:01.893833 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d064224d-b64d-4ac1-b0a0-0ee9442e2095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b175cd3af34d2bb6d83ab69ed4c546', 'request_id': 'req-d064224d-b64d-4ac1-b0a0-0ee9442e2095'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:01.987322 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d064224d-b64d-4ac1-b0a0-0ee9442e2095 admin admin] The token cache is being invalidate because project d4b175cd3af34d2bb6d83ab69ed4c546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:00:01.987607 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d064224d-b64d-4ac1-b0a0-0ee9442e2095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:01.988510 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d064224d-b64d-4ac1-b0a0-0ee9442e2095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:01.990133 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1232/2496] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:00:01 2021] DELETE /identity/v3/projects/d4b175cd3af34d2bb6d83ab69ed4c546 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:00:13.207156 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06834f0b-1286-48cd-ac96-f57041e756fa service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:13.208627 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-06834f0b-1286-48cd-ac96-f57041e756fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:13.220485 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06834f0b-1286-48cd-ac96-f57041e756fa service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:13.286249 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cf730-9112-43fb-af83-06ad84efeede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:13.287130 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cf730-9112-43fb-af83-06ad84efeede admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:13.287422 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cf730-9112-43fb-af83-06ad84efeede admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:13.287704 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cf730-9112-43fb-af83-06ad84efeede admin admin] PATH_INFO: `/v3/users/802f44f483374c2984b1db06ce7244b0` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:13.288825 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cf730-9112-43fb-af83-06ad84efeede admin admin] RBAC: Authorizing `identity:delete_user(user_id=802f44f483374c2984b1db06ce7244b0)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:13.315829 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cf730-9112-43fb-af83-06ad84efeede admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:13.458596 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5f3cf730-9112-43fb-af83-06ad84efeede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '802f44f483374c2984b1db06ce7244b0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:13.459297 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5f3cf730-9112-43fb-af83-06ad84efeede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '802f44f483374c2984b1db06ce7244b0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:13.496699 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5f3cf730-9112-43fb-af83-06ad84efeede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '802f44f483374c2984b1db06ce7244b0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:13.504885 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5f3cf730-9112-43fb-af83-06ad84efeede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '802f44f483374c2984b1db06ce7244b0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:13.505505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5f3cf730-9112-43fb-af83-06ad84efeede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '802f44f483374c2984b1db06ce7244b0'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:13.521929 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1265/2497] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:00:13 2021] DELETE /identity/v3/users/802f44f483374c2984b1db06ce7244b0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:00:13.526322 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625de86-67ef-4163-a2eb-38d2f5d94eb5 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:13.526803 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625de86-67ef-4163-a2eb-38d2f5d94eb5 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:13.526917 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625de86-67ef-4163-a2eb-38d2f5d94eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:13.548373 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-d625de86-67ef-4163-a2eb-38d2f5d94eb5 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:00:13.549541 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d625de86-67ef-4163-a2eb-38d2f5d94eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:13.612651 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1233/2498] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:00:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:00:13.623338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cf730-9112-43fb-af83-06ad84efeede admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:13.624654 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-5f3cf730-9112-43fb-af83-06ad84efeede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:13.685572 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cf730-9112-43fb-af83-06ad84efeede admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:13.689065 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034d92a-e6af-44b9-a691-ff167420146a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:13.689650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034d92a-e6af-44b9-a691-ff167420146a service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:13.689965 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034d92a-e6af-44b9-a691-ff167420146a service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:13.690244 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034d92a-e6af-44b9-a691-ff167420146a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:13.698893 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034d92a-e6af-44b9-a691-ff167420146a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:13.723826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034d92a-e6af-44b9-a691-ff167420146a service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:13.733124 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1266/2499] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:00:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:00:14.214235 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625de86-67ef-4163-a2eb-38d2f5d94eb5 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:14.215619 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d625de86-67ef-4163-a2eb-38d2f5d94eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:14.227593 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625de86-67ef-4163-a2eb-38d2f5d94eb5 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:14.232408 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491a6b8-baba-425a-9bb5-aec705fc2c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:14.233348 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491a6b8-baba-425a-9bb5-aec705fc2c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:14.233766 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491a6b8-baba-425a-9bb5-aec705fc2c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:14.234503 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491a6b8-baba-425a-9bb5-aec705fc2c6a admin admin] PATH_INFO: `/v3/projects/f44d365af0a64e35856fb1d8f793581a` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:14.236472 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491a6b8-baba-425a-9bb5-aec705fc2c6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f44d365af0a64e35856fb1d8f793581a)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:14.263844 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491a6b8-baba-425a-9bb5-aec705fc2c6a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:14.411077 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7491a6b8-baba-425a-9bb5-aec705fc2c6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f44d365af0a64e35856fb1d8f793581a', 'request_id': 'req-7491a6b8-baba-425a-9bb5-aec705fc2c6a'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:14.416258 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7491a6b8-baba-425a-9bb5-aec705fc2c6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f44d365af0a64e35856fb1d8f793581a', 'request_id': 'req-7491a6b8-baba-425a-9bb5-aec705fc2c6a'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:14.427382 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7491a6b8-baba-425a-9bb5-aec705fc2c6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f44d365af0a64e35856fb1d8f793581a', 'request_id': 'req-7491a6b8-baba-425a-9bb5-aec705fc2c6a'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:14.501056 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7491a6b8-baba-425a-9bb5-aec705fc2c6a admin admin] The token cache is being invalidate because project f44d365af0a64e35856fb1d8f793581a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:00:14.501342 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7491a6b8-baba-425a-9bb5-aec705fc2c6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:14.501922 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7491a6b8-baba-425a-9bb5-aec705fc2c6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:14.503332 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1234/2500] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:00:14 2021] DELETE /identity/v3/projects/f44d365af0a64e35856fb1d8f793581a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:00:14.507296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034d92a-e6af-44b9-a691-ff167420146a service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:14.517039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034d92a-e6af-44b9-a691-ff167420146a service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:14.579935 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a77670-0fe1-4a48-97db-2a9df1609536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:14.580735 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a77670-0fe1-4a48-97db-2a9df1609536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:14.581023 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a77670-0fe1-4a48-97db-2a9df1609536 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:14.581302 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a77670-0fe1-4a48-97db-2a9df1609536 admin admin] PATH_INFO: `/v3/users/a8633c7e52a34cfb88cbbc6ee750dd5e` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:14.582364 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a77670-0fe1-4a48-97db-2a9df1609536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8633c7e52a34cfb88cbbc6ee750dd5e)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:14.614592 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a77670-0fe1-4a48-97db-2a9df1609536 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:14.806799 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-95a77670-0fe1-4a48-97db-2a9df1609536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8633c7e52a34cfb88cbbc6ee750dd5e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:14.807431 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-95a77670-0fe1-4a48-97db-2a9df1609536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8633c7e52a34cfb88cbbc6ee750dd5e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:14.857377 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-95a77670-0fe1-4a48-97db-2a9df1609536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8633c7e52a34cfb88cbbc6ee750dd5e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:14.865377 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-95a77670-0fe1-4a48-97db-2a9df1609536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8633c7e52a34cfb88cbbc6ee750dd5e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:14.866002 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-95a77670-0fe1-4a48-97db-2a9df1609536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8633c7e52a34cfb88cbbc6ee750dd5e'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:14.883439 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1267/2501] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:00:14 2021] DELETE /identity/v3/users/a8633c7e52a34cfb88cbbc6ee750dd5e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:00:15.323704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491a6b8-baba-425a-9bb5-aec705fc2c6a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:15.325306 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-7491a6b8-baba-425a-9bb5-aec705fc2c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:15.338638 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491a6b8-baba-425a-9bb5-aec705fc2c6a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:15.417750 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93888e-7420-48c6-bba1-b7d5390823cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:15.418710 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93888e-7420-48c6-bba1-b7d5390823cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:15.419260 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93888e-7420-48c6-bba1-b7d5390823cf admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:15.419633 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93888e-7420-48c6-bba1-b7d5390823cf admin admin] PATH_INFO: `/v3/projects/cb0883fa7351456c92e90dcfad6d6e4c` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:15.421172 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93888e-7420-48c6-bba1-b7d5390823cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb0883fa7351456c92e90dcfad6d6e4c)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:15.452241 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93888e-7420-48c6-bba1-b7d5390823cf admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:15.542944 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-2f93888e-7420-48c6-bba1-b7d5390823cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb0883fa7351456c92e90dcfad6d6e4c', 'request_id': 'req-2f93888e-7420-48c6-bba1-b7d5390823cf'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:15.548189 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-2f93888e-7420-48c6-bba1-b7d5390823cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb0883fa7351456c92e90dcfad6d6e4c', 'request_id': 'req-2f93888e-7420-48c6-bba1-b7d5390823cf'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:15.560500 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-2f93888e-7420-48c6-bba1-b7d5390823cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb0883fa7351456c92e90dcfad6d6e4c', 'request_id': 'req-2f93888e-7420-48c6-bba1-b7d5390823cf'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:15.639357 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-2f93888e-7420-48c6-bba1-b7d5390823cf admin admin] The token cache is being invalidate because project cb0883fa7351456c92e90dcfad6d6e4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:00:15.639649 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-2f93888e-7420-48c6-bba1-b7d5390823cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:15.640249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-2f93888e-7420-48c6-bba1-b7d5390823cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:15.641719 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1235/2502] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:00:15 2021] DELETE /identity/v3/projects/cb0883fa7351456c92e90dcfad6d6e4c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:00:15.647366 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c8725-4509-4aa8-b5f5-5ec2cbb1ae59 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:15.647854 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c8725-4509-4aa8-b5f5-5ec2cbb1ae59 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:15.648120 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c8725-4509-4aa8-b5f5-5ec2cbb1ae59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:15.671091 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-e82c8725-4509-4aa8-b5f5-5ec2cbb1ae59 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:00:15.672266 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e82c8725-4509-4aa8-b5f5-5ec2cbb1ae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:15.737456 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1268/2503] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:00:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:00:15.746310 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83622a-7d9a-47ad-ba40-f0f686d07c66 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:15.750381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83622a-7d9a-47ad-ba40-f0f686d07c66 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:15.750381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83622a-7d9a-47ad-ba40-f0f686d07c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:15.769285 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-9d83622a-7d9a-47ad-ba40-f0f686d07c66 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:00:15.770481 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-9d83622a-7d9a-47ad-ba40-f0f686d07c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:15.777663 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1236/2504] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:00:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:00:15.782152 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c8725-4509-4aa8-b5f5-5ec2cbb1ae59 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:15.791533 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c8725-4509-4aa8-b5f5-5ec2cbb1ae59 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:15.796840 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564753f-6bfd-4041-8d0b-ea4a3cfa4cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:15.797581 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564753f-6bfd-4041-8d0b-ea4a3cfa4cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:15.797921 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564753f-6bfd-4041-8d0b-ea4a3cfa4cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:15.798207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564753f-6bfd-4041-8d0b-ea4a3cfa4cd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:15.798954 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564753f-6bfd-4041-8d0b-ea4a3cfa4cd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 02:00:15.799406 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564753f-6bfd-4041-8d0b-ea4a3cfa4cd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:15.826740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564753f-6bfd-4041-8d0b-ea4a3cfa4cd1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:15.841072 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1269/2505] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 02:00:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 02:00:15.849021 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83622a-7d9a-47ad-ba40-f0f686d07c66 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:15.855017 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83622a-7d9a-47ad-ba40-f0f686d07c66 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:15.859862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236959fd-f506-4d5e-a494-bacc0cf684f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:15.860440 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236959fd-f506-4d5e-a494-bacc0cf684f6 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:15.860759 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236959fd-f506-4d5e-a494-bacc0cf684f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:15.861054 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236959fd-f506-4d5e-a494-bacc0cf684f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:15.861669 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236959fd-f506-4d5e-a494-bacc0cf684f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:15.889066 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236959fd-f506-4d5e-a494-bacc0cf684f6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:15.997910 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1237/2506] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:00:15 2021] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:00:15.999000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564753f-6bfd-4041-8d0b-ea4a3cfa4cd1 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:16.008430 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564753f-6bfd-4041-8d0b-ea4a3cfa4cd1 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:16.073187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238e3e0-dcab-4dc9-bc8e-83d2bac05986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:16.074055 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238e3e0-dcab-4dc9-bc8e-83d2bac05986 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:16.074354 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238e3e0-dcab-4dc9-bc8e-83d2bac05986 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:16.074636 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238e3e0-dcab-4dc9-bc8e-83d2bac05986 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:16.075296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238e3e0-dcab-4dc9-bc8e-83d2bac05986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:16.101879 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238e3e0-dcab-4dc9-bc8e-83d2bac05986 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:16.234921 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1270/2507] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:00:15 2021] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:00:16.239017 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236959fd-f506-4d5e-a494-bacc0cf684f6 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:16.248834 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236959fd-f506-4d5e-a494-bacc0cf684f6 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:16.253456 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bc020-2639-49e6-bb48-3368efcdeeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:16.254068 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bc020-2639-49e6-bb48-3368efcdeeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:16.254353 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bc020-2639-49e6-bb48-3368efcdeeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:16.254630 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bc020-2639-49e6-bb48-3368efcdeeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:16.255504 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bc020-2639-49e6-bb48-3368efcdeeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:16.281287 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bc020-2639-49e6-bb48-3368efcdeeb6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:16.291737 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1238/2508] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:00:16 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:00:16.296849 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238e3e0-dcab-4dc9-bc8e-83d2bac05986 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:16.306540 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238e3e0-dcab-4dc9-bc8e-83d2bac05986 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:16.310637 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791f30b-3c51-4254-989d-8d66a1620fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:16.311433 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791f30b-3c51-4254-989d-8d66a1620fab admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:16.311714 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791f30b-3c51-4254-989d-8d66a1620fab admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:16.311991 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791f30b-3c51-4254-989d-8d66a1620fab admin admin] PATH_INFO: `/v3/projects/e5677f7175b34ba09405a729a996be4b/users/fc715fc002b043c580366a5e124e4c89/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:16.331583 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791f30b-3c51-4254-989d-8d66a1620fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5677f7175b34ba09405a729a996be4b, user_id=fc715fc002b043c580366a5e124e4c89, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:16.358105 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791f30b-3c51-4254-989d-8d66a1620fab admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:16.428602 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1271/2509] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:00:16 2021] PUT /identity/v3/projects/e5677f7175b34ba09405a729a996be4b/users/fc715fc002b043c580366a5e124e4c89/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:00:16.439121 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58404b-c706-4061-8fbe-6e5a3d759d57 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:16.439630 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58404b-c706-4061-8fbe-6e5a3d759d57 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:16.439838 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58404b-c706-4061-8fbe-6e5a3d759d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:16.476510 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-2c58404b-c706-4061-8fbe-6e5a3d759d57 None None] MFA Rules not processed for user `fc715fc002b043c580366a5e124e4c89`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:00:16.477686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2c58404b-c706-4061-8fbe-6e5a3d759d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:16.546825 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1239/2510] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:00:16 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:00:16.557091 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791f30b-3c51-4254-989d-8d66a1620fab admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:16.558740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-a791f30b-3c51-4254-989d-8d66a1620fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:16.623263 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791f30b-3c51-4254-989d-8d66a1620fab admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:16.626611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785eabf-6acc-4001-897b-baa3359ece3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:16.627190 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785eabf-6acc-4001-897b-baa3359ece3a service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:16.627477 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785eabf-6acc-4001-897b-baa3359ece3a service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:16.627756 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785eabf-6acc-4001-897b-baa3359ece3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:16.635908 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785eabf-6acc-4001-897b-baa3359ece3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:16.661678 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785eabf-6acc-4001-897b-baa3359ece3a service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:16.671151 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1272/2511] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:00:16 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:00:16.691201 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58404b-c706-4061-8fbe-6e5a3d759d57 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:16.759908 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58404b-c706-4061-8fbe-6e5a3d759d57 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:16.764999 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83598818-6d9c-4419-bb93-bf31738786b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:16.765940 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83598818-6d9c-4419-bb93-bf31738786b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:16.766228 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83598818-6d9c-4419-bb93-bf31738786b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:16.766511 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83598818-6d9c-4419-bb93-bf31738786b5 admin admin] PATH_INFO: `/v3/users/fc715fc002b043c580366a5e124e4c89` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:16.767608 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83598818-6d9c-4419-bb93-bf31738786b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc715fc002b043c580366a5e124e4c89)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:16.793567 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83598818-6d9c-4419-bb93-bf31738786b5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:16.967969 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-83598818-6d9c-4419-bb93-bf31738786b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc715fc002b043c580366a5e124e4c89'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:17.028456 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-83598818-6d9c-4419-bb93-bf31738786b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc715fc002b043c580366a5e124e4c89'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:17.029153 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-83598818-6d9c-4419-bb93-bf31738786b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc715fc002b043c580366a5e124e4c89'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:17.037647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-83598818-6d9c-4419-bb93-bf31738786b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc715fc002b043c580366a5e124e4c89'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:17.038255 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-83598818-6d9c-4419-bb93-bf31738786b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc715fc002b043c580366a5e124e4c89'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:17.053277 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785eabf-6acc-4001-897b-baa3359ece3a service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:17.054669 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-9785eabf-6acc-4001-897b-baa3359ece3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:17.056155 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1240/2512] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:00:16 2021] DELETE /identity/v3/users/fc715fc002b043c580366a5e124e4c89 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:00:17.060832 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f94c8-8002-4bcf-ac25-de6e4949c9b8 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:17.061130 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f94c8-8002-4bcf-ac25-de6e4949c9b8 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:17.061415 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f94c8-8002-4bcf-ac25-de6e4949c9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:17.084832 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-5d0f94c8-8002-4bcf-ac25-de6e4949c9b8 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:00:17.085974 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5d0f94c8-8002-4bcf-ac25-de6e4949c9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:17.118065 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785eabf-6acc-4001-897b-baa3359ece3a service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:17.148834 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1241/2513] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:00:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 02:00:17.158862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f94c8-8002-4bcf-ac25-de6e4949c9b8 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:17.160104 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5d0f94c8-8002-4bcf-ac25-de6e4949c9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:17.179546 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ab02d-8309-46b0-b1c9-f248c13d8a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:17.180388 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ab02d-8309-46b0-b1c9-f248c13d8a69 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:17.180388 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ab02d-8309-46b0-b1c9-f248c13d8a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:17.180728 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ab02d-8309-46b0-b1c9-f248c13d8a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:17.182379 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-d83ab02d-8309-46b0-b1c9-f248c13d8a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:17.226226 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f94c8-8002-4bcf-ac25-de6e4949c9b8 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:17.229612 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15321aa-0bf4-4e4a-8cea-d3da6c39b12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:17.230217 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15321aa-0bf4-4e4a-8cea-d3da6c39b12b service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:17.230505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15321aa-0bf4-4e4a-8cea-d3da6c39b12b service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:17.230787 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15321aa-0bf4-4e4a-8cea-d3da6c39b12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:17.240262 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15321aa-0bf4-4e4a-8cea-d3da6c39b12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:17.251439 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ab02d-8309-46b0-b1c9-f248c13d8a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:17.265496 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15321aa-0bf4-4e4a-8cea-d3da6c39b12b service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:17.274739 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1242/2514] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:00:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 02:00:17.276501 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ab02d-8309-46b0-b1c9-f248c13d8a69 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:17.286087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1273/2515] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:00:17 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 02:00:18.009966 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15321aa-0bf4-4e4a-8cea-d3da6c39b12b service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:18.011056 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-c15321aa-0bf4-4e4a-8cea-d3da6c39b12b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:18.022716 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15321aa-0bf4-4e4a-8cea-d3da6c39b12b service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:18.027067 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f9ba8-0131-40b3-8384-7fadd2864e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:18.027848 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f9ba8-0131-40b3-8384-7fadd2864e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:18.028671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f9ba8-0131-40b3-8384-7fadd2864e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:18.029007 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f9ba8-0131-40b3-8384-7fadd2864e7c admin admin] PATH_INFO: `/v3/projects/e5677f7175b34ba09405a729a996be4b` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:18.030118 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f9ba8-0131-40b3-8384-7fadd2864e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5677f7175b34ba09405a729a996be4b)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:18.057140 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f9ba8-0131-40b3-8384-7fadd2864e7c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:18.246102 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-450f9ba8-0131-40b3-8384-7fadd2864e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5677f7175b34ba09405a729a996be4b', 'request_id': 'req-450f9ba8-0131-40b3-8384-7fadd2864e7c'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:18.251107 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-450f9ba8-0131-40b3-8384-7fadd2864e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5677f7175b34ba09405a729a996be4b', 'request_id': 'req-450f9ba8-0131-40b3-8384-7fadd2864e7c'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:18.261802 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-450f9ba8-0131-40b3-8384-7fadd2864e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5677f7175b34ba09405a729a996be4b', 'request_id': 'req-450f9ba8-0131-40b3-8384-7fadd2864e7c'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:18.353684 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-450f9ba8-0131-40b3-8384-7fadd2864e7c admin admin] The token cache is being invalidate because project e5677f7175b34ba09405a729a996be4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:00:18.353969 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-450f9ba8-0131-40b3-8384-7fadd2864e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:18.354577 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-450f9ba8-0131-40b3-8384-7fadd2864e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:18.355999 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1243/2516] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:00:18 2021] DELETE /identity/v3/projects/e5677f7175b34ba09405a729a996be4b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:00:18.361684 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adb719-a6af-4eda-be6d-b92e6f33260e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:18.362183 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adb719-a6af-4eda-be6d-b92e6f33260e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:18.362476 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adb719-a6af-4eda-be6d-b92e6f33260e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:18.385895 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-f9adb719-a6af-4eda-be6d-b92e6f33260e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:00:18.387164 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f9adb719-a6af-4eda-be6d-b92e6f33260e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:18.458642 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1274/2517] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:00:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:00:18.466915 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608490c4-cb9a-41ad-8365-4407c209c260 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:18.467213 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608490c4-cb9a-41ad-8365-4407c209c260 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:18.467494 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608490c4-cb9a-41ad-8365-4407c209c260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:18.489328 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-608490c4-cb9a-41ad-8365-4407c209c260 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:00:18.490469 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-608490c4-cb9a-41ad-8365-4407c209c260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:18.497498 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1244/2518] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:00:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:00:18.501693 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adb719-a6af-4eda-be6d-b92e6f33260e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:18.510867 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adb719-a6af-4eda-be6d-b92e6f33260e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:18.515724 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570161f-f505-40ba-9b16-ddb2a8da8165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:18.516311 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570161f-f505-40ba-9b16-ddb2a8da8165 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:18.516622 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570161f-f505-40ba-9b16-ddb2a8da8165 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:18.516908 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570161f-f505-40ba-9b16-ddb2a8da8165 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:18.517585 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570161f-f505-40ba-9b16-ddb2a8da8165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 02:00:18.517883 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570161f-f505-40ba-9b16-ddb2a8da8165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:18.543196 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570161f-f505-40ba-9b16-ddb2a8da8165 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:18.556387 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1275/2519] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 02:00:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 02:00:18.560765 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608490c4-cb9a-41ad-8365-4407c209c260 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:18.569698 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608490c4-cb9a-41ad-8365-4407c209c260 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:18.573956 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb685c-a82c-4f7c-981f-d92d3e871844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:18.574535 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb685c-a82c-4f7c-981f-d92d3e871844 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:18.574829 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb685c-a82c-4f7c-981f-d92d3e871844 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:18.575604 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb685c-a82c-4f7c-981f-d92d3e871844 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:18.576235 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb685c-a82c-4f7c-981f-d92d3e871844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:18.601953 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb685c-a82c-4f7c-981f-d92d3e871844 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:18.698750 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1245/2520] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:00:18 2021] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:00:18.703455 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570161f-f505-40ba-9b16-ddb2a8da8165 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:18.713191 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570161f-f505-40ba-9b16-ddb2a8da8165 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:18.775014 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c493aa-ebb1-46d7-bba0-479833ad5951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:18.775608 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c493aa-ebb1-46d7-bba0-479833ad5951 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:18.775897 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c493aa-ebb1-46d7-bba0-479833ad5951 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:18.776178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c493aa-ebb1-46d7-bba0-479833ad5951 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:18.776969 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c493aa-ebb1-46d7-bba0-479833ad5951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:18.802261 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c493aa-ebb1-46d7-bba0-479833ad5951 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:18.892096 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1276/2521] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:00:18 2021] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:00:18.896265 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb685c-a82c-4f7c-981f-d92d3e871844 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:18.906035 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb685c-a82c-4f7c-981f-d92d3e871844 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:18.910197 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e84258-a0ca-408b-8bbf-4f20a8fd9239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:18.910779 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e84258-a0ca-408b-8bbf-4f20a8fd9239 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:18.911070 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e84258-a0ca-408b-8bbf-4f20a8fd9239 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:18.911354 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e84258-a0ca-408b-8bbf-4f20a8fd9239 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:18.912038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e84258-a0ca-408b-8bbf-4f20a8fd9239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:18.937802 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e84258-a0ca-408b-8bbf-4f20a8fd9239 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:18.952295 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1246/2522] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:00:18 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:00:18.953538 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c493aa-ebb1-46d7-bba0-479833ad5951 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:18.963773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c493aa-ebb1-46d7-bba0-479833ad5951 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:18.968771 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540adac-d427-4d9a-97c5-b734e8b5f687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:18.972093 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540adac-d427-4d9a-97c5-b734e8b5f687 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:18.972093 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540adac-d427-4d9a-97c5-b734e8b5f687 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:18.972093 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540adac-d427-4d9a-97c5-b734e8b5f687 admin admin] PATH_INFO: `/v3/projects/4ab1f71ce8d24b8abb151ef9f3f2de95/users/3272fd854bfd4ce196e458d14f582571/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:18.992625 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540adac-d427-4d9a-97c5-b734e8b5f687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab1f71ce8d24b8abb151ef9f3f2de95, user_id=3272fd854bfd4ce196e458d14f582571, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:19.019784 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540adac-d427-4d9a-97c5-b734e8b5f687 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:19.091632 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1277/2523] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:00:18 2021] PUT /identity/v3/projects/4ab1f71ce8d24b8abb151ef9f3f2de95/users/3272fd854bfd4ce196e458d14f582571/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:00:19.102547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44ca42-9d7d-4d42-b303-4e3015a57c58 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:19.103078 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44ca42-9d7d-4d42-b303-4e3015a57c58 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:19.103220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44ca42-9d7d-4d42-b303-4e3015a57c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:19.140701 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-5e44ca42-9d7d-4d42-b303-4e3015a57c58 None None] MFA Rules not processed for user `3272fd854bfd4ce196e458d14f582571`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:00:19.141871 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5e44ca42-9d7d-4d42-b303-4e3015a57c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:19.215695 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1247/2524] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:00:19 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:00:19.225652 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540adac-d427-4d9a-97c5-b734e8b5f687 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:19.227209 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-6540adac-d427-4d9a-97c5-b734e8b5f687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:19.291022 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540adac-d427-4d9a-97c5-b734e8b5f687 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:19.294843 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8f7a8-3854-4d01-8bd3-186729bde6bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:19.295533 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8f7a8-3854-4d01-8bd3-186729bde6bd service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:19.295819 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8f7a8-3854-4d01-8bd3-186729bde6bd service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:19.296097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8f7a8-3854-4d01-8bd3-186729bde6bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:19.304953 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8f7a8-3854-4d01-8bd3-186729bde6bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:19.330729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8f7a8-3854-4d01-8bd3-186729bde6bd service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:19.339786 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1278/2525] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:00:19 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:00:46.164864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44ca42-9d7d-4d42-b303-4e3015a57c58 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:46.164864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5e44ca42-9d7d-4d42-b303-4e3015a57c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:46.242889 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44ca42-9d7d-4d42-b303-4e3015a57c58 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:46.248634 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143f9e1-f97c-44df-a15d-0213155a1855 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4a6c587fd604395908134c50ce7618d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:46.249222 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143f9e1-f97c-44df-a15d-0213155a1855 service placement] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:46.249515 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143f9e1-f97c-44df-a15d-0213155a1855 service placement] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:46.249790 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143f9e1-f97c-44df-a15d-0213155a1855 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:46.251617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d143f9e1-f97c-44df-a15d-0213155a1855 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:46.264621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143f9e1-f97c-44df-a15d-0213155a1855 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:46.299704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143f9e1-f97c-44df-a15d-0213155a1855 service placement] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:46.304796 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1248/2526] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:00:46 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:00:47.283331 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8f7a8-3854-4d01-8bd3-186729bde6bd service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:47.416176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8f7a8-3854-4d01-8bd3-186729bde6bd service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:47.421320 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad140ea5-33e0-4f31-9377-2d84affc0950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:47.422297 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad140ea5-33e0-4f31-9377-2d84affc0950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:47.422740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad140ea5-33e0-4f31-9377-2d84affc0950 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:47.423192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad140ea5-33e0-4f31-9377-2d84affc0950 admin admin] PATH_INFO: `/v3/users/3272fd854bfd4ce196e458d14f582571` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:47.424512 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad140ea5-33e0-4f31-9377-2d84affc0950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3272fd854bfd4ce196e458d14f582571)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:47.452364 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad140ea5-33e0-4f31-9377-2d84affc0950 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:47.722457 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ad140ea5-33e0-4f31-9377-2d84affc0950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3272fd854bfd4ce196e458d14f582571'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:47.723157 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ad140ea5-33e0-4f31-9377-2d84affc0950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3272fd854bfd4ce196e458d14f582571'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:47.782374 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ad140ea5-33e0-4f31-9377-2d84affc0950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3272fd854bfd4ce196e458d14f582571'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:47.791987 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ad140ea5-33e0-4f31-9377-2d84affc0950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3272fd854bfd4ce196e458d14f582571'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:47.792823 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ad140ea5-33e0-4f31-9377-2d84affc0950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3272fd854bfd4ce196e458d14f582571'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:47.813428 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1279/2527] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:00:47 2021] DELETE /identity/v3/users/3272fd854bfd4ce196e458d14f582571 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:00:47.817673 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fef07-da89-41fe-a4df-854a1148c94f None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:47.818170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fef07-da89-41fe-a4df-854a1148c94f None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:47.818267 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fef07-da89-41fe-a4df-854a1148c94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:47.844080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-185fef07-da89-41fe-a4df-854a1148c94f None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:00:47.845699 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-185fef07-da89-41fe-a4df-854a1148c94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:47.915991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1249/2528] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:00:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:00:47.926333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad140ea5-33e0-4f31-9377-2d84affc0950 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:47.927906 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ad140ea5-33e0-4f31-9377-2d84affc0950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:47.992719 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad140ea5-33e0-4f31-9377-2d84affc0950 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:47.996042 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba695f0-104f-4c91-a219-2eba873b8fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:47.996663 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba695f0-104f-4c91-a219-2eba873b8fcb service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:47.996969 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba695f0-104f-4c91-a219-2eba873b8fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:48.003101 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba695f0-104f-4c91-a219-2eba873b8fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:48.007044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba695f0-104f-4c91-a219-2eba873b8fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:48.034345 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba695f0-104f-4c91-a219-2eba873b8fcb service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:48.044351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1280/2529] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:00:47 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:00:48.861246 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fef07-da89-41fe-a4df-854a1148c94f None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:48.862708 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-185fef07-da89-41fe-a4df-854a1148c94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:48.873877 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fef07-da89-41fe-a4df-854a1148c94f None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:48.878064 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893aac6-26b4-4b48-b9d0-bd9de5efc3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:48.878841 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893aac6-26b4-4b48-b9d0-bd9de5efc3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:48.879122 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893aac6-26b4-4b48-b9d0-bd9de5efc3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:48.879392 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893aac6-26b4-4b48-b9d0-bd9de5efc3ef admin admin] PATH_INFO: `/v3/projects/4ab1f71ce8d24b8abb151ef9f3f2de95` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:48.880669 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893aac6-26b4-4b48-b9d0-bd9de5efc3ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab1f71ce8d24b8abb151ef9f3f2de95)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:48.907017 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893aac6-26b4-4b48-b9d0-bd9de5efc3ef admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:49.081558 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7893aac6-26b4-4b48-b9d0-bd9de5efc3ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab1f71ce8d24b8abb151ef9f3f2de95', 'request_id': 'req-7893aac6-26b4-4b48-b9d0-bd9de5efc3ef'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:49.086794 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7893aac6-26b4-4b48-b9d0-bd9de5efc3ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab1f71ce8d24b8abb151ef9f3f2de95', 'request_id': 'req-7893aac6-26b4-4b48-b9d0-bd9de5efc3ef'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:49.098431 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7893aac6-26b4-4b48-b9d0-bd9de5efc3ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab1f71ce8d24b8abb151ef9f3f2de95', 'request_id': 'req-7893aac6-26b4-4b48-b9d0-bd9de5efc3ef'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:49.214525 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7893aac6-26b4-4b48-b9d0-bd9de5efc3ef admin admin] The token cache is being invalidate because project 4ab1f71ce8d24b8abb151ef9f3f2de95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:00:49.215037 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7893aac6-26b4-4b48-b9d0-bd9de5efc3ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:49.216001 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-7893aac6-26b4-4b48-b9d0-bd9de5efc3ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:00:49.226499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad23a55-c5c9-4062-8c63-e88a0ef1e776 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:49.227588 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad23a55-c5c9-4062-8c63-e88a0ef1e776 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:49.228030 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad23a55-c5c9-4062-8c63-e88a0ef1e776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:49.237524 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1250/2530] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:00:48 2021] DELETE /identity/v3/projects/4ab1f71ce8d24b8abb151ef9f3f2de95 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:00:49.259011 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-cad23a55-c5c9-4062-8c63-e88a0ef1e776 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:00:49.260617 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-cad23a55-c5c9-4062-8c63-e88a0ef1e776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:49.337767 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1281/2531] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:00:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:00:49.346090 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9eff04-4440-4a45-9a7b-dbf7f8b7e23a None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:49.346390 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9eff04-4440-4a45-9a7b-dbf7f8b7e23a None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:49.346674 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9eff04-4440-4a45-9a7b-dbf7f8b7e23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:49.371607 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-ec9eff04-4440-4a45-9a7b-dbf7f8b7e23a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:00:49.373436 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-ec9eff04-4440-4a45-9a7b-dbf7f8b7e23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:49.384836 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1251/2532] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:00:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:00:49.386202 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad23a55-c5c9-4062-8c63-e88a0ef1e776 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:49.397543 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad23a55-c5c9-4062-8c63-e88a0ef1e776 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:49.402229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384aa3a-27a2-46cd-bf73-bffaaeef6ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:49.402822 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384aa3a-27a2-46cd-bf73-bffaaeef6ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:49.403108 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384aa3a-27a2-46cd-bf73-bffaaeef6ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:49.403389 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384aa3a-27a2-46cd-bf73-bffaaeef6ce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:49.404267 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384aa3a-27a2-46cd-bf73-bffaaeef6ce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 02:00:49.404618 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384aa3a-27a2-46cd-bf73-bffaaeef6ce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:49.438704 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384aa3a-27a2-46cd-bf73-bffaaeef6ce0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:49.454707 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1282/2533] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 02:00:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 02:00:49.459052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9eff04-4440-4a45-9a7b-dbf7f8b7e23a None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:49.467861 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9eff04-4440-4a45-9a7b-dbf7f8b7e23a None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:49.472044 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19613f2a-6ea9-4f30-8a9a-7d527583a7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:49.472650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19613f2a-6ea9-4f30-8a9a-7d527583a7da admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:49.472942 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19613f2a-6ea9-4f30-8a9a-7d527583a7da admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:49.473224 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19613f2a-6ea9-4f30-8a9a-7d527583a7da admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:49.473864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19613f2a-6ea9-4f30-8a9a-7d527583a7da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:49.500535 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19613f2a-6ea9-4f30-8a9a-7d527583a7da admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:49.633083 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1252/2534] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:00:49 2021] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:00:49.634374 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384aa3a-27a2-46cd-bf73-bffaaeef6ce0 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:49.644252 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384aa3a-27a2-46cd-bf73-bffaaeef6ce0 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:49.710505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dd70a-3acd-455a-97b7-0b7a67782fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:49.711120 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dd70a-3acd-455a-97b7-0b7a67782fbf admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:49.711408 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dd70a-3acd-455a-97b7-0b7a67782fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:49.711685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dd70a-3acd-455a-97b7-0b7a67782fbf admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:49.712316 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533dd70a-3acd-455a-97b7-0b7a67782fbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:49.739778 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533dd70a-3acd-455a-97b7-0b7a67782fbf admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:49.821891 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1283/2535] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:00:49 2021] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:00:49.826090 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19613f2a-6ea9-4f30-8a9a-7d527583a7da admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:49.835994 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19613f2a-6ea9-4f30-8a9a-7d527583a7da admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:49.840256 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b824b-6197-4c60-9964-c9ac88d9f857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:49.840870 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b824b-6197-4c60-9964-c9ac88d9f857 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:49.841643 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b824b-6197-4c60-9964-c9ac88d9f857 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:49.841920 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b824b-6197-4c60-9964-c9ac88d9f857 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:49.842605 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b824b-6197-4c60-9964-c9ac88d9f857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:49.869510 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b824b-6197-4c60-9964-c9ac88d9f857 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:49.880522 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1253/2536] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:00:49 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 02:00:49.884848 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dd70a-3acd-455a-97b7-0b7a67782fbf admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:49.894311 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dd70a-3acd-455a-97b7-0b7a67782fbf admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:49.898586 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45487749-e505-4519-99d4-268614cad59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:49.899384 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45487749-e505-4519-99d4-268614cad59a admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:49.899668 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45487749-e505-4519-99d4-268614cad59a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:49.899940 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45487749-e505-4519-99d4-268614cad59a admin admin] PATH_INFO: `/v3/projects/845de35e291e437a90ca29f374ed99bc/users/2602ebb9e9d14f2d896d3df1ce07c87a/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:49.920913 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45487749-e505-4519-99d4-268614cad59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=845de35e291e437a90ca29f374ed99bc, user_id=2602ebb9e9d14f2d896d3df1ce07c87a, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:49.949555 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45487749-e505-4519-99d4-268614cad59a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:50.021073 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1284/2537] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:00:49 2021] PUT /identity/v3/projects/845de35e291e437a90ca29f374ed99bc/users/2602ebb9e9d14f2d896d3df1ce07c87a/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:00:50.032372 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9cfba-6dd3-4802-bdf2-2455055ba758 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:50.032699 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9cfba-6dd3-4802-bdf2-2455055ba758 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:50.032981 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9cfba-6dd3-4802-bdf2-2455055ba758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:50.068320 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-e4d9cfba-6dd3-4802-bdf2-2455055ba758 None None] MFA Rules not processed for user `2602ebb9e9d14f2d896d3df1ce07c87a`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:00:50.069483 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-e4d9cfba-6dd3-4802-bdf2-2455055ba758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:50.143517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1254/2538] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:00:50 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:00:50.148166 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45487749-e505-4519-99d4-268614cad59a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:50.215723 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45487749-e505-4519-99d4-268614cad59a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:50.220997 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0eb26-8eb5-4869-a3dc-1a79a9c5397b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:50.221595 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0eb26-8eb5-4869-a3dc-1a79a9c5397b admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:50.222480 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0eb26-8eb5-4869-a3dc-1a79a9c5397b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:50.222480 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0eb26-8eb5-4869-a3dc-1a79a9c5397b admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:50.222932 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0eb26-8eb5-4869-a3dc-1a79a9c5397b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:50.249797 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0eb26-8eb5-4869-a3dc-1a79a9c5397b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:50.332130 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1285/2539] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:00:50 2021] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:00:50.336101 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9cfba-6dd3-4802-bdf2-2455055ba758 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:50.346899 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9cfba-6dd3-4802-bdf2-2455055ba758 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:50.408815 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34eb7f-5ac4-43ae-9347-f33e8be95a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:50.409409 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34eb7f-5ac4-43ae-9347-f33e8be95a56 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:50.409703 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34eb7f-5ac4-43ae-9347-f33e8be95a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:50.410037 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34eb7f-5ac4-43ae-9347-f33e8be95a56 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:50.410682 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34eb7f-5ac4-43ae-9347-f33e8be95a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:50.436043 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34eb7f-5ac4-43ae-9347-f33e8be95a56 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:50.507476 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1255/2540] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:00:50 2021] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:00:50.511505 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0eb26-8eb5-4869-a3dc-1a79a9c5397b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:50.521941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0eb26-8eb5-4869-a3dc-1a79a9c5397b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:50.526222 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44dbe9-5afa-442b-88d1-505001802d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:50.526781 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44dbe9-5afa-442b-88d1-505001802d37 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:50.527091 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44dbe9-5afa-442b-88d1-505001802d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:50.527368 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44dbe9-5afa-442b-88d1-505001802d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:50.528059 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44dbe9-5afa-442b-88d1-505001802d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:50.553471 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44dbe9-5afa-442b-88d1-505001802d37 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:50.564722 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1286/2541] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:00:50 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 02:00:50.568997 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34eb7f-5ac4-43ae-9347-f33e8be95a56 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:50.578952 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34eb7f-5ac4-43ae-9347-f33e8be95a56 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:50.583090 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd4b83-cb3a-4d16-81b9-31286274b2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:50.583827 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd4b83-cb3a-4d16-81b9-31286274b2a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:50.584109 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd4b83-cb3a-4d16-81b9-31286274b2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:50.584388 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd4b83-cb3a-4d16-81b9-31286274b2a8 admin admin] PATH_INFO: `/v3/projects/2d260d97697f45f19a565fa7387276d7/users/8131bca53cd7415e97c754347d6153e7/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:50.603232 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd4b83-cb3a-4d16-81b9-31286274b2a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d260d97697f45f19a565fa7387276d7, user_id=8131bca53cd7415e97c754347d6153e7, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:50.629683 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd4b83-cb3a-4d16-81b9-31286274b2a8 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:50.742666 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1256/2542] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:00:50 2021] PUT /identity/v3/projects/2d260d97697f45f19a565fa7387276d7/users/8131bca53cd7415e97c754347d6153e7/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:00:50.753082 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94f96f-2574-44c6-81dd-5102a7fcbefb None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:50.753376 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94f96f-2574-44c6-81dd-5102a7fcbefb None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:50.753656 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94f96f-2574-44c6-81dd-5102a7fcbefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:50.789289 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-ed94f96f-2574-44c6-81dd-5102a7fcbefb None None] MFA Rules not processed for user `8131bca53cd7415e97c754347d6153e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:00:50.790424 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ed94f96f-2574-44c6-81dd-5102a7fcbefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:50.863852 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1287/2543] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:00:50 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:00:50.868292 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd4b83-cb3a-4d16-81b9-31286274b2a8 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:50.938464 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd4b83-cb3a-4d16-81b9-31286274b2a8 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:50.942780 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2239f-6734-4aba-aae6-6951c0a668d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:50.943365 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2239f-6734-4aba-aae6-6951c0a668d5 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:50.943653 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2239f-6734-4aba-aae6-6951c0a668d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:50.943935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2239f-6734-4aba-aae6-6951c0a668d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:50.944583 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2239f-6734-4aba-aae6-6951c0a668d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:50.969714 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2239f-6734-4aba-aae6-6951c0a668d5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:51.063302 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1257/2544] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:00:50 2021] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:00:51.067530 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94f96f-2574-44c6-81dd-5102a7fcbefb None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:51.077632 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94f96f-2574-44c6-81dd-5102a7fcbefb None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:51.142433 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc54413-d14f-46d7-a497-67d26bbfef2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:51.143033 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc54413-d14f-46d7-a497-67d26bbfef2b admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:51.143317 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc54413-d14f-46d7-a497-67d26bbfef2b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:51.143591 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc54413-d14f-46d7-a497-67d26bbfef2b admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:51.144216 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc54413-d14f-46d7-a497-67d26bbfef2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:51.169930 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc54413-d14f-46d7-a497-67d26bbfef2b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:51.239461 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1288/2545] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:00:51 2021] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:00:51.255611 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2239f-6734-4aba-aae6-6951c0a668d5 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:51.265295 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2239f-6734-4aba-aae6-6951c0a668d5 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:51.269465 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad549929-73d3-4a2d-b85b-2ed33d9886ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:51.270042 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad549929-73d3-4a2d-b85b-2ed33d9886ef admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:51.270325 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad549929-73d3-4a2d-b85b-2ed33d9886ef admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:51.270602 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad549929-73d3-4a2d-b85b-2ed33d9886ef admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:51.271281 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad549929-73d3-4a2d-b85b-2ed33d9886ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:51.297824 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad549929-73d3-4a2d-b85b-2ed33d9886ef admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:51.308901 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1258/2546] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:00:51 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:00:51.313033 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc54413-d14f-46d7-a497-67d26bbfef2b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:51.322209 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc54413-d14f-46d7-a497-67d26bbfef2b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:51.326338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc6c0f-f5cc-4684-87fe-51dfd3447daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:51.327128 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc6c0f-f5cc-4684-87fe-51dfd3447daf admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:51.327410 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc6c0f-f5cc-4684-87fe-51dfd3447daf admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:51.327688 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc6c0f-f5cc-4684-87fe-51dfd3447daf admin admin] PATH_INFO: `/v3/projects/85162dc96bd74d2c9c32647022f80851/users/ffa72ecc418a424ba2e4294a0c2eb11f/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:51.347147 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc6c0f-f5cc-4684-87fe-51dfd3447daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=85162dc96bd74d2c9c32647022f80851, user_id=ffa72ecc418a424ba2e4294a0c2eb11f, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:51.373618 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc6c0f-f5cc-4684-87fe-51dfd3447daf admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:51.433547 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1289/2547] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:00:51 2021] PUT /identity/v3/projects/85162dc96bd74d2c9c32647022f80851/users/ffa72ecc418a424ba2e4294a0c2eb11f/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:00:51.437422 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad549929-73d3-4a2d-b85b-2ed33d9886ef admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:51.447206 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad549929-73d3-4a2d-b85b-2ed33d9886ef admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:51.508466 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0c1b0-9b19-4783-a74f-93e715f08111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:51.509104 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0c1b0-9b19-4783-a74f-93e715f08111 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:51.509397 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0c1b0-9b19-4783-a74f-93e715f08111 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:51.509670 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0c1b0-9b19-4783-a74f-93e715f08111 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:51.510344 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0c1b0-9b19-4783-a74f-93e715f08111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:51.536083 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0c1b0-9b19-4783-a74f-93e715f08111 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:51.546906 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1259/2548] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:00:51 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 02:00:51.551195 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc6c0f-f5cc-4684-87fe-51dfd3447daf admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:51.561107 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc6c0f-f5cc-4684-87fe-51dfd3447daf admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:51.565295 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cec72-ba03-4655-bcfd-f59f6b5e51be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:51.567126 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cec72-ba03-4655-bcfd-f59f6b5e51be admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:51.567418 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cec72-ba03-4655-bcfd-f59f6b5e51be admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:51.567701 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cec72-ba03-4655-bcfd-f59f6b5e51be admin admin] PATH_INFO: `/v3/projects/85162dc96bd74d2c9c32647022f80851/users/ffa72ecc418a424ba2e4294a0c2eb11f/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:51.569474 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cec72-ba03-4655-bcfd-f59f6b5e51be admin admin] RBAC: Authorizing `identity:create_grant(project_id=85162dc96bd74d2c9c32647022f80851, user_id=ffa72ecc418a424ba2e4294a0c2eb11f, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:51.596086 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cec72-ba03-4655-bcfd-f59f6b5e51be admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:51.605849 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1290/2549] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:00:51 2021] PUT /identity/v3/projects/85162dc96bd74d2c9c32647022f80851/users/ffa72ecc418a424ba2e4294a0c2eb11f/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:00:51.610141 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0c1b0-9b19-4783-a74f-93e715f08111 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:51.619616 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0c1b0-9b19-4783-a74f-93e715f08111 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:51.681144 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee2d8f-b7b1-4c22-84e3-42007c161dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:51.681759 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee2d8f-b7b1-4c22-84e3-42007c161dee admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:51.682046 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee2d8f-b7b1-4c22-84e3-42007c161dee admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:51.682323 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee2d8f-b7b1-4c22-84e3-42007c161dee admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:51.683003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee2d8f-b7b1-4c22-84e3-42007c161dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:51.708466 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee2d8f-b7b1-4c22-84e3-42007c161dee admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:51.718837 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1260/2550] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:00:51 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 02:00:51.723127 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cec72-ba03-4655-bcfd-f59f6b5e51be admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:51.732761 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cec72-ba03-4655-bcfd-f59f6b5e51be admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:51.736901 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37194c1d-6ee4-452b-a82f-afea3eaa1757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:51.737694 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37194c1d-6ee4-452b-a82f-afea3eaa1757 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:51.737977 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37194c1d-6ee4-452b-a82f-afea3eaa1757 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:51.738254 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37194c1d-6ee4-452b-a82f-afea3eaa1757 admin admin] PATH_INFO: `/v3/projects/85162dc96bd74d2c9c32647022f80851/users/ffa72ecc418a424ba2e4294a0c2eb11f/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:51.739949 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37194c1d-6ee4-452b-a82f-afea3eaa1757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85162dc96bd74d2c9c32647022f80851, user_id=ffa72ecc418a424ba2e4294a0c2eb11f, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:51.766662 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37194c1d-6ee4-452b-a82f-afea3eaa1757 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:51.867941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1291/2551] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:00:51 2021] PUT /identity/v3/projects/85162dc96bd74d2c9c32647022f80851/users/ffa72ecc418a424ba2e4294a0c2eb11f/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:00:51.878036 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd8dd4-9465-4d32-a8cb-03d1e26581ae None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:51.878338 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd8dd4-9465-4d32-a8cb-03d1e26581ae None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:51.878621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd8dd4-9465-4d32-a8cb-03d1e26581ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:51.915959 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-e2dd8dd4-9465-4d32-a8cb-03d1e26581ae None None] MFA Rules not processed for user `ffa72ecc418a424ba2e4294a0c2eb11f`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:00:51.917220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-e2dd8dd4-9465-4d32-a8cb-03d1e26581ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:51.990918 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1261/2552] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:00:51 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 02:00:52.001557 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37194c1d-6ee4-452b-a82f-afea3eaa1757 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:52.003122 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-37194c1d-6ee4-452b-a82f-afea3eaa1757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:52.065135 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37194c1d-6ee4-452b-a82f-afea3eaa1757 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:52.068555 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00540c3d-2b20-4dff-8643-b682de12f08a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:52.069159 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540c3d-2b20-4dff-8643-b682de12f08a service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:52.069443 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540c3d-2b20-4dff-8643-b682de12f08a service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:52.069721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540c3d-2b20-4dff-8643-b682de12f08a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:52.132064 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00540c3d-2b20-4dff-8643-b682de12f08a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:52.157369 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00540c3d-2b20-4dff-8643-b682de12f08a service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:52.166041 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1292/2553] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:00:52 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:00:54.386871 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd8dd4-9465-4d32-a8cb-03d1e26581ae None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:54.389128 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-e2dd8dd4-9465-4d32-a8cb-03d1e26581ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:54.400641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd8dd4-9465-4d32-a8cb-03d1e26581ae None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:54.403989 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792730a-6759-4875-a29c-75854e3ba00c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:54.404586 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792730a-6759-4875-a29c-75854e3ba00c service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:54.404885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792730a-6759-4875-a29c-75854e3ba00c service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:54.405163 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792730a-6759-4875-a29c-75854e3ba00c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:54.472427 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792730a-6759-4875-a29c-75854e3ba00c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:54.494423 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792730a-6759-4875-a29c-75854e3ba00c service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:54.503837 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1262/2554] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:00:54 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:00:55.101034 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00540c3d-2b20-4dff-8643-b682de12f08a service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:55.102418 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-00540c3d-2b20-4dff-8643-b682de12f08a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:55.165686 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00540c3d-2b20-4dff-8643-b682de12f08a service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:55.169735 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39c29-e7cb-4f2b-ae19-5bafdd1b1764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:55.175689 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39c29-e7cb-4f2b-ae19-5bafdd1b1764 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:55.175689 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39c29-e7cb-4f2b-ae19-5bafdd1b1764 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:55.175689 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39c29-e7cb-4f2b-ae19-5bafdd1b1764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:55.175689 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-69e39c29-e7cb-4f2b-ae19-5bafdd1b1764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:00:55.323985 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e39c29-e7cb-4f2b-ae19-5bafdd1b1764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:55.349569 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e39c29-e7cb-4f2b-ae19-5bafdd1b1764 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:55.359254 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1293/2555] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:00:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:00:56.010797 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792730a-6759-4875-a29c-75854e3ba00c service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:00:56.019373 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792730a-6759-4875-a29c-75854e3ba00c service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:00:56.022660 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d110d-daea-4ec1-b737-0a7b4e533060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:00:56.023221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d110d-daea-4ec1-b737-0a7b4e533060 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:00:56.023506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d110d-daea-4ec1-b737-0a7b4e533060 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:00:56.023782 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d110d-daea-4ec1-b737-0a7b4e533060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:00:56.033265 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d110d-daea-4ec1-b737-0a7b4e533060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:00:56.059986 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d110d-daea-4ec1-b737-0a7b4e533060 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:00:56.070742 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1263/2556] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:00:56 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:01:01.732241 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39c29-e7cb-4f2b-ae19-5bafdd1b1764 service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:01.742406 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39c29-e7cb-4f2b-ae19-5bafdd1b1764 service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:01.747882 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5291637-9373-41bd-9b7d-c18aa7ac5e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:01.749008 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5291637-9373-41bd-9b7d-c18aa7ac5e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:01.749399 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5291637-9373-41bd-9b7d-c18aa7ac5e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:01.749775 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5291637-9373-41bd-9b7d-c18aa7ac5e3f admin admin] PATH_INFO: `/v3/users/2602ebb9e9d14f2d896d3df1ce07c87a` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:01.751235 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5291637-9373-41bd-9b7d-c18aa7ac5e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2602ebb9e9d14f2d896d3df1ce07c87a)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:01.780336 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5291637-9373-41bd-9b7d-c18aa7ac5e3f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:01.978242 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d5291637-9373-41bd-9b7d-c18aa7ac5e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2602ebb9e9d14f2d896d3df1ce07c87a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:01.978856 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d5291637-9373-41bd-9b7d-c18aa7ac5e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2602ebb9e9d14f2d896d3df1ce07c87a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:02.044884 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d5291637-9373-41bd-9b7d-c18aa7ac5e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2602ebb9e9d14f2d896d3df1ce07c87a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:02.054405 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d5291637-9373-41bd-9b7d-c18aa7ac5e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2602ebb9e9d14f2d896d3df1ce07c87a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:02.055283 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-d5291637-9373-41bd-9b7d-c18aa7ac5e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2602ebb9e9d14f2d896d3df1ce07c87a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:02.073930 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1294/2557] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:01:01 2021] DELETE /identity/v3/users/2602ebb9e9d14f2d896d3df1ce07c87a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:02.078802 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b5692-e85e-4049-b721-5783afb386f8 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:02.083010 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b5692-e85e-4049-b721-5783afb386f8 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:02.083010 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b5692-e85e-4049-b721-5783afb386f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:02.101888 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-cc5b5692-e85e-4049-b721-5783afb386f8 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:02.103156 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-cc5b5692-e85e-4049-b721-5783afb386f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:02.159761 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5291637-9373-41bd-9b7d-c18aa7ac5e3f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:02.161382 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-d5291637-9373-41bd-9b7d-c18aa7ac5e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:02.171837 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1264/2558] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:02.182766 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b5692-e85e-4049-b721-5783afb386f8 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:02.184759 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-cc5b5692-e85e-4049-b721-5783afb386f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:02.238217 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5291637-9373-41bd-9b7d-c18aa7ac5e3f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:02.245496 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea74f3-b065-4f98-a73f-89ac2b34933b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:02.245496 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea74f3-b065-4f98-a73f-89ac2b34933b admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:02.245496 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea74f3-b065-4f98-a73f-89ac2b34933b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:02.245496 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea74f3-b065-4f98-a73f-89ac2b34933b admin admin] PATH_INFO: `/v3/users/7172c19e3f7c4f92bf53305e9f5325d6` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:02.246725 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea74f3-b065-4f98-a73f-89ac2b34933b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7172c19e3f7c4f92bf53305e9f5325d6)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:02.266506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b5692-e85e-4049-b721-5783afb386f8 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:02.272888 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f9573-8fd0-4c46-8938-6b2e4dc27dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:02.273765 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f9573-8fd0-4c46-8938-6b2e4dc27dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:02.274156 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f9573-8fd0-4c46-8938-6b2e4dc27dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:02.274538 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f9573-8fd0-4c46-8938-6b2e4dc27dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:02.277180 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea74f3-b065-4f98-a73f-89ac2b34933b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:02.288849 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f9573-8fd0-4c46-8938-6b2e4dc27dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:02.321298 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f9573-8fd0-4c46-8938-6b2e4dc27dd6 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:02.332311 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1265/2559] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:01:02.486772 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-3dea74f3-b065-4f98-a73f-89ac2b34933b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7172c19e3f7c4f92bf53305e9f5325d6'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:02.487410 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-3dea74f3-b065-4f98-a73f-89ac2b34933b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7172c19e3f7c4f92bf53305e9f5325d6'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:02.587665 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-3dea74f3-b065-4f98-a73f-89ac2b34933b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7172c19e3f7c4f92bf53305e9f5325d6'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:02.595912 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-3dea74f3-b065-4f98-a73f-89ac2b34933b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7172c19e3f7c4f92bf53305e9f5325d6'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:02.596532 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-3dea74f3-b065-4f98-a73f-89ac2b34933b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7172c19e3f7c4f92bf53305e9f5325d6'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:02.616867 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1295/2560] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:01:02 2021] DELETE /identity/v3/users/7172c19e3f7c4f92bf53305e9f5325d6 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:02.853006 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f9573-8fd0-4c46-8938-6b2e4dc27dd6 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:02.854557 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-8b9f9573-8fd0-4c46-8938-6b2e4dc27dd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:02.867702 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f9573-8fd0-4c46-8938-6b2e4dc27dd6 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:02.938578 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea74f3-b065-4f98-a73f-89ac2b34933b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:02.939937 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-3dea74f3-b065-4f98-a73f-89ac2b34933b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:02.961126 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d051f6-0517-4a33-9824-9fcc6f5f92df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:02.961972 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d051f6-0517-4a33-9824-9fcc6f5f92df admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:02.962247 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d051f6-0517-4a33-9824-9fcc6f5f92df admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:02.962528 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d051f6-0517-4a33-9824-9fcc6f5f92df admin admin] PATH_INFO: `/v3/projects/845de35e291e437a90ca29f374ed99bc` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:02.963628 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d051f6-0517-4a33-9824-9fcc6f5f92df admin admin] RBAC: Authorizing `identity:delete_project(project_id=845de35e291e437a90ca29f374ed99bc)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:02.991216 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d051f6-0517-4a33-9824-9fcc6f5f92df admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:03.021402 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea74f3-b065-4f98-a73f-89ac2b34933b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:03.027948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412bd74-1424-4542-9e9d-23295331436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:03.028833 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412bd74-1424-4542-9e9d-23295331436c admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:03.029126 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412bd74-1424-4542-9e9d-23295331436c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:03.029409 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412bd74-1424-4542-9e9d-23295331436c admin admin] PATH_INFO: `/v3/projects/9bb2cbb0b80946b59df7b67e0b0df333` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:03.030632 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412bd74-1424-4542-9e9d-23295331436c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb2cbb0b80946b59df7b67e0b0df333)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:03.057585 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412bd74-1424-4542-9e9d-23295331436c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:03.109908 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d3d051f6-0517-4a33-9824-9fcc6f5f92df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '845de35e291e437a90ca29f374ed99bc', 'request_id': 'req-d3d051f6-0517-4a33-9824-9fcc6f5f92df'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:03.115331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d3d051f6-0517-4a33-9824-9fcc6f5f92df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '845de35e291e437a90ca29f374ed99bc', 'request_id': 'req-d3d051f6-0517-4a33-9824-9fcc6f5f92df'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:03.129076 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d3d051f6-0517-4a33-9824-9fcc6f5f92df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '845de35e291e437a90ca29f374ed99bc', 'request_id': 'req-d3d051f6-0517-4a33-9824-9fcc6f5f92df'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:03.189689 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1412bd74-1424-4542-9e9d-23295331436c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb2cbb0b80946b59df7b67e0b0df333', 'request_id': 'req-1412bd74-1424-4542-9e9d-23295331436c'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:03.195902 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1412bd74-1424-4542-9e9d-23295331436c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb2cbb0b80946b59df7b67e0b0df333', 'request_id': 'req-1412bd74-1424-4542-9e9d-23295331436c'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:03.199546 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d3d051f6-0517-4a33-9824-9fcc6f5f92df admin admin] The token cache is being invalidate because project 845de35e291e437a90ca29f374ed99bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:01:03.199845 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d3d051f6-0517-4a33-9824-9fcc6f5f92df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:03.200471 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d3d051f6-0517-4a33-9824-9fcc6f5f92df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:03.202049 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1266/2561] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:01:02 2021] DELETE /identity/v3/projects/845de35e291e437a90ca29f374ed99bc => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:03.206077 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d051f6-0517-4a33-9824-9fcc6f5f92df admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:03.207761 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-d3d051f6-0517-4a33-9824-9fcc6f5f92df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:03.208517 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1412bd74-1424-4542-9e9d-23295331436c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb2cbb0b80946b59df7b67e0b0df333', 'request_id': 'req-1412bd74-1424-4542-9e9d-23295331436c'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:03.279295 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1412bd74-1424-4542-9e9d-23295331436c admin admin] The token cache is being invalidate because project 9bb2cbb0b80946b59df7b67e0b0df333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:01:03.279640 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1412bd74-1424-4542-9e9d-23295331436c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:03.280338 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1412bd74-1424-4542-9e9d-23295331436c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:03.282134 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1296/2562] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:01:02 2021] DELETE /identity/v3/projects/9bb2cbb0b80946b59df7b67e0b0df333 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:03.289990 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10911b-8312-42e4-a7c0-9596a0940b59 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:03.290290 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10911b-8312-42e4-a7c0-9596a0940b59 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:03.290616 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10911b-8312-42e4-a7c0-9596a0940b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:03.345608 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-5f10911b-8312-42e4-a7c0-9596a0940b59 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:03.346810 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-5f10911b-8312-42e4-a7c0-9596a0940b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:03.365905 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d051f6-0517-4a33-9824-9fcc6f5f92df admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:03.419754 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1297/2563] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 02:01:03.427651 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f07a-e5c6-4d7c-9328-de2d5fb91eef None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:03.427941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f07a-e5c6-4d7c-9328-de2d5fb91eef None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:03.428350 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f07a-e5c6-4d7c-9328-de2d5fb91eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:03.435347 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df026ea8-55b3-416f-9a34-10c79f68440b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:03.436119 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df026ea8-55b3-416f-9a34-10c79f68440b admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:03.436406 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df026ea8-55b3-416f-9a34-10c79f68440b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:03.436719 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df026ea8-55b3-416f-9a34-10c79f68440b admin admin] PATH_INFO: `/v3/users/8131bca53cd7415e97c754347d6153e7` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:03.437856 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df026ea8-55b3-416f-9a34-10c79f68440b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8131bca53cd7415e97c754347d6153e7)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:03.459453 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-4197f07a-e5c6-4d7c-9328-de2d5fb91eef None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:03.460760 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-4197f07a-e5c6-4d7c-9328-de2d5fb91eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:03.465456 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df026ea8-55b3-416f-9a34-10c79f68440b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:03.472097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1298/2564] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 02:01:03.473088 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197f07a-e5c6-4d7c-9328-de2d5fb91eef None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:03.482511 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197f07a-e5c6-4d7c-9328-de2d5fb91eef None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:03.486783 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8071c-d3de-423d-bc8e-78d36f4452fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:03.487350 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8071c-d3de-423d-bc8e-78d36f4452fa admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:03.487632 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8071c-d3de-423d-bc8e-78d36f4452fa admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:03.487911 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8071c-d3de-423d-bc8e-78d36f4452fa admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:03.488594 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8071c-d3de-423d-bc8e-78d36f4452fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 02:01:03.488901 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8071c-d3de-423d-bc8e-78d36f4452fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:03.516911 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8071c-d3de-423d-bc8e-78d36f4452fa admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:03.531105 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1299/2565] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 02:01:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 02:01:03.535516 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8071c-d3de-423d-bc8e-78d36f4452fa admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:03.545497 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8071c-d3de-423d-bc8e-78d36f4452fa admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:03.549824 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece2ec4-9bfe-412d-9c2f-7c80eeda7419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:03.550395 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece2ec4-9bfe-412d-9c2f-7c80eeda7419 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:03.550685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece2ec4-9bfe-412d-9c2f-7c80eeda7419 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:03.550968 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece2ec4-9bfe-412d-9c2f-7c80eeda7419 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:03.551978 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece2ec4-9bfe-412d-9c2f-7c80eeda7419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:03.578587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece2ec4-9bfe-412d-9c2f-7c80eeda7419 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:03.686667 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-df026ea8-55b3-416f-9a34-10c79f68440b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8131bca53cd7415e97c754347d6153e7'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:03.691865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1300/2566] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:01:03 2021] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:01:03.695821 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece2ec4-9bfe-412d-9c2f-7c80eeda7419 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:03.761804 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece2ec4-9bfe-412d-9c2f-7c80eeda7419 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:03.766874 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9be1cd-41e9-404b-9940-00390848d9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:03.767566 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9be1cd-41e9-404b-9940-00390848d9ec admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:03.767854 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9be1cd-41e9-404b-9940-00390848d9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:03.768151 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9be1cd-41e9-404b-9940-00390848d9ec admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:03.768810 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9be1cd-41e9-404b-9940-00390848d9ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:03.795004 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9be1cd-41e9-404b-9940-00390848d9ec admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:03.930348 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-df026ea8-55b3-416f-9a34-10c79f68440b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8131bca53cd7415e97c754347d6153e7'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:03.930924 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-df026ea8-55b3-416f-9a34-10c79f68440b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8131bca53cd7415e97c754347d6153e7'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:03.938968 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-df026ea8-55b3-416f-9a34-10c79f68440b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8131bca53cd7415e97c754347d6153e7'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:03.939510 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-df026ea8-55b3-416f-9a34-10c79f68440b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8131bca53cd7415e97c754347d6153e7'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:03.957132 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1267/2567] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:01:03 2021] DELETE /identity/v3/users/8131bca53cd7415e97c754347d6153e7 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:04.000085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1301/2568] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:01:03 2021] POST /identity/v3/users => generated 293 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:01:04.018213 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df026ea8-55b3-416f-9a34-10c79f68440b admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:04.019630 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-df026ea8-55b3-416f-9a34-10c79f68440b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:04.088772 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df026ea8-55b3-416f-9a34-10c79f68440b admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:04.095261 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daae956-9e0f-41ff-a62b-417d3eb451c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:04.095261 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daae956-9e0f-41ff-a62b-417d3eb451c3 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:04.095261 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daae956-9e0f-41ff-a62b-417d3eb451c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:04.095261 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daae956-9e0f-41ff-a62b-417d3eb451c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:04.095662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daae956-9e0f-41ff-a62b-417d3eb451c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:04.119832 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daae956-9e0f-41ff-a62b-417d3eb451c3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:04.130294 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1268/2569] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:04 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:04.134585 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9be1cd-41e9-404b-9940-00390848d9ec admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:04.144828 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9be1cd-41e9-404b-9940-00390848d9ec admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:04.149123 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438a78e-ce7e-4d3e-81a3-77a797579a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:04.149924 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438a78e-ce7e-4d3e-81a3-77a797579a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:04.154322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438a78e-ce7e-4d3e-81a3-77a797579a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:04.154322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438a78e-ce7e-4d3e-81a3-77a797579a93 admin admin] PATH_INFO: `/v3/projects/9242c46766eb4a4389e4d23fee592d45/users/666bfc452329472482d1abc582308241/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:04.169556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438a78e-ce7e-4d3e-81a3-77a797579a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9242c46766eb4a4389e4d23fee592d45, user_id=666bfc452329472482d1abc582308241, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:04.197656 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438a78e-ce7e-4d3e-81a3-77a797579a93 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:04.342571 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1302/2570] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:04 2021] PUT /identity/v3/projects/9242c46766eb4a4389e4d23fee592d45/users/666bfc452329472482d1abc582308241/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:04.353636 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fe1e3-948a-4e25-bf6a-9f871432d2d5 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:04.354047 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fe1e3-948a-4e25-bf6a-9f871432d2d5 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:04.354525 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fe1e3-948a-4e25-bf6a-9f871432d2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:04.393671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-478fe1e3-948a-4e25-bf6a-9f871432d2d5 None None] MFA Rules not processed for user `666bfc452329472482d1abc582308241`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:04.395032 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-478fe1e3-948a-4e25-bf6a-9f871432d2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:04.474374 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1269/2571] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:04 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 02:01:04.485656 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438a78e-ce7e-4d3e-81a3-77a797579a93 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:04.487239 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f438a78e-ce7e-4d3e-81a3-77a797579a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:04.564981 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438a78e-ce7e-4d3e-81a3-77a797579a93 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:04.570266 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f9bb9-7aeb-498b-b80f-e2be9b8a4aa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:04.570847 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f9bb9-7aeb-498b-b80f-e2be9b8a4aa4 service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:04.571132 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f9bb9-7aeb-498b-b80f-e2be9b8a4aa4 service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:04.571409 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f9bb9-7aeb-498b-b80f-e2be9b8a4aa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:04.580307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f9bb9-7aeb-498b-b80f-e2be9b8a4aa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:04.580615 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fe1e3-948a-4e25-bf6a-9f871432d2d5 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:04.581975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-478fe1e3-948a-4e25-bf6a-9f871432d2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:04.607311 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f9bb9-7aeb-498b-b80f-e2be9b8a4aa4 service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:04.617346 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1303/2572] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:04 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 02:01:04.660457 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fe1e3-948a-4e25-bf6a-9f871432d2d5 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:04.664709 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a160e-e263-4e0e-b4a5-f73b4eeddab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:04.665496 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a160e-e263-4e0e-b4a5-f73b4eeddab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:04.667819 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a160e-e263-4e0e-b4a5-f73b4eeddab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:04.667819 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a160e-e263-4e0e-b4a5-f73b4eeddab2 admin admin] PATH_INFO: `/v3/projects/2d260d97697f45f19a565fa7387276d7` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:04.667819 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a160e-e263-4e0e-b4a5-f73b4eeddab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d260d97697f45f19a565fa7387276d7)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:04.694766 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a160e-e263-4e0e-b4a5-f73b4eeddab2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:04.819542 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-519a160e-e263-4e0e-b4a5-f73b4eeddab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d260d97697f45f19a565fa7387276d7', 'request_id': 'req-519a160e-e263-4e0e-b4a5-f73b4eeddab2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:04.825613 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-519a160e-e263-4e0e-b4a5-f73b4eeddab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d260d97697f45f19a565fa7387276d7', 'request_id': 'req-519a160e-e263-4e0e-b4a5-f73b4eeddab2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:04.838673 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-519a160e-e263-4e0e-b4a5-f73b4eeddab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d260d97697f45f19a565fa7387276d7', 'request_id': 'req-519a160e-e263-4e0e-b4a5-f73b4eeddab2'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:04.940143 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-519a160e-e263-4e0e-b4a5-f73b4eeddab2 admin admin] The token cache is being invalidate because project 2d260d97697f45f19a565fa7387276d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:01:04.940143 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-519a160e-e263-4e0e-b4a5-f73b4eeddab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:04.940143 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-519a160e-e263-4e0e-b4a5-f73b4eeddab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:04.940143 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1270/2573] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:01:04 2021] DELETE /identity/v3/projects/2d260d97697f45f19a565fa7387276d7 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:04.942808 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f9bb9-7aeb-498b-b80f-e2be9b8a4aa4 service nova] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:04.952822 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f9bb9-7aeb-498b-b80f-e2be9b8a4aa4 service nova] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:05.024544 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25eef8a-c0c8-48aa-88b2-3163cd18c47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:05.025332 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eef8a-c0c8-48aa-88b2-3163cd18c47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:05.025631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eef8a-c0c8-48aa-88b2-3163cd18c47f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:05.025957 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eef8a-c0c8-48aa-88b2-3163cd18c47f admin admin] PATH_INFO: `/v3/users/ffa72ecc418a424ba2e4294a0c2eb11f` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:05.027055 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25eef8a-c0c8-48aa-88b2-3163cd18c47f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffa72ecc418a424ba2e4294a0c2eb11f)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:05.055536 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25eef8a-c0c8-48aa-88b2-3163cd18c47f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:05.222779 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a25eef8a-c0c8-48aa-88b2-3163cd18c47f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffa72ecc418a424ba2e4294a0c2eb11f'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:05.223382 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a25eef8a-c0c8-48aa-88b2-3163cd18c47f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffa72ecc418a424ba2e4294a0c2eb11f'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:05.296195 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a25eef8a-c0c8-48aa-88b2-3163cd18c47f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffa72ecc418a424ba2e4294a0c2eb11f'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:05.304727 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a25eef8a-c0c8-48aa-88b2-3163cd18c47f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffa72ecc418a424ba2e4294a0c2eb11f'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:05.305585 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a25eef8a-c0c8-48aa-88b2-3163cd18c47f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffa72ecc418a424ba2e4294a0c2eb11f'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:05.322464 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1304/2574] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:01:04 2021] DELETE /identity/v3/users/ffa72ecc418a424ba2e4294a0c2eb11f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:05.894946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a160e-e263-4e0e-b4a5-f73b4eeddab2 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:05.896322 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-519a160e-e263-4e0e-b4a5-f73b4eeddab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:05.910536 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a160e-e263-4e0e-b4a5-f73b4eeddab2 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:05.973953 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73750c-dc23-4bac-ba5d-48c6bf935a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:05.974764 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73750c-dc23-4bac-ba5d-48c6bf935a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:05.975047 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73750c-dc23-4bac-ba5d-48c6bf935a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:05.975323 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73750c-dc23-4bac-ba5d-48c6bf935a1f admin admin] PATH_INFO: `/v3/projects/85162dc96bd74d2c9c32647022f80851` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:05.976403 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73750c-dc23-4bac-ba5d-48c6bf935a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=85162dc96bd74d2c9c32647022f80851)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:06.002600 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73750c-dc23-4bac-ba5d-48c6bf935a1f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:06.137813 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-8a73750c-dc23-4bac-ba5d-48c6bf935a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85162dc96bd74d2c9c32647022f80851', 'request_id': 'req-8a73750c-dc23-4bac-ba5d-48c6bf935a1f'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:06.143224 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-8a73750c-dc23-4bac-ba5d-48c6bf935a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85162dc96bd74d2c9c32647022f80851', 'request_id': 'req-8a73750c-dc23-4bac-ba5d-48c6bf935a1f'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:06.156780 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-8a73750c-dc23-4bac-ba5d-48c6bf935a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85162dc96bd74d2c9c32647022f80851', 'request_id': 'req-8a73750c-dc23-4bac-ba5d-48c6bf935a1f'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:06.233458 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-8a73750c-dc23-4bac-ba5d-48c6bf935a1f admin admin] The token cache is being invalidate because project 85162dc96bd74d2c9c32647022f80851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:01:06.233745 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-8a73750c-dc23-4bac-ba5d-48c6bf935a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:06.234344 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-8a73750c-dc23-4bac-ba5d-48c6bf935a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:06.235815 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1271/2575] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:01:05 2021] DELETE /identity/v3/projects/85162dc96bd74d2c9c32647022f80851 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:06.241478 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae39d3f-403a-418d-b017-fb591a6a7d65 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:06.241962 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae39d3f-403a-418d-b017-fb591a6a7d65 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:06.242380 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae39d3f-403a-418d-b017-fb591a6a7d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:06.269000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-fae39d3f-403a-418d-b017-fb591a6a7d65 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:06.270157 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-fae39d3f-403a-418d-b017-fb591a6a7d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:06.338100 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1305/2576] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:06.347661 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd576e-1a06-4cf4-bbfc-b32904e0c16a None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:06.348007 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd576e-1a06-4cf4-bbfc-b32904e0c16a None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:06.348331 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd576e-1a06-4cf4-bbfc-b32904e0c16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:06.372482 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-83dd576e-1a06-4cf4-bbfc-b32904e0c16a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:06.373737 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-83dd576e-1a06-4cf4-bbfc-b32904e0c16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:06.381745 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1272/2577] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 02:01:06.385840 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae39d3f-403a-418d-b017-fb591a6a7d65 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:06.396119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae39d3f-403a-418d-b017-fb591a6a7d65 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:06.401071 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f2fed-e391-4a18-8ecf-c402a7fcfe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:06.401685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f2fed-e391-4a18-8ecf-c402a7fcfe57 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:06.401999 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f2fed-e391-4a18-8ecf-c402a7fcfe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:06.402340 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f2fed-e391-4a18-8ecf-c402a7fcfe57 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:06.403072 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f2fed-e391-4a18-8ecf-c402a7fcfe57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 02:01:06.403422 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f2fed-e391-4a18-8ecf-c402a7fcfe57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:06.433624 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f2fed-e391-4a18-8ecf-c402a7fcfe57 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:06.448067 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1306/2578] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 02:01:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 02:01:06.452464 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd576e-1a06-4cf4-bbfc-b32904e0c16a None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:06.461577 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd576e-1a06-4cf4-bbfc-b32904e0c16a None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:06.469235 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5cd5b-c4c3-450e-9d50-02e424a427f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:06.469840 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5cd5b-c4c3-450e-9d50-02e424a427f0 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:06.470544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5cd5b-c4c3-450e-9d50-02e424a427f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:06.470862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5cd5b-c4c3-450e-9d50-02e424a427f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:06.471511 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5cd5b-c4c3-450e-9d50-02e424a427f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:06.497821 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5cd5b-c4c3-450e-9d50-02e424a427f0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:06.597227 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1273/2579] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:01:06 2021] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:01:06.601396 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f2fed-e391-4a18-8ecf-c402a7fcfe57 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:06.612370 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f2fed-e391-4a18-8ecf-c402a7fcfe57 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:06.682712 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32476ffc-049e-4a4b-89ae-1ec8a0c6159c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:06.683475 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32476ffc-049e-4a4b-89ae-1ec8a0c6159c admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:06.683830 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32476ffc-049e-4a4b-89ae-1ec8a0c6159c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:06.684204 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32476ffc-049e-4a4b-89ae-1ec8a0c6159c admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:06.684936 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32476ffc-049e-4a4b-89ae-1ec8a0c6159c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:06.711087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32476ffc-049e-4a4b-89ae-1ec8a0c6159c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:06.794635 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1307/2580] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:01:06 2021] POST /identity/v3/users => generated 284 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:01:06.798637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5cd5b-c4c3-450e-9d50-02e424a427f0 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:06.810203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5cd5b-c4c3-450e-9d50-02e424a427f0 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:06.815862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54276264-7113-4cd0-96be-51463bcb6a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:06.816542 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54276264-7113-4cd0-96be-51463bcb6a12 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:06.816875 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54276264-7113-4cd0-96be-51463bcb6a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:06.817163 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54276264-7113-4cd0-96be-51463bcb6a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:06.817858 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54276264-7113-4cd0-96be-51463bcb6a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:06.846170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54276264-7113-4cd0-96be-51463bcb6a12 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:06.858203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1274/2581] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:06 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:06.862305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32476ffc-049e-4a4b-89ae-1ec8a0c6159c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:06.873165 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32476ffc-049e-4a4b-89ae-1ec8a0c6159c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:06.878062 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835c996-4aa8-471d-8d26-6481843c5050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:06.880119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835c996-4aa8-471d-8d26-6481843c5050 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:06.880119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835c996-4aa8-471d-8d26-6481843c5050 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:06.880119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835c996-4aa8-471d-8d26-6481843c5050 admin admin] PATH_INFO: `/v3/projects/888e1ffb89b1414aad7461bdfd6e2aff/users/28d5d7d0391341d8a0daba7a7d7ced89/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:06.901553 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835c996-4aa8-471d-8d26-6481843c5050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=888e1ffb89b1414aad7461bdfd6e2aff, user_id=28d5d7d0391341d8a0daba7a7d7ced89, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:06.929422 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835c996-4aa8-471d-8d26-6481843c5050 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:07.023832 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1308/2582] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:06 2021] PUT /identity/v3/projects/888e1ffb89b1414aad7461bdfd6e2aff/users/28d5d7d0391341d8a0daba7a7d7ced89/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:07.034641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e647f3-68c9-44b6-80d0-55b76828a59a None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:07.035131 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e647f3-68c9-44b6-80d0-55b76828a59a None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:07.035397 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e647f3-68c9-44b6-80d0-55b76828a59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:07.088461 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-a2e647f3-68c9-44b6-80d0-55b76828a59a None None] MFA Rules not processed for user `28d5d7d0391341d8a0daba7a7d7ced89`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:07.088461 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a2e647f3-68c9-44b6-80d0-55b76828a59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:07.090859 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835c996-4aa8-471d-8d26-6481843c5050 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:07.092610 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c835c996-4aa8-471d-8d26-6481843c5050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:07.168597 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1275/2583] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:07 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:07.170771 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835c996-4aa8-471d-8d26-6481843c5050 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:07.177438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19b869-bca1-4af4-8395-7bd0b22941c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:07.178322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19b869-bca1-4af4-8395-7bd0b22941c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:07.178685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19b869-bca1-4af4-8395-7bd0b22941c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:07.179035 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19b869-bca1-4af4-8395-7bd0b22941c1 admin admin] PATH_INFO: `/v3/users/e0b1425fe2b640cdadd6d4bba510e813` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:07.186837 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19b869-bca1-4af4-8395-7bd0b22941c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0b1425fe2b640cdadd6d4bba510e813)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:07.189191 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e647f3-68c9-44b6-80d0-55b76828a59a None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:07.190534 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a2e647f3-68c9-44b6-80d0-55b76828a59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:07.207264 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19b869-bca1-4af4-8395-7bd0b22941c1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:07.275285 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e647f3-68c9-44b6-80d0-55b76828a59a None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:07.279151 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad5010-d5ee-4ac4-8f02-fbb1df0b084d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '913cd471ba494382af7dda858b9010c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:07.279729 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad5010-d5ee-4ac4-8f02-fbb1df0b084d service glance] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:07.280015 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad5010-d5ee-4ac4-8f02-fbb1df0b084d service glance] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:07.280292 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad5010-d5ee-4ac4-8f02-fbb1df0b084d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:07.289088 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad5010-d5ee-4ac4-8f02-fbb1df0b084d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:07.314836 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad5010-d5ee-4ac4-8f02-fbb1df0b084d service glance] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:07.323481 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1276/2584] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:07 2021] GET /identity/v3/auth/tokens => generated 3674 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:01:07.453465 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4d19b869-bca1-4af4-8395-7bd0b22941c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0b1425fe2b640cdadd6d4bba510e813'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:07.454112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4d19b869-bca1-4af4-8395-7bd0b22941c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0b1425fe2b640cdadd6d4bba510e813'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:07.534723 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4d19b869-bca1-4af4-8395-7bd0b22941c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0b1425fe2b640cdadd6d4bba510e813'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:07.543016 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4d19b869-bca1-4af4-8395-7bd0b22941c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0b1425fe2b640cdadd6d4bba510e813'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:07.544187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-4d19b869-bca1-4af4-8395-7bd0b22941c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0b1425fe2b640cdadd6d4bba510e813'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:07.561878 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1309/2585] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:01:07 2021] DELETE /identity/v3/users/e0b1425fe2b640cdadd6d4bba510e813 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:08.042317 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad5010-d5ee-4ac4-8f02-fbb1df0b084d service glance] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:08.052925 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad5010-d5ee-4ac4-8f02-fbb1df0b084d service glance] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:08.116079 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384db09b-68b2-404b-bff2-f410ea0e6c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:08.116925 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384db09b-68b2-404b-bff2-f410ea0e6c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:08.117216 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384db09b-68b2-404b-bff2-f410ea0e6c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:08.117505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384db09b-68b2-404b-bff2-f410ea0e6c4a admin admin] PATH_INFO: `/v3/projects/e97a243b107d49e88f0a17cbd77bce63` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:08.118570 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384db09b-68b2-404b-bff2-f410ea0e6c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e97a243b107d49e88f0a17cbd77bce63)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:08.145190 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384db09b-68b2-404b-bff2-f410ea0e6c4a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:08.290204 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-384db09b-68b2-404b-bff2-f410ea0e6c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e97a243b107d49e88f0a17cbd77bce63', 'request_id': 'req-384db09b-68b2-404b-bff2-f410ea0e6c4a'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:08.295867 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-384db09b-68b2-404b-bff2-f410ea0e6c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e97a243b107d49e88f0a17cbd77bce63', 'request_id': 'req-384db09b-68b2-404b-bff2-f410ea0e6c4a'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:08.307790 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-384db09b-68b2-404b-bff2-f410ea0e6c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e97a243b107d49e88f0a17cbd77bce63', 'request_id': 'req-384db09b-68b2-404b-bff2-f410ea0e6c4a'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:08.421281 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-384db09b-68b2-404b-bff2-f410ea0e6c4a admin admin] The token cache is being invalidate because project e97a243b107d49e88f0a17cbd77bce63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:01:08.428170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-384db09b-68b2-404b-bff2-f410ea0e6c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:08.428170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-384db09b-68b2-404b-bff2-f410ea0e6c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:08.428170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1277/2586] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:01:08 2021] DELETE /identity/v3/projects/e97a243b107d49e88f0a17cbd77bce63 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:08.430181 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f56d93-8c30-49cf-86a9-a5f84ed75146 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:08.431198 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f56d93-8c30-49cf-86a9-a5f84ed75146 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:08.431681 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f56d93-8c30-49cf-86a9-a5f84ed75146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:08.455713 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-62f56d93-8c30-49cf-86a9-a5f84ed75146 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:08.456970 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-62f56d93-8c30-49cf-86a9-a5f84ed75146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:08.522456 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1310/2587] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:08.531184 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1929f11-ac61-4d8e-9f5d-ed2a5101c12a None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:08.531500 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1929f11-ac61-4d8e-9f5d-ed2a5101c12a None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:08.531800 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1929f11-ac61-4d8e-9f5d-ed2a5101c12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:08.555841 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-e1929f11-ac61-4d8e-9f5d-ed2a5101c12a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:08.557709 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-e1929f11-ac61-4d8e-9f5d-ed2a5101c12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:08.566259 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1278/2588] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:08.571501 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f56d93-8c30-49cf-86a9-a5f84ed75146 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:08.581397 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f56d93-8c30-49cf-86a9-a5f84ed75146 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:08.586836 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057a5c1-1f20-4851-9f3f-482e2721d681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:08.587411 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057a5c1-1f20-4851-9f3f-482e2721d681 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:08.587697 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057a5c1-1f20-4851-9f3f-482e2721d681 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:08.587974 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057a5c1-1f20-4851-9f3f-482e2721d681 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:08.588672 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057a5c1-1f20-4851-9f3f-482e2721d681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 02:01:08.588970 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057a5c1-1f20-4851-9f3f-482e2721d681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:08.617253 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057a5c1-1f20-4851-9f3f-482e2721d681 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:08.633184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1311/2589] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 02:01:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 02:01:08.637460 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1929f11-ac61-4d8e-9f5d-ed2a5101c12a None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:08.646885 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1929f11-ac61-4d8e-9f5d-ed2a5101c12a None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:08.651155 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9453927-4c6f-4fe8-b8a0-1ebc400e8991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:08.651729 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9453927-4c6f-4fe8-b8a0-1ebc400e8991 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:08.652017 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9453927-4c6f-4fe8-b8a0-1ebc400e8991 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:08.652298 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9453927-4c6f-4fe8-b8a0-1ebc400e8991 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:08.653491 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9453927-4c6f-4fe8-b8a0-1ebc400e8991 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:08.680763 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9453927-4c6f-4fe8-b8a0-1ebc400e8991 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:08.759686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1279/2590] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:01:08 2021] POST /identity/v3/projects => generated 391 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:01:08.764001 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057a5c1-1f20-4851-9f3f-482e2721d681 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:08.773783 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057a5c1-1f20-4851-9f3f-482e2721d681 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:08.839636 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184db09-4a63-473f-a8bf-7f199087f883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:08.840151 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184db09-4a63-473f-a8bf-7f199087f883 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:08.840998 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184db09-4a63-473f-a8bf-7f199087f883 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:08.841276 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184db09-4a63-473f-a8bf-7f199087f883 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:08.841896 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184db09-4a63-473f-a8bf-7f199087f883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:08.867809 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184db09-4a63-473f-a8bf-7f199087f883 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:08.953086 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1312/2591] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:01:08 2021] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:01:08.957242 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9453927-4c6f-4fe8-b8a0-1ebc400e8991 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:08.967507 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9453927-4c6f-4fe8-b8a0-1ebc400e8991 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:08.971610 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca49661-747f-4f11-a1f3-17585bf0b243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:08.972187 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca49661-747f-4f11-a1f3-17585bf0b243 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:08.972471 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca49661-747f-4f11-a1f3-17585bf0b243 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:08.972775 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca49661-747f-4f11-a1f3-17585bf0b243 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:08.973453 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca49661-747f-4f11-a1f3-17585bf0b243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:08.998643 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca49661-747f-4f11-a1f3-17585bf0b243 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:09.008407 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1280/2592] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:08 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:09.012934 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184db09-4a63-473f-a8bf-7f199087f883 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:09.022176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184db09-4a63-473f-a8bf-7f199087f883 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:09.026301 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d184009-0f9b-4d7a-86e8-c758333ef9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:09.027096 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d184009-0f9b-4d7a-86e8-c758333ef9cc admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:09.027378 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d184009-0f9b-4d7a-86e8-c758333ef9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:09.027655 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d184009-0f9b-4d7a-86e8-c758333ef9cc admin admin] PATH_INFO: `/v3/projects/a85c4108c05f4cf0b7548a316bf6aaa5/users/f2ca98ee41a6462c81eba906e6e15996/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:09.047056 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d184009-0f9b-4d7a-86e8-c758333ef9cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85c4108c05f4cf0b7548a316bf6aaa5, user_id=f2ca98ee41a6462c81eba906e6e15996, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:09.073684 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d184009-0f9b-4d7a-86e8-c758333ef9cc admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:09.221523 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1313/2593] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:09 2021] PUT /identity/v3/projects/a85c4108c05f4cf0b7548a316bf6aaa5/users/f2ca98ee41a6462c81eba906e6e15996/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:09.231858 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930ca35-8481-47f9-9bf6-2be9ed4c935d None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:09.232348 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930ca35-8481-47f9-9bf6-2be9ed4c935d None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:09.232481 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930ca35-8481-47f9-9bf6-2be9ed4c935d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:09.271379 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-f930ca35-8481-47f9-9bf6-2be9ed4c935d None None] MFA Rules not processed for user `f2ca98ee41a6462c81eba906e6e15996`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:09.272532 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-f930ca35-8481-47f9-9bf6-2be9ed4c935d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:09.343356 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1281/2594] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:09 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:09.352587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d184009-0f9b-4d7a-86e8-c758333ef9cc admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:09.354176 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-4d184009-0f9b-4d7a-86e8-c758333ef9cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:09.421669 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d184009-0f9b-4d7a-86e8-c758333ef9cc admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:09.431495 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964451d-890b-4e8d-b11e-9e909511ab7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:09.431495 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964451d-890b-4e8d-b11e-9e909511ab7a service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:09.431495 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964451d-890b-4e8d-b11e-9e909511ab7a service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:09.431495 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964451d-890b-4e8d-b11e-9e909511ab7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:09.436116 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964451d-890b-4e8d-b11e-9e909511ab7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:09.461734 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964451d-890b-4e8d-b11e-9e909511ab7a service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:09.471375 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1314/2595] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:09 2021] GET /identity/v3/auth/tokens => generated 3698 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:01:15.680991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930ca35-8481-47f9-9bf6-2be9ed4c935d None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:15.682406 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-f930ca35-8481-47f9-9bf6-2be9ed4c935d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:15.753679 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930ca35-8481-47f9-9bf6-2be9ed4c935d None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:15.758363 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dac1c6-5460-4ee3-8a17-8da7e81a1f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:15.759152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dac1c6-5460-4ee3-8a17-8da7e81a1f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:15.759433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dac1c6-5460-4ee3-8a17-8da7e81a1f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:15.759709 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dac1c6-5460-4ee3-8a17-8da7e81a1f16 admin admin] PATH_INFO: `/v3/users/666bfc452329472482d1abc582308241` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:15.760952 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dac1c6-5460-4ee3-8a17-8da7e81a1f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=666bfc452329472482d1abc582308241)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:15.788374 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dac1c6-5460-4ee3-8a17-8da7e81a1f16 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:15.973053 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-00dac1c6-5460-4ee3-8a17-8da7e81a1f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '666bfc452329472482d1abc582308241'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:16.033320 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-00dac1c6-5460-4ee3-8a17-8da7e81a1f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '666bfc452329472482d1abc582308241'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:16.041334 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-00dac1c6-5460-4ee3-8a17-8da7e81a1f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '666bfc452329472482d1abc582308241'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:16.049572 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-00dac1c6-5460-4ee3-8a17-8da7e81a1f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '666bfc452329472482d1abc582308241'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:16.050244 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-00dac1c6-5460-4ee3-8a17-8da7e81a1f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '666bfc452329472482d1abc582308241'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:16.069409 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1282/2596] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:01:15 2021] DELETE /identity/v3/users/666bfc452329472482d1abc582308241 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:16.074066 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc0496-778f-4388-89c9-a9a149adb974 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:16.078956 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc0496-778f-4388-89c9-a9a149adb974 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:16.078956 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc0496-778f-4388-89c9-a9a149adb974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:16.097582 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-ebcc0496-778f-4388-89c9-a9a149adb974 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:16.098749 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ebcc0496-778f-4388-89c9-a9a149adb974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:16.164119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1315/2597] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:16.174710 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dac1c6-5460-4ee3-8a17-8da7e81a1f16 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:16.176332 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-00dac1c6-5460-4ee3-8a17-8da7e81a1f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:16.241066 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dac1c6-5460-4ee3-8a17-8da7e81a1f16 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:16.244961 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d6579-a43f-47c8-9e65-01b788423465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:16.245721 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d6579-a43f-47c8-9e65-01b788423465 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:16.246069 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d6579-a43f-47c8-9e65-01b788423465 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:16.247014 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d6579-a43f-47c8-9e65-01b788423465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:16.258571 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d6579-a43f-47c8-9e65-01b788423465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:16.285142 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d6579-a43f-47c8-9e65-01b788423465 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:16.294679 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1283/2598] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:16 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:01:16.792967 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc0496-778f-4388-89c9-a9a149adb974 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:16.794984 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ebcc0496-778f-4388-89c9-a9a149adb974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:16.806839 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc0496-778f-4388-89c9-a9a149adb974 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:16.811097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88cde9d-7c1a-4eec-88b9-b899c2f3d9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:16.811882 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88cde9d-7c1a-4eec-88b9-b899c2f3d9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:16.812169 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88cde9d-7c1a-4eec-88b9-b899c2f3d9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:16.812446 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88cde9d-7c1a-4eec-88b9-b899c2f3d9e7 admin admin] PATH_INFO: `/v3/projects/9242c46766eb4a4389e4d23fee592d45` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:16.813580 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88cde9d-7c1a-4eec-88b9-b899c2f3d9e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9242c46766eb4a4389e4d23fee592d45)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:16.839010 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88cde9d-7c1a-4eec-88b9-b899c2f3d9e7 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:16.948116 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a88cde9d-7c1a-4eec-88b9-b899c2f3d9e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9242c46766eb4a4389e4d23fee592d45', 'request_id': 'req-a88cde9d-7c1a-4eec-88b9-b899c2f3d9e7'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:16.953056 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a88cde9d-7c1a-4eec-88b9-b899c2f3d9e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9242c46766eb4a4389e4d23fee592d45', 'request_id': 'req-a88cde9d-7c1a-4eec-88b9-b899c2f3d9e7'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:16.963677 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a88cde9d-7c1a-4eec-88b9-b899c2f3d9e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9242c46766eb4a4389e4d23fee592d45', 'request_id': 'req-a88cde9d-7c1a-4eec-88b9-b899c2f3d9e7'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:17.032885 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a88cde9d-7c1a-4eec-88b9-b899c2f3d9e7 admin admin] The token cache is being invalidate because project 9242c46766eb4a4389e4d23fee592d45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:01:17.033129 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a88cde9d-7c1a-4eec-88b9-b899c2f3d9e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:17.033723 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-a88cde9d-7c1a-4eec-88b9-b899c2f3d9e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:17.035231 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1316/2599] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:01:16 2021] DELETE /identity/v3/projects/9242c46766eb4a4389e4d23fee592d45 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:17.040833 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56e63d-a618-4089-b4de-0450aa80bf0b None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:17.041304 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56e63d-a618-4089-b4de-0450aa80bf0b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:17.041410 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56e63d-a618-4089-b4de-0450aa80bf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:17.065753 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-dd56e63d-a618-4089-b4de-0450aa80bf0b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:17.066899 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-dd56e63d-a618-4089-b4de-0450aa80bf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:17.133424 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1284/2600] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 02:01:17.141582 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48da17-7aab-48c7-a7ed-c8f3b325c0a1 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:17.142057 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48da17-7aab-48c7-a7ed-c8f3b325c0a1 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:17.142161 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48da17-7aab-48c7-a7ed-c8f3b325c0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:17.165527 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-ef48da17-7aab-48c7-a7ed-c8f3b325c0a1 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:17.166667 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ef48da17-7aab-48c7-a7ed-c8f3b325c0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:17.173584 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1317/2601] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:17.178043 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56e63d-a618-4089-b4de-0450aa80bf0b None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:17.187208 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56e63d-a618-4089-b4de-0450aa80bf0b None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:17.191309 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc91d1-e02d-4056-9fce-c5b99eecce12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:17.195133 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc91d1-e02d-4056-9fce-c5b99eecce12 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:17.195133 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc91d1-e02d-4056-9fce-c5b99eecce12 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:17.195133 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc91d1-e02d-4056-9fce-c5b99eecce12 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:17.195133 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc91d1-e02d-4056-9fce-c5b99eecce12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 02:01:17.195133 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc91d1-e02d-4056-9fce-c5b99eecce12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:17.220181 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc91d1-e02d-4056-9fce-c5b99eecce12 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:17.235249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1285/2602] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 02:01:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 02:01:17.239711 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48da17-7aab-48c7-a7ed-c8f3b325c0a1 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:17.249059 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48da17-7aab-48c7-a7ed-c8f3b325c0a1 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:17.253345 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cea82-1843-42d5-90a3-6b9c86a6e955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:17.253935 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cea82-1843-42d5-90a3-6b9c86a6e955 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:17.254219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cea82-1843-42d5-90a3-6b9c86a6e955 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:17.254497 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cea82-1843-42d5-90a3-6b9c86a6e955 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:17.255158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cea82-1843-42d5-90a3-6b9c86a6e955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:17.281606 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cea82-1843-42d5-90a3-6b9c86a6e955 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:17.376298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1318/2603] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:01:17 2021] POST /identity/v3/projects => generated 403 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:01:17.380481 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc91d1-e02d-4056-9fce-c5b99eecce12 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:17.392864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc91d1-e02d-4056-9fce-c5b99eecce12 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:17.532949 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40db48-86f9-4a62-bfc5-73b26a2c3f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:17.533645 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40db48-86f9-4a62-bfc5-73b26a2c3f15 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:17.533930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40db48-86f9-4a62-bfc5-73b26a2c3f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:17.534209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40db48-86f9-4a62-bfc5-73b26a2c3f15 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:17.534851 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40db48-86f9-4a62-bfc5-73b26a2c3f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:17.560878 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40db48-86f9-4a62-bfc5-73b26a2c3f15 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:17.667771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1286/2604] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:01:17 2021] POST /identity/v3/users => generated 302 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:01:17.672969 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cea82-1843-42d5-90a3-6b9c86a6e955 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:17.681606 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cea82-1843-42d5-90a3-6b9c86a6e955 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:17.686453 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd90bb5-0b2d-4a75-b36c-fcfb0db0d16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:17.687037 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd90bb5-0b2d-4a75-b36c-fcfb0db0d16c admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:17.687322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd90bb5-0b2d-4a75-b36c-fcfb0db0d16c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:17.687601 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd90bb5-0b2d-4a75-b36c-fcfb0db0d16c admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:17.688284 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd90bb5-0b2d-4a75-b36c-fcfb0db0d16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:17.713914 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd90bb5-0b2d-4a75-b36c-fcfb0db0d16c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:17.724459 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1319/2605] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:17 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:17.728676 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40db48-86f9-4a62-bfc5-73b26a2c3f15 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:17.738376 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40db48-86f9-4a62-bfc5-73b26a2c3f15 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:17.742521 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b68c9-f7a4-4d51-96af-5a45818cb831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:17.743340 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b68c9-f7a4-4d51-96af-5a45818cb831 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:17.743623 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b68c9-f7a4-4d51-96af-5a45818cb831 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:17.743905 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b68c9-f7a4-4d51-96af-5a45818cb831 admin admin] PATH_INFO: `/v3/projects/488a29bdc5f845aa863ee0a6c9a2d363/users/73a9c9cbedc041dc8475e813347bac6b/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:17.763940 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b68c9-f7a4-4d51-96af-5a45818cb831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=488a29bdc5f845aa863ee0a6c9a2d363, user_id=73a9c9cbedc041dc8475e813347bac6b, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:17.790408 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b68c9-f7a4-4d51-96af-5a45818cb831 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:17.902311 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1287/2606] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:17 2021] PUT /identity/v3/projects/488a29bdc5f845aa863ee0a6c9a2d363/users/73a9c9cbedc041dc8475e813347bac6b/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:17.912494 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43177ab2-cb7a-4467-b10b-5972b9bb73e3 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:17.912818 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43177ab2-cb7a-4467-b10b-5972b9bb73e3 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:17.913130 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43177ab2-cb7a-4467-b10b-5972b9bb73e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:17.949849 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-43177ab2-cb7a-4467-b10b-5972b9bb73e3 None None] MFA Rules not processed for user `73a9c9cbedc041dc8475e813347bac6b`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:17.951296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-43177ab2-cb7a-4467-b10b-5972b9bb73e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:18.022860 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1320/2607] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:17 2021] POST /identity/v3/auth/tokens => generated 3710 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:18.027742 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b68c9-f7a4-4d51-96af-5a45818cb831 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:18.097704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b68c9-f7a4-4d51-96af-5a45818cb831 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:18.102136 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2383da-bd97-410e-9314-9aaaa3069249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:18.102727 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2383da-bd97-410e-9314-9aaaa3069249 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:18.103013 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2383da-bd97-410e-9314-9aaaa3069249 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:18.103294 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2383da-bd97-410e-9314-9aaaa3069249 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:18.103935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2383da-bd97-410e-9314-9aaaa3069249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:18.131646 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2383da-bd97-410e-9314-9aaaa3069249 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:18.235420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1288/2608] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:01:18 2021] POST /identity/v3/projects => generated 405 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:01:18.239496 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43177ab2-cb7a-4467-b10b-5972b9bb73e3 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:18.250432 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43177ab2-cb7a-4467-b10b-5972b9bb73e3 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:18.313934 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0bb91-e390-486d-9062-849d38e9f593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:18.314531 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0bb91-e390-486d-9062-849d38e9f593 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:18.314879 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0bb91-e390-486d-9062-849d38e9f593 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:18.315158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0bb91-e390-486d-9062-849d38e9f593 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:18.315802 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0bb91-e390-486d-9062-849d38e9f593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:18.342226 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0bb91-e390-486d-9062-849d38e9f593 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:18.419905 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1321/2609] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:01:18 2021] POST /identity/v3/users => generated 309 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:01:18.421175 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2383da-bd97-410e-9314-9aaaa3069249 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:18.431740 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2383da-bd97-410e-9314-9aaaa3069249 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:18.437413 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede093f8-1690-42f4-b263-61c795146dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:18.438102 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede093f8-1690-42f4-b263-61c795146dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:18.438457 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede093f8-1690-42f4-b263-61c795146dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:18.438804 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede093f8-1690-42f4-b263-61c795146dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:18.439607 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede093f8-1690-42f4-b263-61c795146dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:18.465647 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede093f8-1690-42f4-b263-61c795146dd2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:18.476903 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1289/2610] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:18 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:18.481869 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0bb91-e390-486d-9062-849d38e9f593 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:18.491924 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0bb91-e390-486d-9062-849d38e9f593 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:18.496187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f31588-1040-4453-9091-654a8f095379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:18.497405 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f31588-1040-4453-9091-654a8f095379 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:18.497696 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f31588-1040-4453-9091-654a8f095379 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:18.497976 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f31588-1040-4453-9091-654a8f095379 admin admin] PATH_INFO: `/v3/projects/a6c5c11bd5b7459e9153d723f04ca878/users/65ec6cf982b94f319daeb1de3fc377bb/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:18.517579 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f31588-1040-4453-9091-654a8f095379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c5c11bd5b7459e9153d723f04ca878, user_id=65ec6cf982b94f319daeb1de3fc377bb, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:18.545704 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f31588-1040-4453-9091-654a8f095379 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:18.621941 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1322/2611] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:18 2021] PUT /identity/v3/projects/a6c5c11bd5b7459e9153d723f04ca878/users/65ec6cf982b94f319daeb1de3fc377bb/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:18.626362 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede093f8-1690-42f4-b263-61c795146dd2 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:18.636129 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede093f8-1690-42f4-b263-61c795146dd2 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:18.699916 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f688f-624e-4249-875a-6743f716d056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:18.700515 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f688f-624e-4249-875a-6743f716d056 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:18.700832 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f688f-624e-4249-875a-6743f716d056 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:18.701114 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f688f-624e-4249-875a-6743f716d056 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:18.701809 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f688f-624e-4249-875a-6743f716d056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:18.727473 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f688f-624e-4249-875a-6743f716d056 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:18.737097 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1290/2612] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:18 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:18.741173 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f31588-1040-4453-9091-654a8f095379 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:18.750910 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f31588-1040-4453-9091-654a8f095379 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:18.755501 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df513cfa-5e0d-4fcb-9d48-c98dda019205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:18.756332 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513cfa-5e0d-4fcb-9d48-c98dda019205 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:18.756652 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513cfa-5e0d-4fcb-9d48-c98dda019205 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:18.756939 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513cfa-5e0d-4fcb-9d48-c98dda019205 admin admin] PATH_INFO: `/v3/projects/a6c5c11bd5b7459e9153d723f04ca878/users/65ec6cf982b94f319daeb1de3fc377bb/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:18.758766 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df513cfa-5e0d-4fcb-9d48-c98dda019205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c5c11bd5b7459e9153d723f04ca878, user_id=65ec6cf982b94f319daeb1de3fc377bb, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:18.786372 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df513cfa-5e0d-4fcb-9d48-c98dda019205 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:18.797000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1323/2613] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:18 2021] PUT /identity/v3/projects/a6c5c11bd5b7459e9153d723f04ca878/users/65ec6cf982b94f319daeb1de3fc377bb/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:18.801369 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f688f-624e-4249-875a-6743f716d056 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:18.813921 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f688f-624e-4249-875a-6743f716d056 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:18.877697 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d66396-6bd8-4c96-bb68-90b875ee4950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:18.878289 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d66396-6bd8-4c96-bb68-90b875ee4950 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:18.878573 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d66396-6bd8-4c96-bb68-90b875ee4950 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:18.878857 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d66396-6bd8-4c96-bb68-90b875ee4950 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:18.879535 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d66396-6bd8-4c96-bb68-90b875ee4950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:18.906645 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d66396-6bd8-4c96-bb68-90b875ee4950 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:18.917210 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1291/2614] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:18 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:18.921687 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df513cfa-5e0d-4fcb-9d48-c98dda019205 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:18.931611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df513cfa-5e0d-4fcb-9d48-c98dda019205 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:18.935717 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c084274-4c02-44ad-8335-cafd830e145e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:18.936509 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c084274-4c02-44ad-8335-cafd830e145e admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:18.936826 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c084274-4c02-44ad-8335-cafd830e145e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:18.937102 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c084274-4c02-44ad-8335-cafd830e145e admin admin] PATH_INFO: `/v3/projects/a6c5c11bd5b7459e9153d723f04ca878/users/65ec6cf982b94f319daeb1de3fc377bb/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:18.938876 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c084274-4c02-44ad-8335-cafd830e145e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c5c11bd5b7459e9153d723f04ca878, user_id=65ec6cf982b94f319daeb1de3fc377bb, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:18.966341 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c084274-4c02-44ad-8335-cafd830e145e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:19.040499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1324/2615] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:18 2021] PUT /identity/v3/projects/a6c5c11bd5b7459e9153d723f04ca878/users/65ec6cf982b94f319daeb1de3fc377bb/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:19.051997 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdf785-af73-48b6-a1cc-40b2d6da5a84 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:19.052289 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdf785-af73-48b6-a1cc-40b2d6da5a84 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:19.058379 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdf785-af73-48b6-a1cc-40b2d6da5a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:19.091152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-5ffdf785-af73-48b6-a1cc-40b2d6da5a84 None None] MFA Rules not processed for user `65ec6cf982b94f319daeb1de3fc377bb`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:19.093598 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5ffdf785-af73-48b6-a1cc-40b2d6da5a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:19.165824 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1292/2616] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:19 2021] POST /identity/v3/auth/tokens => generated 3779 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:19.175632 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c084274-4c02-44ad-8335-cafd830e145e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:19.177514 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-6c084274-4c02-44ad-8335-cafd830e145e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:19.240234 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c084274-4c02-44ad-8335-cafd830e145e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:19.243905 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc8f15-46ed-448a-b084-1cf8f6b7e437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:19.244474 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc8f15-46ed-448a-b084-1cf8f6b7e437 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:19.244792 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc8f15-46ed-448a-b084-1cf8f6b7e437 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:19.245068 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc8f15-46ed-448a-b084-1cf8f6b7e437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:19.254329 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc8f15-46ed-448a-b084-1cf8f6b7e437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:19.279999 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc8f15-46ed-448a-b084-1cf8f6b7e437 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:19.289739 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1325/2617] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:19 2021] GET /identity/v3/auth/tokens => generated 3779 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:01:19.842338 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdf785-af73-48b6-a1cc-40b2d6da5a84 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:19.909309 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdf785-af73-48b6-a1cc-40b2d6da5a84 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:19.913441 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd746238-b097-4b8c-a532-f84998f5dd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:19.914240 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd746238-b097-4b8c-a532-f84998f5dd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:19.914529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd746238-b097-4b8c-a532-f84998f5dd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:19.914813 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd746238-b097-4b8c-a532-f84998f5dd05 admin admin] PATH_INFO: `/v3/users/73a9c9cbedc041dc8475e813347bac6b` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:19.915903 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd746238-b097-4b8c-a532-f84998f5dd05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a9c9cbedc041dc8475e813347bac6b)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:19.942925 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd746238-b097-4b8c-a532-f84998f5dd05 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:20.098413 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fd746238-b097-4b8c-a532-f84998f5dd05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a9c9cbedc041dc8475e813347bac6b'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:20.164420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fd746238-b097-4b8c-a532-f84998f5dd05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a9c9cbedc041dc8475e813347bac6b'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:20.164930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fd746238-b097-4b8c-a532-f84998f5dd05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a9c9cbedc041dc8475e813347bac6b'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:20.173171 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fd746238-b097-4b8c-a532-f84998f5dd05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a9c9cbedc041dc8475e813347bac6b'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:20.173742 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fd746238-b097-4b8c-a532-f84998f5dd05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a9c9cbedc041dc8475e813347bac6b'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:20.190574 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1293/2618] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:01:19 2021] DELETE /identity/v3/users/73a9c9cbedc041dc8475e813347bac6b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:20.194999 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951518ea-3e0d-45ed-831c-ed3a26a5ad29 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:20.195329 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951518ea-3e0d-45ed-831c-ed3a26a5ad29 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:20.195643 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951518ea-3e0d-45ed-831c-ed3a26a5ad29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:20.219715 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-951518ea-3e0d-45ed-831c-ed3a26a5ad29 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:20.220888 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-951518ea-3e0d-45ed-831c-ed3a26a5ad29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:20.288326 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1326/2619] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:20.298964 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd746238-b097-4b8c-a532-f84998f5dd05 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:20.300361 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-fd746238-b097-4b8c-a532-f84998f5dd05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:20.364785 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd746238-b097-4b8c-a532-f84998f5dd05 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:20.368263 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65719ca-fb77-4abb-9af4-50dd97846024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:20.368916 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65719ca-fb77-4abb-9af4-50dd97846024 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:20.369220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65719ca-fb77-4abb-9af4-50dd97846024 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:20.369505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65719ca-fb77-4abb-9af4-50dd97846024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:20.378822 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65719ca-fb77-4abb-9af4-50dd97846024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:20.410959 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65719ca-fb77-4abb-9af4-50dd97846024 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:20.420898 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1294/2620] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:20 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:01:20.901396 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951518ea-3e0d-45ed-831c-ed3a26a5ad29 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:20.902801 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-951518ea-3e0d-45ed-831c-ed3a26a5ad29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:20.913714 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951518ea-3e0d-45ed-831c-ed3a26a5ad29 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:20.918800 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16095f-75a4-459e-bd3e-6b4792b3a632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:20.919571 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16095f-75a4-459e-bd3e-6b4792b3a632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:20.919909 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16095f-75a4-459e-bd3e-6b4792b3a632 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:20.920364 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16095f-75a4-459e-bd3e-6b4792b3a632 admin admin] PATH_INFO: `/v3/projects/488a29bdc5f845aa863ee0a6c9a2d363` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:20.921266 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16095f-75a4-459e-bd3e-6b4792b3a632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=488a29bdc5f845aa863ee0a6c9a2d363)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:20.948333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16095f-75a4-459e-bd3e-6b4792b3a632 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:21.068482 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5e16095f-75a4-459e-bd3e-6b4792b3a632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488a29bdc5f845aa863ee0a6c9a2d363', 'request_id': 'req-5e16095f-75a4-459e-bd3e-6b4792b3a632'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:21.073929 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5e16095f-75a4-459e-bd3e-6b4792b3a632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488a29bdc5f845aa863ee0a6c9a2d363', 'request_id': 'req-5e16095f-75a4-459e-bd3e-6b4792b3a632'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:21.094347 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5e16095f-75a4-459e-bd3e-6b4792b3a632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488a29bdc5f845aa863ee0a6c9a2d363', 'request_id': 'req-5e16095f-75a4-459e-bd3e-6b4792b3a632'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:21.170234 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5e16095f-75a4-459e-bd3e-6b4792b3a632 admin admin] The token cache is being invalidate because project 488a29bdc5f845aa863ee0a6c9a2d363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:01:21.170517 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5e16095f-75a4-459e-bd3e-6b4792b3a632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:21.171109 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-5e16095f-75a4-459e-bd3e-6b4792b3a632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:21.172607 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1327/2621] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:01:20 2021] DELETE /identity/v3/projects/488a29bdc5f845aa863ee0a6c9a2d363 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:21.176814 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65719ca-fb77-4abb-9af4-50dd97846024 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:21.186765 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65719ca-fb77-4abb-9af4-50dd97846024 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:21.251064 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333ac19-2145-48c4-8fb3-b58ec8087007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:21.251785 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333ac19-2145-48c4-8fb3-b58ec8087007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:21.252070 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333ac19-2145-48c4-8fb3-b58ec8087007 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:21.252412 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333ac19-2145-48c4-8fb3-b58ec8087007 admin admin] PATH_INFO: `/v3/users/65ec6cf982b94f319daeb1de3fc377bb` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:21.253516 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333ac19-2145-48c4-8fb3-b58ec8087007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65ec6cf982b94f319daeb1de3fc377bb)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:21.279952 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333ac19-2145-48c4-8fb3-b58ec8087007 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:21.452814 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5333ac19-2145-48c4-8fb3-b58ec8087007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65ec6cf982b94f319daeb1de3fc377bb'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:21.507086 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5333ac19-2145-48c4-8fb3-b58ec8087007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65ec6cf982b94f319daeb1de3fc377bb'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:21.507601 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5333ac19-2145-48c4-8fb3-b58ec8087007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65ec6cf982b94f319daeb1de3fc377bb'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:21.515845 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5333ac19-2145-48c4-8fb3-b58ec8087007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65ec6cf982b94f319daeb1de3fc377bb'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:21.516468 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5333ac19-2145-48c4-8fb3-b58ec8087007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65ec6cf982b94f319daeb1de3fc377bb'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:21.534377 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1295/2622] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:01:21 2021] DELETE /identity/v3/users/65ec6cf982b94f319daeb1de3fc377bb => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:22.030057 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16095f-75a4-459e-bd3e-6b4792b3a632 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:22.032060 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-5e16095f-75a4-459e-bd3e-6b4792b3a632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:22.045591 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16095f-75a4-459e-bd3e-6b4792b3a632 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:22.107730 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a329d9-a206-4125-9260-bf66791e4176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:22.108511 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a329d9-a206-4125-9260-bf66791e4176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:22.108956 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a329d9-a206-4125-9260-bf66791e4176 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:22.109236 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a329d9-a206-4125-9260-bf66791e4176 admin admin] PATH_INFO: `/v3/projects/a6c5c11bd5b7459e9153d723f04ca878` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:22.110300 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a329d9-a206-4125-9260-bf66791e4176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c5c11bd5b7459e9153d723f04ca878)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:22.136729 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a329d9-a206-4125-9260-bf66791e4176 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:22.280313 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-70a329d9-a206-4125-9260-bf66791e4176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c5c11bd5b7459e9153d723f04ca878', 'request_id': 'req-70a329d9-a206-4125-9260-bf66791e4176'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:22.285289 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-70a329d9-a206-4125-9260-bf66791e4176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c5c11bd5b7459e9153d723f04ca878', 'request_id': 'req-70a329d9-a206-4125-9260-bf66791e4176'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:22.296749 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-70a329d9-a206-4125-9260-bf66791e4176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c5c11bd5b7459e9153d723f04ca878', 'request_id': 'req-70a329d9-a206-4125-9260-bf66791e4176'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:22.369241 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-70a329d9-a206-4125-9260-bf66791e4176 admin admin] The token cache is being invalidate because project a6c5c11bd5b7459e9153d723f04ca878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:01:22.369524 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-70a329d9-a206-4125-9260-bf66791e4176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:22.370113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-70a329d9-a206-4125-9260-bf66791e4176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:22.371641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1328/2623] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:01:22 2021] DELETE /identity/v3/projects/a6c5c11bd5b7459e9153d723f04ca878 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:22.378005 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26d6fb-d354-4bbf-b95b-662a37f70827 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:22.378472 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26d6fb-d354-4bbf-b95b-662a37f70827 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:22.378569 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26d6fb-d354-4bbf-b95b-662a37f70827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:22.401040 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-3c26d6fb-d354-4bbf-b95b-662a37f70827 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:22.402283 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-3c26d6fb-d354-4bbf-b95b-662a37f70827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:22.468628 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1296/2624] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:22.476403 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4caa1-a52d-455a-8a25-de72924db57a None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:22.476799 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4caa1-a52d-455a-8a25-de72924db57a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:22.477087 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4caa1-a52d-455a-8a25-de72924db57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:22.499928 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-c2c4caa1-a52d-455a-8a25-de72924db57a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:22.501182 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c2c4caa1-a52d-455a-8a25-de72924db57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:22.509445 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1329/2625] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:22.513369 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26d6fb-d354-4bbf-b95b-662a37f70827 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:22.522629 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26d6fb-d354-4bbf-b95b-662a37f70827 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:22.526871 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa0fa9-7034-4007-9914-ca9ce4b8e122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:22.527441 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa0fa9-7034-4007-9914-ca9ce4b8e122 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:22.527722 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa0fa9-7034-4007-9914-ca9ce4b8e122 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:22.528082 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa0fa9-7034-4007-9914-ca9ce4b8e122 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:22.528799 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa0fa9-7034-4007-9914-ca9ce4b8e122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 02:01:22.529096 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa0fa9-7034-4007-9914-ca9ce4b8e122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:22.554893 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa0fa9-7034-4007-9914-ca9ce4b8e122 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:22.568639 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1297/2626] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 02:01:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 02:01:22.573173 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4caa1-a52d-455a-8a25-de72924db57a None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:22.581797 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4caa1-a52d-455a-8a25-de72924db57a None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:22.588519 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adca5fa-7340-4254-bf9f-a9c650855e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:22.588519 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adca5fa-7340-4254-bf9f-a9c650855e51 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:22.588519 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adca5fa-7340-4254-bf9f-a9c650855e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:22.588519 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adca5fa-7340-4254-bf9f-a9c650855e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:22.589005 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adca5fa-7340-4254-bf9f-a9c650855e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:22.613479 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adca5fa-7340-4254-bf9f-a9c650855e51 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:22.696182 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1330/2627] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:01:22 2021] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:01:22.700361 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa0fa9-7034-4007-9914-ca9ce4b8e122 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:22.709816 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa0fa9-7034-4007-9914-ca9ce4b8e122 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:22.770085 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cd97c-44ce-4f41-926d-5d3f73079788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:22.770672 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cd97c-44ce-4f41-926d-5d3f73079788 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:22.770957 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cd97c-44ce-4f41-926d-5d3f73079788 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:22.771235 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cd97c-44ce-4f41-926d-5d3f73079788 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:22.771861 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cd97c-44ce-4f41-926d-5d3f73079788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:22.798223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cd97c-44ce-4f41-926d-5d3f73079788 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:22.872776 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1298/2628] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:01:22 2021] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:01:22.876756 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adca5fa-7340-4254-bf9f-a9c650855e51 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:22.886631 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adca5fa-7340-4254-bf9f-a9c650855e51 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:22.890952 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c15e57-9288-4037-a224-f48208fdf3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:22.891613 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c15e57-9288-4037-a224-f48208fdf3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:22.891901 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c15e57-9288-4037-a224-f48208fdf3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:22.892208 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c15e57-9288-4037-a224-f48208fdf3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:22.893001 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c15e57-9288-4037-a224-f48208fdf3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:22.919509 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c15e57-9288-4037-a224-f48208fdf3c2 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:22.929851 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1331/2629] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:22 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:22.933843 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cd97c-44ce-4f41-926d-5d3f73079788 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:22.943221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cd97c-44ce-4f41-926d-5d3f73079788 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:22.947401 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75cd0d-2f16-43a2-9641-6884bea45805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:22.948217 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75cd0d-2f16-43a2-9641-6884bea45805 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:22.948493 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75cd0d-2f16-43a2-9641-6884bea45805 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:22.948805 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75cd0d-2f16-43a2-9641-6884bea45805 admin admin] PATH_INFO: `/v3/projects/9d0db0e2722647ec802ea73002427ec0/users/9d1c37218f6549c3ada02355e9fb9efe/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:22.968258 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75cd0d-2f16-43a2-9641-6884bea45805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d0db0e2722647ec802ea73002427ec0, user_id=9d1c37218f6549c3ada02355e9fb9efe, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:22.994984 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75cd0d-2f16-43a2-9641-6884bea45805 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:23.054814 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1299/2630] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:22 2021] PUT /identity/v3/projects/9d0db0e2722647ec802ea73002427ec0/users/9d1c37218f6549c3ada02355e9fb9efe/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:23.064708 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999195d-06a1-4c69-8330-5751f1e76bf5 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:23.065193 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999195d-06a1-4c69-8330-5751f1e76bf5 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:23.065291 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999195d-06a1-4c69-8330-5751f1e76bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:23.101136 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-7999195d-06a1-4c69-8330-5751f1e76bf5 None None] MFA Rules not processed for user `9d1c37218f6549c3ada02355e9fb9efe`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:23.102276 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-7999195d-06a1-4c69-8330-5751f1e76bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:23.175152 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1332/2631] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:23 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 02:01:23.179503 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75cd0d-2f16-43a2-9641-6884bea45805 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:23.247127 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75cd0d-2f16-43a2-9641-6884bea45805 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:23.251537 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d569b7-b80d-4018-a9e4-2cbe5c36b038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:23.252117 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d569b7-b80d-4018-a9e4-2cbe5c36b038 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:23.252405 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d569b7-b80d-4018-a9e4-2cbe5c36b038 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:23.252714 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d569b7-b80d-4018-a9e4-2cbe5c36b038 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:23.253351 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d569b7-b80d-4018-a9e4-2cbe5c36b038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:23.278845 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d569b7-b80d-4018-a9e4-2cbe5c36b038 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:23.359831 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1300/2632] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:01:23 2021] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:01:23.363947 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999195d-06a1-4c69-8330-5751f1e76bf5 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:23.374640 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999195d-06a1-4c69-8330-5751f1e76bf5 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:23.436969 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe751c12-3c40-48c9-a93d-72ee59b2ae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:23.437476 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe751c12-3c40-48c9-a93d-72ee59b2ae1d admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:23.437759 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe751c12-3c40-48c9-a93d-72ee59b2ae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:23.438150 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe751c12-3c40-48c9-a93d-72ee59b2ae1d admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:23.438794 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe751c12-3c40-48c9-a93d-72ee59b2ae1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:23.464579 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe751c12-3c40-48c9-a93d-72ee59b2ae1d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:23.530282 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1333/2633] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:01:23 2021] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:01:23.534288 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d569b7-b80d-4018-a9e4-2cbe5c36b038 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:23.544203 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d569b7-b80d-4018-a9e4-2cbe5c36b038 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:23.548582 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f827fb4-a4d0-420e-8e69-0c446d121e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:23.551918 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f827fb4-a4d0-420e-8e69-0c446d121e4f admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:23.551918 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f827fb4-a4d0-420e-8e69-0c446d121e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:23.551918 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f827fb4-a4d0-420e-8e69-0c446d121e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:23.551918 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f827fb4-a4d0-420e-8e69-0c446d121e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:23.576872 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f827fb4-a4d0-420e-8e69-0c446d121e4f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:23.595767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1301/2634] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:23 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 02:01:23.597304 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe751c12-3c40-48c9-a93d-72ee59b2ae1d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:23.607384 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe751c12-3c40-48c9-a93d-72ee59b2ae1d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:23.611603 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ece2e2-07b9-40c8-9979-9add4ab5059b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:23.612545 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ece2e2-07b9-40c8-9979-9add4ab5059b admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:23.612859 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ece2e2-07b9-40c8-9979-9add4ab5059b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:23.613138 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ece2e2-07b9-40c8-9979-9add4ab5059b admin admin] PATH_INFO: `/v3/projects/b9860e4cb5fa4568b8d4c5b76cac87ad/users/6c3d06cb83374d7c87da6e3fe4153737/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:23.632482 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ece2e2-07b9-40c8-9979-9add4ab5059b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9860e4cb5fa4568b8d4c5b76cac87ad, user_id=6c3d06cb83374d7c87da6e3fe4153737, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:23.660099 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ece2e2-07b9-40c8-9979-9add4ab5059b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:23.729648 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1334/2635] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:23 2021] PUT /identity/v3/projects/b9860e4cb5fa4568b8d4c5b76cac87ad/users/6c3d06cb83374d7c87da6e3fe4153737/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:23.740835 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00121b44-8009-4cc3-a622-abe496e3601e None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:23.741132 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00121b44-8009-4cc3-a622-abe496e3601e None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:23.741443 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00121b44-8009-4cc3-a622-abe496e3601e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:23.776157 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-00121b44-8009-4cc3-a622-abe496e3601e None None] MFA Rules not processed for user `6c3d06cb83374d7c87da6e3fe4153737`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:23.777327 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-00121b44-8009-4cc3-a622-abe496e3601e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:23.849688 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1302/2636] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:23 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:23.854219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ece2e2-07b9-40c8-9979-9add4ab5059b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:23.921166 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ece2e2-07b9-40c8-9979-9add4ab5059b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:23.925429 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f5bb8-7370-4842-85f0-9f6d861684cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:23.926298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f5bb8-7370-4842-85f0-9f6d861684cf admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:23.926587 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f5bb8-7370-4842-85f0-9f6d861684cf admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:23.926870 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f5bb8-7370-4842-85f0-9f6d861684cf admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:23.927494 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f5bb8-7370-4842-85f0-9f6d861684cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:23.954050 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f5bb8-7370-4842-85f0-9f6d861684cf admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:24.199251 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1335/2637] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:01:23 2021] POST /identity/v3/projects => generated 385 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:01:24.203945 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00121b44-8009-4cc3-a622-abe496e3601e None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:24.215162 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00121b44-8009-4cc3-a622-abe496e3601e None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:24.278506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b8728-8f54-40a4-af69-aad35565ccf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:24.278506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b8728-8f54-40a4-af69-aad35565ccf6 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:24.278506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b8728-8f54-40a4-af69-aad35565ccf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:24.278506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b8728-8f54-40a4-af69-aad35565ccf6 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:24.279398 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b8728-8f54-40a4-af69-aad35565ccf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:24.305333 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b8728-8f54-40a4-af69-aad35565ccf6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:24.474256 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1303/2638] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:01:24 2021] POST /identity/v3/users => generated 299 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:01:24.474458 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f5bb8-7370-4842-85f0-9f6d861684cf admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:24.480583 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f5bb8-7370-4842-85f0-9f6d861684cf admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:24.485161 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d0699-97ea-4de1-b358-a66eba32761f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:24.485740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d0699-97ea-4de1-b358-a66eba32761f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:24.486027 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d0699-97ea-4de1-b358-a66eba32761f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:24.486307 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d0699-97ea-4de1-b358-a66eba32761f admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:24.486989 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d0699-97ea-4de1-b358-a66eba32761f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:24.512825 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d0699-97ea-4de1-b358-a66eba32761f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:24.523637 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1336/2639] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:24 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:24.527828 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b8728-8f54-40a4-af69-aad35565ccf6 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:24.537107 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b8728-8f54-40a4-af69-aad35565ccf6 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:24.541615 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee9edb-0736-4c3f-881c-4867a3fc52a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:24.542477 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee9edb-0736-4c3f-881c-4867a3fc52a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:24.542753 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee9edb-0736-4c3f-881c-4867a3fc52a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:24.543029 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee9edb-0736-4c3f-881c-4867a3fc52a2 admin admin] PATH_INFO: `/v3/projects/20a18989a7794534b3c03102ae9c2695/users/7feb486639884ea18bdb33d1e2cc95b6/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:24.563370 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee9edb-0736-4c3f-881c-4867a3fc52a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a18989a7794534b3c03102ae9c2695, user_id=7feb486639884ea18bdb33d1e2cc95b6, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:24.589406 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee9edb-0736-4c3f-881c-4867a3fc52a2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:24.684761 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1304/2640] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:24 2021] PUT /identity/v3/projects/20a18989a7794534b3c03102ae9c2695/users/7feb486639884ea18bdb33d1e2cc95b6/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:24.688976 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d0699-97ea-4de1-b358-a66eba32761f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:24.698576 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d0699-97ea-4de1-b358-a66eba32761f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:24.761454 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d7cf2-8379-4d89-8369-424aba88ce23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:24.762070 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d7cf2-8379-4d89-8369-424aba88ce23 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:24.762344 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d7cf2-8379-4d89-8369-424aba88ce23 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:24.762619 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d7cf2-8379-4d89-8369-424aba88ce23 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:24.763697 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d7cf2-8379-4d89-8369-424aba88ce23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:24.789545 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d7cf2-8379-4d89-8369-424aba88ce23 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:24.800318 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1337/2641] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:24 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:24.804801 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee9edb-0736-4c3f-881c-4867a3fc52a2 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:24.814786 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee9edb-0736-4c3f-881c-4867a3fc52a2 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:24.819062 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116341e9-02af-4379-9ae2-962fd4a9b555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:24.819934 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116341e9-02af-4379-9ae2-962fd4a9b555 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:24.820220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116341e9-02af-4379-9ae2-962fd4a9b555 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:24.820502 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116341e9-02af-4379-9ae2-962fd4a9b555 admin admin] PATH_INFO: `/v3/projects/20a18989a7794534b3c03102ae9c2695/users/7feb486639884ea18bdb33d1e2cc95b6/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:24.822432 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116341e9-02af-4379-9ae2-962fd4a9b555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a18989a7794534b3c03102ae9c2695, user_id=7feb486639884ea18bdb33d1e2cc95b6, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:24.849210 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116341e9-02af-4379-9ae2-962fd4a9b555 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:24.859617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1305/2642] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:24 2021] PUT /identity/v3/projects/20a18989a7794534b3c03102ae9c2695/users/7feb486639884ea18bdb33d1e2cc95b6/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:24.863469 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d7cf2-8379-4d89-8369-424aba88ce23 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:24.872867 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d7cf2-8379-4d89-8369-424aba88ce23 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:24.934744 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701f4cb-0c6d-4493-b9f8-57e620071d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:24.935339 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701f4cb-0c6d-4493-b9f8-57e620071d68 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:24.935627 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701f4cb-0c6d-4493-b9f8-57e620071d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:24.935904 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701f4cb-0c6d-4493-b9f8-57e620071d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:24.936604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701f4cb-0c6d-4493-b9f8-57e620071d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:24.961623 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701f4cb-0c6d-4493-b9f8-57e620071d68 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:24.972158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1338/2643] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:24 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 02:01:24.976401 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116341e9-02af-4379-9ae2-962fd4a9b555 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:24.986927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116341e9-02af-4379-9ae2-962fd4a9b555 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:24.990945 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c372bd-84f6-41e6-b83f-b882e914dbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:24.991763 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c372bd-84f6-41e6-b83f-b882e914dbbb admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:24.992050 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c372bd-84f6-41e6-b83f-b882e914dbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:24.992325 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c372bd-84f6-41e6-b83f-b882e914dbbb admin admin] PATH_INFO: `/v3/projects/20a18989a7794534b3c03102ae9c2695/users/7feb486639884ea18bdb33d1e2cc95b6/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:24.994098 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c372bd-84f6-41e6-b83f-b882e914dbbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a18989a7794534b3c03102ae9c2695, user_id=7feb486639884ea18bdb33d1e2cc95b6, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:25.020686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c372bd-84f6-41e6-b83f-b882e914dbbb admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:25.097948 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1306/2644] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:24 2021] PUT /identity/v3/projects/20a18989a7794534b3c03102ae9c2695/users/7feb486639884ea18bdb33d1e2cc95b6/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:25.108201 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4c819-4a0f-49c2-bf16-336dd9b5ac4d None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:25.108499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4c819-4a0f-49c2-bf16-336dd9b5ac4d None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:25.108811 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4c819-4a0f-49c2-bf16-336dd9b5ac4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:25.146971 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-a1f4c819-4a0f-49c2-bf16-336dd9b5ac4d None None] MFA Rules not processed for user `7feb486639884ea18bdb33d1e2cc95b6`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:25.148104 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-a1f4c819-4a0f-49c2-bf16-336dd9b5ac4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:25.221979 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1339/2645] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:25 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:25.231250 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c372bd-84f6-41e6-b83f-b882e914dbbb admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:25.232902 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-b8c372bd-84f6-41e6-b83f-b882e914dbbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:25.297396 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c372bd-84f6-41e6-b83f-b882e914dbbb admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:25.301102 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062864e-0301-46a8-bc01-4ab67309d117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:25.301671 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062864e-0301-46a8-bc01-4ab67309d117 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:25.301958 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062864e-0301-46a8-bc01-4ab67309d117 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:25.302238 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062864e-0301-46a8-bc01-4ab67309d117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:25.311380 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062864e-0301-46a8-bc01-4ab67309d117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:25.336783 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062864e-0301-46a8-bc01-4ab67309d117 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:25.347520 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1307/2646] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:25 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:01:26.650817 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4c819-4a0f-49c2-bf16-336dd9b5ac4d None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:26.652178 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-a1f4c819-4a0f-49c2-bf16-336dd9b5ac4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:26.663380 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4c819-4a0f-49c2-bf16-336dd9b5ac4d None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:26.666633 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b15e7-b1c1-4a61-9a4e-e89b2cac8490 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:26.667197 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b15e7-b1c1-4a61-9a4e-e89b2cac8490 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:26.667480 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b15e7-b1c1-4a61-9a4e-e89b2cac8490 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:26.667755 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b15e7-b1c1-4a61-9a4e-e89b2cac8490 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:26.733155 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b15e7-b1c1-4a61-9a4e-e89b2cac8490 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:26.758520 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b15e7-b1c1-4a61-9a4e-e89b2cac8490 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:26.767183 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1340/2647] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:26 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:01:31.114971 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062864e-0301-46a8-bc01-4ab67309d117 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:31.116398 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4062864e-0301-46a8-bc01-4ab67309d117 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:31.193220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062864e-0301-46a8-bc01-4ab67309d117 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:31.193220 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251334f-861c-49c9-889a-9252b70b2d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:31.193443 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251334f-861c-49c9-889a-9252b70b2d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:31.193624 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251334f-861c-49c9-889a-9252b70b2d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:31.193899 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251334f-861c-49c9-889a-9252b70b2d01 admin admin] PATH_INFO: `/v3/users/f2ca98ee41a6462c81eba906e6e15996` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:31.194975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251334f-861c-49c9-889a-9252b70b2d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ca98ee41a6462c81eba906e6e15996)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:31.222188 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251334f-861c-49c9-889a-9252b70b2d01 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:31.549107 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6251334f-861c-49c9-889a-9252b70b2d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ca98ee41a6462c81eba906e6e15996'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:31.632642 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6251334f-861c-49c9-889a-9252b70b2d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ca98ee41a6462c81eba906e6e15996'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:31.633178 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6251334f-861c-49c9-889a-9252b70b2d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ca98ee41a6462c81eba906e6e15996'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:31.642059 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6251334f-861c-49c9-889a-9252b70b2d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ca98ee41a6462c81eba906e6e15996'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:31.642679 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-6251334f-861c-49c9-889a-9252b70b2d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ca98ee41a6462c81eba906e6e15996'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:31.659368 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1308/2648] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:01:31 2021] DELETE /identity/v3/users/f2ca98ee41a6462c81eba906e6e15996 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:31.663940 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7808b69-2187-47c4-9025-e1cc71f148ca None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:31.664488 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7808b69-2187-47c4-9025-e1cc71f148ca None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:31.664488 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7808b69-2187-47c4-9025-e1cc71f148ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:31.686765 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-e7808b69-2187-47c4-9025-e1cc71f148ca None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:31.687923 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e7808b69-2187-47c4-9025-e1cc71f148ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:31.751131 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1341/2649] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:31.761062 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251334f-861c-49c9-889a-9252b70b2d01 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:31.762454 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-6251334f-861c-49c9-889a-9252b70b2d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:31.826433 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251334f-861c-49c9-889a-9252b70b2d01 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:31.829759 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f03d1-4850-4149-b776-42818f28663f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:31.830326 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f03d1-4850-4149-b776-42818f28663f service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:31.830611 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f03d1-4850-4149-b776-42818f28663f service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:31.830930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f03d1-4850-4149-b776-42818f28663f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:31.839633 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f03d1-4850-4149-b776-42818f28663f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:31.864932 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f03d1-4850-4149-b776-42818f28663f service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:31.874381 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1309/2650] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:01:32.361666 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7808b69-2187-47c4-9025-e1cc71f148ca None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:32.363019 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e7808b69-2187-47c4-9025-e1cc71f148ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:32.375490 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f03d1-4850-4149-b776-42818f28663f service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:32.377563 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-fb3f03d1-4850-4149-b776-42818f28663f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:32.397449 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f03d1-4850-4149-b776-42818f28663f service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:32.403145 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14214fe-453c-4dbb-a2a8-00e504434320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:32.442529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14214fe-453c-4dbb-a2a8-00e504434320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:32.442529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14214fe-453c-4dbb-a2a8-00e504434320 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:32.442529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14214fe-453c-4dbb-a2a8-00e504434320 admin admin] PATH_INFO: `/v3/projects/a85c4108c05f4cf0b7548a316bf6aaa5` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:32.442529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14214fe-453c-4dbb-a2a8-00e504434320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a85c4108c05f4cf0b7548a316bf6aaa5)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:32.442529 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14214fe-453c-4dbb-a2a8-00e504434320 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:32.443992 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7808b69-2187-47c4-9025-e1cc71f148ca None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:32.443992 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc234140-6bbd-415b-ac6e-d32ee1ae7168 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:32.443992 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc234140-6bbd-415b-ac6e-d32ee1ae7168 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:32.443992 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc234140-6bbd-415b-ac6e-d32ee1ae7168 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:32.444710 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc234140-6bbd-415b-ac6e-d32ee1ae7168 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:32.444710 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-bc234140-6bbd-415b-ac6e-d32ee1ae7168 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:32.510110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc234140-6bbd-415b-ac6e-d32ee1ae7168 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:32.536430 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc234140-6bbd-415b-ac6e-d32ee1ae7168 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:32.544905 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1342/2651] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:32 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:01:32.640358 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f14214fe-453c-4dbb-a2a8-00e504434320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a85c4108c05f4cf0b7548a316bf6aaa5', 'request_id': 'req-f14214fe-453c-4dbb-a2a8-00e504434320'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:32.645438 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f14214fe-453c-4dbb-a2a8-00e504434320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a85c4108c05f4cf0b7548a316bf6aaa5', 'request_id': 'req-f14214fe-453c-4dbb-a2a8-00e504434320'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:32.657829 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f14214fe-453c-4dbb-a2a8-00e504434320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a85c4108c05f4cf0b7548a316bf6aaa5', 'request_id': 'req-f14214fe-453c-4dbb-a2a8-00e504434320'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:32.751221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f14214fe-453c-4dbb-a2a8-00e504434320 admin admin] The token cache is being invalidate because project a85c4108c05f4cf0b7548a316bf6aaa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:01:32.751505 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f14214fe-453c-4dbb-a2a8-00e504434320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:32.752099 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f14214fe-453c-4dbb-a2a8-00e504434320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:32.753525 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1310/2652] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:01:32 2021] DELETE /identity/v3/projects/a85c4108c05f4cf0b7548a316bf6aaa5 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:32.761450 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9428f9a-4e8f-452c-9679-af46cc258a20 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:32.761963 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9428f9a-4e8f-452c-9679-af46cc258a20 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:32.762992 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9428f9a-4e8f-452c-9679-af46cc258a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:32.785989 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-c9428f9a-4e8f-452c-9679-af46cc258a20 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:32.787253 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c9428f9a-4e8f-452c-9679-af46cc258a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:32.852413 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1343/2653] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 02:01:32.859881 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa241d06-6a55-4b3f-9221-eb252c93ff95 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:32.860178 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa241d06-6a55-4b3f-9221-eb252c93ff95 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:32.860462 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa241d06-6a55-4b3f-9221-eb252c93ff95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:32.882771 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-aa241d06-6a55-4b3f-9221-eb252c93ff95 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:32.883949 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-aa241d06-6a55-4b3f-9221-eb252c93ff95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:32.891328 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1311/2654] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:32.895554 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9428f9a-4e8f-452c-9679-af46cc258a20 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:32.905848 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9428f9a-4e8f-452c-9679-af46cc258a20 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:32.910344 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6802d4-f8af-43ca-9eab-38c6142feea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:32.910970 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6802d4-f8af-43ca-9eab-38c6142feea1 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:32.911394 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6802d4-f8af-43ca-9eab-38c6142feea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:32.911886 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6802d4-f8af-43ca-9eab-38c6142feea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:32.912618 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6802d4-f8af-43ca-9eab-38c6142feea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 02:01:32.912917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6802d4-f8af-43ca-9eab-38c6142feea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:32.939148 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6802d4-f8af-43ca-9eab-38c6142feea1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:32.953451 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1344/2655] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 02:01:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 02:01:32.957985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa241d06-6a55-4b3f-9221-eb252c93ff95 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:32.966725 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa241d06-6a55-4b3f-9221-eb252c93ff95 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:32.971330 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03080a51-fb29-47e8-be23-91bdac44c64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:32.972234 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03080a51-fb29-47e8-be23-91bdac44c64e admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:32.972234 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03080a51-fb29-47e8-be23-91bdac44c64e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:32.972446 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03080a51-fb29-47e8-be23-91bdac44c64e admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:32.973109 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03080a51-fb29-47e8-be23-91bdac44c64e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:32.998198 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03080a51-fb29-47e8-be23-91bdac44c64e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:33.091194 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1312/2656] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:01:32 2021] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:01:33.095275 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6802d4-f8af-43ca-9eab-38c6142feea1 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:33.105061 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6802d4-f8af-43ca-9eab-38c6142feea1 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:33.166128 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9eb05-87ba-44f9-8be4-be2ee20cb1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:33.166727 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9eb05-87ba-44f9-8be4-be2ee20cb1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:33.167017 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9eb05-87ba-44f9-8be4-be2ee20cb1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:33.167297 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9eb05-87ba-44f9-8be4-be2ee20cb1f8 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:33.167935 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9eb05-87ba-44f9-8be4-be2ee20cb1f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:33.194403 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9eb05-87ba-44f9-8be4-be2ee20cb1f8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:33.290443 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1345/2657] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:01:33 2021] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:01:33.294544 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03080a51-fb29-47e8-be23-91bdac44c64e admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:33.305102 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03080a51-fb29-47e8-be23-91bdac44c64e admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:33.309261 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b403b3c-2402-48c5-adae-ebc631a9a280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:33.309826 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b403b3c-2402-48c5-adae-ebc631a9a280 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:33.310112 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b403b3c-2402-48c5-adae-ebc631a9a280 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:33.310390 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b403b3c-2402-48c5-adae-ebc631a9a280 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:33.311131 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b403b3c-2402-48c5-adae-ebc631a9a280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:33.336620 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b403b3c-2402-48c5-adae-ebc631a9a280 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:33.346545 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1313/2658] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:33 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:33.350554 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9eb05-87ba-44f9-8be4-be2ee20cb1f8 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:33.360457 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9eb05-87ba-44f9-8be4-be2ee20cb1f8 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:33.365035 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64819fcb-e801-432c-abcb-b70eefbf271d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:33.365876 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64819fcb-e801-432c-abcb-b70eefbf271d admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:33.366213 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64819fcb-e801-432c-abcb-b70eefbf271d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:33.366497 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64819fcb-e801-432c-abcb-b70eefbf271d admin admin] PATH_INFO: `/v3/projects/ba20ee0dab434973abcdb6e3cf80a34a/users/b585e7c0e87246669424cc9dad992e65/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:33.386901 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64819fcb-e801-432c-abcb-b70eefbf271d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba20ee0dab434973abcdb6e3cf80a34a, user_id=b585e7c0e87246669424cc9dad992e65, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:33.413879 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64819fcb-e801-432c-abcb-b70eefbf271d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:33.484520 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1346/2659] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:33 2021] PUT /identity/v3/projects/ba20ee0dab434973abcdb6e3cf80a34a/users/b585e7c0e87246669424cc9dad992e65/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:33.489417 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5645-e8ee-40b0-85a4-a38f22d6e5a2 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:33.489870 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5645-e8ee-40b0-85a4-a38f22d6e5a2 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:33.489989 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5645-e8ee-40b0-85a4-a38f22d6e5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:33.513097 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-1eee5645-e8ee-40b0-85a4-a38f22d6e5a2 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:33.514215 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1eee5645-e8ee-40b0-85a4-a38f22d6e5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:33.578076 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1314/2660] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:33.588480 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64819fcb-e801-432c-abcb-b70eefbf271d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:33.590167 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-64819fcb-e801-432c-abcb-b70eefbf271d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:33.654807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64819fcb-e801-432c-abcb-b70eefbf271d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:33.658652 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251461e-fe0a-45e2-b511-dfd5e12ce364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:33.659333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251461e-fe0a-45e2-b511-dfd5e12ce364 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:33.659610 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251461e-fe0a-45e2-b511-dfd5e12ce364 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:33.659884 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251461e-fe0a-45e2-b511-dfd5e12ce364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:33.668636 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251461e-fe0a-45e2-b511-dfd5e12ce364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:33.694623 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251461e-fe0a-45e2-b511-dfd5e12ce364 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:33.703496 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1347/2661] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 02:01:38.491126 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee5645-e8ee-40b0-85a4-a38f22d6e5a2 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:38.492968 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1eee5645-e8ee-40b0-85a4-a38f22d6e5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:38.504152 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee5645-e8ee-40b0-85a4-a38f22d6e5a2 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:38.508462 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b8a34-e85e-43a7-a8ea-41198c29f079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:38.509369 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b8a34-e85e-43a7-a8ea-41198c29f079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:38.509656 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b8a34-e85e-43a7-a8ea-41198c29f079 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:38.509934 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b8a34-e85e-43a7-a8ea-41198c29f079 admin admin] PATH_INFO: `/v3/users/9d1c37218f6549c3ada02355e9fb9efe` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:38.511008 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b8a34-e85e-43a7-a8ea-41198c29f079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d1c37218f6549c3ada02355e9fb9efe)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:38.538132 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b8a34-e85e-43a7-a8ea-41198c29f079 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:38.749711 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-166b8a34-e85e-43a7-a8ea-41198c29f079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d1c37218f6549c3ada02355e9fb9efe'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:38.815262 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-166b8a34-e85e-43a7-a8ea-41198c29f079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d1c37218f6549c3ada02355e9fb9efe'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:38.815965 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-166b8a34-e85e-43a7-a8ea-41198c29f079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d1c37218f6549c3ada02355e9fb9efe'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:38.824193 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-166b8a34-e85e-43a7-a8ea-41198c29f079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d1c37218f6549c3ada02355e9fb9efe'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:38.824881 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-166b8a34-e85e-43a7-a8ea-41198c29f079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d1c37218f6549c3ada02355e9fb9efe'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:38.849961 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1315/2662] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:01:38 2021] DELETE /identity/v3/users/9d1c37218f6549c3ada02355e9fb9efe => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:38.854513 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbf066-7c7a-404b-8abb-4f117b1fcbef None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:38.855016 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbf066-7c7a-404b-8abb-4f117b1fcbef None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:38.855105 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbf066-7c7a-404b-8abb-4f117b1fcbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:38.884920 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-7edbf066-7c7a-404b-8abb-4f117b1fcbef None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:38.886392 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-7edbf066-7c7a-404b-8abb-4f117b1fcbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:38.993683 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1348/2663] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:39.005998 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b8a34-e85e-43a7-a8ea-41198c29f079 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:39.009461 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-166b8a34-e85e-43a7-a8ea-41198c29f079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:39.088934 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b8a34-e85e-43a7-a8ea-41198c29f079 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:39.092968 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6155d-179e-42ed-a14a-e66b4c50fb7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:39.098302 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6155d-179e-42ed-a14a-e66b4c50fb7b service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:39.098302 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6155d-179e-42ed-a14a-e66b4c50fb7b service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:39.098302 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6155d-179e-42ed-a14a-e66b4c50fb7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:39.105533 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6155d-179e-42ed-a14a-e66b4c50fb7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:39.133110 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6155d-179e-42ed-a14a-e66b4c50fb7b service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:39.143955 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1316/2664] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:01:39.798742 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbf066-7c7a-404b-8abb-4f117b1fcbef None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:39.800179 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-7edbf066-7c7a-404b-8abb-4f117b1fcbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:39.825162 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbf066-7c7a-404b-8abb-4f117b1fcbef None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:39.848994 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ddbc9-3cf8-40ca-b7a1-d9953ba79fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:39.849883 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ddbc9-3cf8-40ca-b7a1-d9953ba79fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:39.850184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ddbc9-3cf8-40ca-b7a1-d9953ba79fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:39.850349 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ddbc9-3cf8-40ca-b7a1-d9953ba79fe1 admin admin] PATH_INFO: `/v3/projects/9d0db0e2722647ec802ea73002427ec0` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:39.851453 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ddbc9-3cf8-40ca-b7a1-d9953ba79fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d0db0e2722647ec802ea73002427ec0)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:39.890838 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ddbc9-3cf8-40ca-b7a1-d9953ba79fe1 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:39.995155 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ae2ddbc9-3cf8-40ca-b7a1-d9953ba79fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d0db0e2722647ec802ea73002427ec0', 'request_id': 'req-ae2ddbc9-3cf8-40ca-b7a1-d9953ba79fe1'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:40.001298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ae2ddbc9-3cf8-40ca-b7a1-d9953ba79fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d0db0e2722647ec802ea73002427ec0', 'request_id': 'req-ae2ddbc9-3cf8-40ca-b7a1-d9953ba79fe1'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:40.013611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ae2ddbc9-3cf8-40ca-b7a1-d9953ba79fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d0db0e2722647ec802ea73002427ec0', 'request_id': 'req-ae2ddbc9-3cf8-40ca-b7a1-d9953ba79fe1'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:40.095851 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ae2ddbc9-3cf8-40ca-b7a1-d9953ba79fe1 admin admin] The token cache is being invalidate because project 9d0db0e2722647ec802ea73002427ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:01:40.096390 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ae2ddbc9-3cf8-40ca-b7a1-d9953ba79fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:40.097061 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ae2ddbc9-3cf8-40ca-b7a1-d9953ba79fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:40.098861 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1349/2665] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:01:39 2021] DELETE /identity/v3/projects/9d0db0e2722647ec802ea73002427ec0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:40.103906 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6155d-179e-42ed-a14a-e66b4c50fb7b service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:40.114506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6155d-179e-42ed-a14a-e66b4c50fb7b service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:40.187268 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2823b-e36f-4e2f-aece-757bbd1ef71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:40.188106 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2823b-e36f-4e2f-aece-757bbd1ef71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:40.188659 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2823b-e36f-4e2f-aece-757bbd1ef71e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:40.189129 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2823b-e36f-4e2f-aece-757bbd1ef71e admin admin] PATH_INFO: `/v3/users/6c3d06cb83374d7c87da6e3fe4153737` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:40.191208 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2823b-e36f-4e2f-aece-757bbd1ef71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c3d06cb83374d7c87da6e3fe4153737)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:40.221399 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2823b-e36f-4e2f-aece-757bbd1ef71e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:40.231514 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e0ac7-0c49-46d0-aa1e-c1733446a748 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:40.231814 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e0ac7-0c49-46d0-aa1e-c1733446a748 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:40.235666 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e0ac7-0c49-46d0-aa1e-c1733446a748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:40.271656 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-fd8e0ac7-0c49-46d0-aa1e-c1733446a748 None None] MFA Rules not processed for user `b585e7c0e87246669424cc9dad992e65`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:40.271656 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-fd8e0ac7-0c49-46d0-aa1e-c1733446a748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:40.365472 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1350/2666] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:40 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:40.367501 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e0ac7-0c49-46d0-aa1e-c1733446a748 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:40.369756 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-fd8e0ac7-0c49-46d0-aa1e-c1733446a748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:40.387818 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e0ac7-0c49-46d0-aa1e-c1733446a748 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:40.392764 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46c289-2f90-4667-977d-90cb9c8ed1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:40.393358 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46c289-2f90-4667-977d-90cb9c8ed1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:40.393653 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46c289-2f90-4667-977d-90cb9c8ed1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:40.393937 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46c289-2f90-4667-977d-90cb9c8ed1d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:40.394746 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46c289-2f90-4667-977d-90cb9c8ed1d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:40.424693 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46c289-2f90-4667-977d-90cb9c8ed1d7 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:40.436728 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0ee2823b-e36f-4e2f-aece-757bbd1ef71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3d06cb83374d7c87da6e3fe4153737'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:40.501290 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0ee2823b-e36f-4e2f-aece-757bbd1ef71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3d06cb83374d7c87da6e3fe4153737'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:40.501881 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0ee2823b-e36f-4e2f-aece-757bbd1ef71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3d06cb83374d7c87da6e3fe4153737'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:40.511223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0ee2823b-e36f-4e2f-aece-757bbd1ef71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3d06cb83374d7c87da6e3fe4153737'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:40.511223 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-0ee2823b-e36f-4e2f-aece-757bbd1ef71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3d06cb83374d7c87da6e3fe4153737'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:40.528296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1317/2667] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:01:40 2021] DELETE /identity/v3/users/6c3d06cb83374d7c87da6e3fe4153737 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:40.539961 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1351/2668] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:01:40 2021] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:01:40.544066 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2823b-e36f-4e2f-aece-757bbd1ef71e admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:40.546079 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-0ee2823b-e36f-4e2f-aece-757bbd1ef71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:40.619801 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2823b-e36f-4e2f-aece-757bbd1ef71e admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:40.689080 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd72827-fe85-4d0d-9a52-31ee9d9542b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:40.689688 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd72827-fe85-4d0d-9a52-31ee9d9542b2 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:40.689971 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd72827-fe85-4d0d-9a52-31ee9d9542b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:40.690249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd72827-fe85-4d0d-9a52-31ee9d9542b2 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:40.690878 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd72827-fe85-4d0d-9a52-31ee9d9542b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:40.717909 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd72827-fe85-4d0d-9a52-31ee9d9542b2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:40.781991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1318/2669] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:01:40 2021] POST /identity/v3/users => generated 292 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:01:40.782904 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46c289-2f90-4667-977d-90cb9c8ed1d7 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:40.793936 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46c289-2f90-4667-977d-90cb9c8ed1d7 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:40.798962 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5d452-2ee9-4f06-adde-4e4451d33f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:40.799699 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5d452-2ee9-4f06-adde-4e4451d33f50 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:40.799995 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5d452-2ee9-4f06-adde-4e4451d33f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:40.800278 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5d452-2ee9-4f06-adde-4e4451d33f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:40.801281 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5d452-2ee9-4f06-adde-4e4451d33f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:40.827990 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5d452-2ee9-4f06-adde-4e4451d33f50 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:40.844058 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1352/2670] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:40 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:40.845572 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd72827-fe85-4d0d-9a52-31ee9d9542b2 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:40.866277 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd72827-fe85-4d0d-9a52-31ee9d9542b2 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:40.878881 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb5d15-83b9-41cd-b43e-2488a36f703d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:40.879721 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb5d15-83b9-41cd-b43e-2488a36f703d admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:40.880010 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb5d15-83b9-41cd-b43e-2488a36f703d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:40.880295 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb5d15-83b9-41cd-b43e-2488a36f703d admin admin] PATH_INFO: `/v3/projects/43a820182dcb47b09cc7c3cb5985a1ca/users/d7d032177d69477da40ee36f03ae2857/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:40.901385 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb5d15-83b9-41cd-b43e-2488a36f703d admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a820182dcb47b09cc7c3cb5985a1ca, user_id=d7d032177d69477da40ee36f03ae2857, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:40.929491 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb5d15-83b9-41cd-b43e-2488a36f703d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:40.992994 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1319/2671] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:40 2021] PUT /identity/v3/projects/43a820182dcb47b09cc7c3cb5985a1ca/users/d7d032177d69477da40ee36f03ae2857/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:40.996843 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5d452-2ee9-4f06-adde-4e4451d33f50 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:41.006885 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5d452-2ee9-4f06-adde-4e4451d33f50 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:41.038100 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb5d15-83b9-41cd-b43e-2488a36f703d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:41.039873 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-16eb5d15-83b9-41cd-b43e-2488a36f703d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:41.085981 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6b7a1-f3aa-47e0-826d-b9786ecd806d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:41.086679 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6b7a1-f3aa-47e0-826d-b9786ecd806d admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:41.087037 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6b7a1-f3aa-47e0-826d-b9786ecd806d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:41.087330 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6b7a1-f3aa-47e0-826d-b9786ecd806d admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:41.088020 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6b7a1-f3aa-47e0-826d-b9786ecd806d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:41.113803 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb5d15-83b9-41cd-b43e-2488a36f703d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:41.114300 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6b7a1-f3aa-47e0-826d-b9786ecd806d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:41.118369 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fff0f-fc91-4288-bc7d-e96acd02683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:41.121546 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fff0f-fc91-4288-bc7d-e96acd02683a admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:41.121546 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fff0f-fc91-4288-bc7d-e96acd02683a admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:41.121546 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fff0f-fc91-4288-bc7d-e96acd02683a admin admin] PATH_INFO: `/v3/projects/b9860e4cb5fa4568b8d4c5b76cac87ad` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:41.121546 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194fff0f-fc91-4288-bc7d-e96acd02683a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9860e4cb5fa4568b8d4c5b76cac87ad)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:41.125192 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1353/2672] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:40 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:41.129274 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6b7a1-f3aa-47e0-826d-b9786ecd806d admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:41.138417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6b7a1-f3aa-47e0-826d-b9786ecd806d admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:41.143564 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e8aab-686c-4dbf-b8fc-c81659e125ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:41.144360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e8aab-686c-4dbf-b8fc-c81659e125ff admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:41.144666 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e8aab-686c-4dbf-b8fc-c81659e125ff admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:41.144949 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e8aab-686c-4dbf-b8fc-c81659e125ff admin admin] PATH_INFO: `/v3/projects/43a820182dcb47b09cc7c3cb5985a1ca/users/d7d032177d69477da40ee36f03ae2857/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:41.146662 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e8aab-686c-4dbf-b8fc-c81659e125ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a820182dcb47b09cc7c3cb5985a1ca, user_id=d7d032177d69477da40ee36f03ae2857, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:41.147846 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194fff0f-fc91-4288-bc7d-e96acd02683a admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:41.172781 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e8aab-686c-4dbf-b8fc-c81659e125ff admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:41.183105 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1354/2673] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:41 2021] PUT /identity/v3/projects/43a820182dcb47b09cc7c3cb5985a1ca/users/d7d032177d69477da40ee36f03ae2857/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:41.188934 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e8aab-686c-4dbf-b8fc-c81659e125ff admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:41.256176 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-194fff0f-fc91-4288-bc7d-e96acd02683a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9860e4cb5fa4568b8d4c5b76cac87ad', 'request_id': 'req-194fff0f-fc91-4288-bc7d-e96acd02683a'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:41.257504 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e8aab-686c-4dbf-b8fc-c81659e125ff admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:41.261177 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-194fff0f-fc91-4288-bc7d-e96acd02683a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9860e4cb5fa4568b8d4c5b76cac87ad', 'request_id': 'req-194fff0f-fc91-4288-bc7d-e96acd02683a'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:41.273251 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-194fff0f-fc91-4288-bc7d-e96acd02683a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9860e4cb5fa4568b8d4c5b76cac87ad', 'request_id': 'req-194fff0f-fc91-4288-bc7d-e96acd02683a'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:41.318377 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61736c-84de-4afb-8830-c6b3534b48cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:41.318976 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61736c-84de-4afb-8830-c6b3534b48cb admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:41.319263 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61736c-84de-4afb-8830-c6b3534b48cb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:41.319544 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61736c-84de-4afb-8830-c6b3534b48cb admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:41.320257 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61736c-84de-4afb-8830-c6b3534b48cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:41.346040 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61736c-84de-4afb-8830-c6b3534b48cb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:41.356950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1355/2674] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:41 2021] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 02:01:41.360807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61736c-84de-4afb-8830-c6b3534b48cb admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:41.364073 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-194fff0f-fc91-4288-bc7d-e96acd02683a admin admin] The token cache is being invalidate because project b9860e4cb5fa4568b8d4c5b76cac87ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:01:41.364357 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-194fff0f-fc91-4288-bc7d-e96acd02683a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:41.365003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-194fff0f-fc91-4288-bc7d-e96acd02683a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:41.366447 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1320/2675] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:01:41 2021] DELETE /identity/v3/projects/b9860e4cb5fa4568b8d4c5b76cac87ad => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:41.370356 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fff0f-fc91-4288-bc7d-e96acd02683a admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:41.370550 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61736c-84de-4afb-8830-c6b3534b48cb admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:41.372181 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-194fff0f-fc91-4288-bc7d-e96acd02683a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:41.375723 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee59a0-5554-47a7-a15b-d3896e92d274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:41.376549 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee59a0-5554-47a7-a15b-d3896e92d274 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:41.376865 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee59a0-5554-47a7-a15b-d3896e92d274 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:41.377168 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee59a0-5554-47a7-a15b-d3896e92d274 admin admin] PATH_INFO: `/v3/projects/43a820182dcb47b09cc7c3cb5985a1ca/users/d7d032177d69477da40ee36f03ae2857/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:41.378926 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee59a0-5554-47a7-a15b-d3896e92d274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a820182dcb47b09cc7c3cb5985a1ca, user_id=d7d032177d69477da40ee36f03ae2857, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:41.385214 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fff0f-fc91-4288-bc7d-e96acd02683a admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:41.390100 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a6a9c-48f3-4d37-95a4-5efb003dacea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:41.392991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a6a9c-48f3-4d37-95a4-5efb003dacea admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:41.392991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a6a9c-48f3-4d37-95a4-5efb003dacea admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:41.392991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a6a9c-48f3-4d37-95a4-5efb003dacea admin admin] PATH_INFO: `/v3/users/7feb486639884ea18bdb33d1e2cc95b6` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:41.395135 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a6a9c-48f3-4d37-95a4-5efb003dacea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7feb486639884ea18bdb33d1e2cc95b6)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:41.405877 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee59a0-5554-47a7-a15b-d3896e92d274 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:41.423419 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a6a9c-48f3-4d37-95a4-5efb003dacea admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:41.478286 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1356/2676] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:41 2021] PUT /identity/v3/projects/43a820182dcb47b09cc7c3cb5985a1ca/users/d7d032177d69477da40ee36f03ae2857/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:41.605085 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f28a6a9c-48f3-4d37-95a4-5efb003dacea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7feb486639884ea18bdb33d1e2cc95b6'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:41.677702 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f28a6a9c-48f3-4d37-95a4-5efb003dacea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7feb486639884ea18bdb33d1e2cc95b6'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:41.678281 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f28a6a9c-48f3-4d37-95a4-5efb003dacea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7feb486639884ea18bdb33d1e2cc95b6'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:41.687096 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f28a6a9c-48f3-4d37-95a4-5efb003dacea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7feb486639884ea18bdb33d1e2cc95b6'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:41.687706 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-f28a6a9c-48f3-4d37-95a4-5efb003dacea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7feb486639884ea18bdb33d1e2cc95b6'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:41.705469 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1321/2677] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:01:41 2021] DELETE /identity/v3/users/7feb486639884ea18bdb33d1e2cc95b6 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:42.483299 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee59a0-5554-47a7-a15b-d3896e92d274 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:42.485483 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-97ee59a0-5554-47a7-a15b-d3896e92d274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:42.565428 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee59a0-5554-47a7-a15b-d3896e92d274 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:42.634716 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa26cb3-2563-48ff-b1a0-baa066904d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:42.635679 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa26cb3-2563-48ff-b1a0-baa066904d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:42.635981 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa26cb3-2563-48ff-b1a0-baa066904d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:42.636286 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa26cb3-2563-48ff-b1a0-baa066904d20 admin admin] PATH_INFO: `/v3/projects/20a18989a7794534b3c03102ae9c2695` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:42.637515 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa26cb3-2563-48ff-b1a0-baa066904d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a18989a7794534b3c03102ae9c2695)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:42.663820 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa26cb3-2563-48ff-b1a0-baa066904d20 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:42.807358 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1fa26cb3-2563-48ff-b1a0-baa066904d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a18989a7794534b3c03102ae9c2695', 'request_id': 'req-1fa26cb3-2563-48ff-b1a0-baa066904d20'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:42.814069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1fa26cb3-2563-48ff-b1a0-baa066904d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a18989a7794534b3c03102ae9c2695', 'request_id': 'req-1fa26cb3-2563-48ff-b1a0-baa066904d20'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:42.829276 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1fa26cb3-2563-48ff-b1a0-baa066904d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a18989a7794534b3c03102ae9c2695', 'request_id': 'req-1fa26cb3-2563-48ff-b1a0-baa066904d20'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:42.906149 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1fa26cb3-2563-48ff-b1a0-baa066904d20 admin admin] The token cache is being invalidate because project 20a18989a7794534b3c03102ae9c2695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:01:42.906542 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1fa26cb3-2563-48ff-b1a0-baa066904d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:42.907117 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1fa26cb3-2563-48ff-b1a0-baa066904d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:42.908533 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1357/2678] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:01:42 2021] DELETE /identity/v3/projects/20a18989a7794534b3c03102ae9c2695 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:42.915061 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba92db-30d4-4dc6-8de3-5cc27a49bc3b None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:42.915514 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba92db-30d4-4dc6-8de3-5cc27a49bc3b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:42.915610 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba92db-30d4-4dc6-8de3-5cc27a49bc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:42.938204 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-ddba92db-30d4-4dc6-8de3-5cc27a49bc3b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:42.939351 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-ddba92db-30d4-4dc6-8de3-5cc27a49bc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:43.011767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1322/2679] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:43.023203 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2aafc-9ea7-4171-ac9b-b778b9d72796 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:43.023499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2aafc-9ea7-4171-ac9b-b778b9d72796 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:43.023837 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2aafc-9ea7-4171-ac9b-b778b9d72796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:43.047374 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-3ed2aafc-9ea7-4171-ac9b-b778b9d72796 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:43.048592 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-3ed2aafc-9ea7-4171-ac9b-b778b9d72796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:43.063802 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1358/2680] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 02:01:43.068039 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba92db-30d4-4dc6-8de3-5cc27a49bc3b None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:43.077276 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba92db-30d4-4dc6-8de3-5cc27a49bc3b None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:43.081704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae3a7d-5348-4a93-ba81-35f971d25207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:43.082225 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae3a7d-5348-4a93-ba81-35f971d25207 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:43.082507 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae3a7d-5348-4a93-ba81-35f971d25207 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:43.082791 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae3a7d-5348-4a93-ba81-35f971d25207 admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:43.083478 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae3a7d-5348-4a93-ba81-35f971d25207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 02:01:43.083774 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae3a7d-5348-4a93-ba81-35f971d25207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:43.109851 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae3a7d-5348-4a93-ba81-35f971d25207 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:43.124602 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1323/2681] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 02:01:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 02:01:43.129137 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2aafc-9ea7-4171-ac9b-b778b9d72796 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:43.139583 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2aafc-9ea7-4171-ac9b-b778b9d72796 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:43.148220 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799fc1b-9d30-4d83-a4ea-40da74bce152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:43.148953 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799fc1b-9d30-4d83-a4ea-40da74bce152 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:43.149748 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799fc1b-9d30-4d83-a4ea-40da74bce152 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:43.149748 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799fc1b-9d30-4d83-a4ea-40da74bce152 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:43.150198 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799fc1b-9d30-4d83-a4ea-40da74bce152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:43.177064 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799fc1b-9d30-4d83-a4ea-40da74bce152 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:43.321152 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1359/2682] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:01:43 2021] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:01:43.325400 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae3a7d-5348-4a93-ba81-35f971d25207 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:43.335215 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae3a7d-5348-4a93-ba81-35f971d25207 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:43.409360 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa58c8-133f-43cb-a873-6e834595cad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:43.410528 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa58c8-133f-43cb-a873-6e834595cad0 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:43.410913 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa58c8-133f-43cb-a873-6e834595cad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:43.411339 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa58c8-133f-43cb-a873-6e834595cad0 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:43.412286 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa58c8-133f-43cb-a873-6e834595cad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:43.450346 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa58c8-133f-43cb-a873-6e834595cad0 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:43.611052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1324/2683] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:01:43 2021] POST /identity/v3/users => generated 291 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:01:43.615399 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799fc1b-9d30-4d83-a4ea-40da74bce152 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:43.625275 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799fc1b-9d30-4d83-a4ea-40da74bce152 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:43.629563 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a988708-9ad3-4c98-8817-db28e40db044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:43.630153 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a988708-9ad3-4c98-8817-db28e40db044 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:43.630443 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a988708-9ad3-4c98-8817-db28e40db044 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:43.630721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a988708-9ad3-4c98-8817-db28e40db044 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:43.631514 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a988708-9ad3-4c98-8817-db28e40db044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:43.656952 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a988708-9ad3-4c98-8817-db28e40db044 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:43.667275 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1360/2684] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:43 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:43.672096 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa58c8-133f-43cb-a873-6e834595cad0 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:43.682111 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa58c8-133f-43cb-a873-6e834595cad0 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:43.686279 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b10f92-731c-4d08-ba9e-1c2b06feca3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:43.687085 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b10f92-731c-4d08-ba9e-1c2b06feca3e admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:43.687373 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b10f92-731c-4d08-ba9e-1c2b06feca3e admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:43.687656 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b10f92-731c-4d08-ba9e-1c2b06feca3e admin admin] PATH_INFO: `/v3/projects/57e3d8bb65a640fd9292bf4ae605dbfe/users/af7929bce65940f580d41edfad9811e2/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:43.709369 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b10f92-731c-4d08-ba9e-1c2b06feca3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e3d8bb65a640fd9292bf4ae605dbfe, user_id=af7929bce65940f580d41edfad9811e2, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:43.737109 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b10f92-731c-4d08-ba9e-1c2b06feca3e admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:43.810636 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1325/2685] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:43 2021] PUT /identity/v3/projects/57e3d8bb65a640fd9292bf4ae605dbfe/users/af7929bce65940f580d41edfad9811e2/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:43.821871 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee6092-596b-42ca-8aae-9b55f5d99211 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:43.822167 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee6092-596b-42ca-8aae-9b55f5d99211 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:43.822451 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee6092-596b-42ca-8aae-9b55f5d99211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:43.862034 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-11ee6092-596b-42ca-8aae-9b55f5d99211 None None] MFA Rules not processed for user `af7929bce65940f580d41edfad9811e2`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:43.863101 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-11ee6092-596b-42ca-8aae-9b55f5d99211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:43.940492 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1361/2686] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:43 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 02:01:43.941659 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b10f92-731c-4d08-ba9e-1c2b06feca3e admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:44.012623 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b10f92-731c-4d08-ba9e-1c2b06feca3e admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:44.017816 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ed1be-a397-4f60-b016-cc7626c81550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:44.018396 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ed1be-a397-4f60-b016-cc7626c81550 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:44.018887 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ed1be-a397-4f60-b016-cc7626c81550 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:44.019124 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ed1be-a397-4f60-b016-cc7626c81550 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:44.019794 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ed1be-a397-4f60-b016-cc7626c81550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:44.046368 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ed1be-a397-4f60-b016-cc7626c81550 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:44.153834 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1326/2687] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:01:43 2021] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:01:44.161632 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee6092-596b-42ca-8aae-9b55f5d99211 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:44.169659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee6092-596b-42ca-8aae-9b55f5d99211 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:44.247077 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44346729-41b4-425e-a92d-61565f503c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:44.248821 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44346729-41b4-425e-a92d-61565f503c1a admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:44.249228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44346729-41b4-425e-a92d-61565f503c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:44.249517 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44346729-41b4-425e-a92d-61565f503c1a admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:44.250235 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44346729-41b4-425e-a92d-61565f503c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:44.277640 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44346729-41b4-425e-a92d-61565f503c1a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:44.385692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1362/2688] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:01:44 2021] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:01:44.390761 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ed1be-a397-4f60-b016-cc7626c81550 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:44.402288 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ed1be-a397-4f60-b016-cc7626c81550 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:44.413333 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe556d-344e-42d9-af98-64d66ca86452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:44.414181 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe556d-344e-42d9-af98-64d66ca86452 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:44.414567 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe556d-344e-42d9-af98-64d66ca86452 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:44.414948 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe556d-344e-42d9-af98-64d66ca86452 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:44.417312 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe556d-344e-42d9-af98-64d66ca86452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:44.488611 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe556d-344e-42d9-af98-64d66ca86452 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:44.525659 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44346729-41b4-425e-a92d-61565f503c1a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:44.528653 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1327/2689] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:44 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:44.536491 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44346729-41b4-425e-a92d-61565f503c1a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:44.541194 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bc22f-2e36-46d7-9f4f-12a7a786d0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:44.542229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bc22f-2e36-46d7-9f4f-12a7a786d0c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:44.542611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bc22f-2e36-46d7-9f4f-12a7a786d0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:44.542989 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bc22f-2e36-46d7-9f4f-12a7a786d0c5 admin admin] PATH_INFO: `/v3/projects/dc4742083f1a46e99a459cb4a99ae2de/users/c0f63818819346b0b9830e99a45c476c/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:44.568386 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bc22f-2e36-46d7-9f4f-12a7a786d0c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc4742083f1a46e99a459cb4a99ae2de, user_id=c0f63818819346b0b9830e99a45c476c, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:44.606051 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bc22f-2e36-46d7-9f4f-12a7a786d0c5 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:44.680945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1363/2690] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:44 2021] PUT /identity/v3/projects/dc4742083f1a46e99a459cb4a99ae2de/users/c0f63818819346b0b9830e99a45c476c/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:44.686404 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe556d-344e-42d9-af98-64d66ca86452 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:44.696709 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe556d-344e-42d9-af98-64d66ca86452 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:44.769546 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b68304-90c1-4567-b375-155bd6e63e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:44.770300 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b68304-90c1-4567-b375-155bd6e63e8b admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:44.770595 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b68304-90c1-4567-b375-155bd6e63e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:44.770915 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b68304-90c1-4567-b375-155bd6e63e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:44.771862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b68304-90c1-4567-b375-155bd6e63e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:44.798190 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b68304-90c1-4567-b375-155bd6e63e8b admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:44.809780 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1328/2691] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:44 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:44.814589 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bc22f-2e36-46d7-9f4f-12a7a786d0c5 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:44.824679 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bc22f-2e36-46d7-9f4f-12a7a786d0c5 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:44.829635 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9b7fe-238f-4855-8e81-841804b132e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:44.830454 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9b7fe-238f-4855-8e81-841804b132e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:44.830765 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9b7fe-238f-4855-8e81-841804b132e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:44.831110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9b7fe-238f-4855-8e81-841804b132e2 admin admin] PATH_INFO: `/v3/projects/dc4742083f1a46e99a459cb4a99ae2de/users/c0f63818819346b0b9830e99a45c476c/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:44.832945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9b7fe-238f-4855-8e81-841804b132e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc4742083f1a46e99a459cb4a99ae2de, user_id=c0f63818819346b0b9830e99a45c476c, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:44.860328 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9b7fe-238f-4855-8e81-841804b132e2 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:44.870740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1364/2692] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:44 2021] PUT /identity/v3/projects/dc4742083f1a46e99a459cb4a99ae2de/users/c0f63818819346b0b9830e99a45c476c/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:44.875228 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b68304-90c1-4567-b375-155bd6e63e8b admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:44.884913 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b68304-90c1-4567-b375-155bd6e63e8b admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:44.951161 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8c8f2-7bc0-4f44-b1b1-2a7bfaed48c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:44.952427 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8c8f2-7bc0-4f44-b1b1-2a7bfaed48c2 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:44.952704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8c8f2-7bc0-4f44-b1b1-2a7bfaed48c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:44.952989 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8c8f2-7bc0-4f44-b1b1-2a7bfaed48c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:44.953672 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8c8f2-7bc0-4f44-b1b1-2a7bfaed48c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:44.979324 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8c8f2-7bc0-4f44-b1b1-2a7bfaed48c2 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:44.992982 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1329/2693] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:44 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:44.994401 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9b7fe-238f-4855-8e81-841804b132e2 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:45.005778 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9b7fe-238f-4855-8e81-841804b132e2 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:45.010617 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2edf2-47b5-4bd5-98c6-f798e2476001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:45.011550 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2edf2-47b5-4bd5-98c6-f798e2476001 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:45.011838 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2edf2-47b5-4bd5-98c6-f798e2476001 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:45.012119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2edf2-47b5-4bd5-98c6-f798e2476001 admin admin] PATH_INFO: `/v3/projects/dc4742083f1a46e99a459cb4a99ae2de/users/c0f63818819346b0b9830e99a45c476c/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:45.013958 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2edf2-47b5-4bd5-98c6-f798e2476001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc4742083f1a46e99a459cb4a99ae2de, user_id=c0f63818819346b0b9830e99a45c476c, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:45.040901 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2edf2-47b5-4bd5-98c6-f798e2476001 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:45.108685 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1365/2694] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:44 2021] PUT /identity/v3/projects/dc4742083f1a46e99a459cb4a99ae2de/users/c0f63818819346b0b9830e99a45c476c/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:45.118952 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcbb61-6e41-45c4-9935-92c102f44512 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:45.119314 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcbb61-6e41-45c4-9935-92c102f44512 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:45.119511 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcbb61-6e41-45c4-9935-92c102f44512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:45.184349 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-6ddcbb61-6e41-45c4-9935-92c102f44512 None None] MFA Rules not processed for user `c0f63818819346b0b9830e99a45c476c`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:45.185666 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-6ddcbb61-6e41-45c4-9935-92c102f44512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:45.287476 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1330/2695] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:45 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:45.297314 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2edf2-47b5-4bd5-98c6-f798e2476001 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:45.299365 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-3fb2edf2-47b5-4bd5-98c6-f798e2476001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:45.382449 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2edf2-47b5-4bd5-98c6-f798e2476001 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:45.402106 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05350cc2-3917-428e-bc84-7ce776dc7e11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:45.402106 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05350cc2-3917-428e-bc84-7ce776dc7e11 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:45.402106 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05350cc2-3917-428e-bc84-7ce776dc7e11 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:45.402106 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05350cc2-3917-428e-bc84-7ce776dc7e11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:45.414323 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05350cc2-3917-428e-bc84-7ce776dc7e11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:45.447092 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05350cc2-3917-428e-bc84-7ce776dc7e11 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:45.463950 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1366/2696] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:45 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:01:45.569637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcbb61-6e41-45c4-9935-92c102f44512 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:45.582321 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcbb61-6e41-45c4-9935-92c102f44512 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:45.588182 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762320b-ff95-40c9-85dc-75efce567040 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:45.589109 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762320b-ff95-40c9-85dc-75efce567040 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:45.589652 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762320b-ff95-40c9-85dc-75efce567040 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:45.590133 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762320b-ff95-40c9-85dc-75efce567040 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:45.679921 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762320b-ff95-40c9-85dc-75efce567040 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:45.711717 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762320b-ff95-40c9-85dc-75efce567040 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:45.723912 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1331/2697] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:45 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 02:01:48.620871 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec384722-e20f-4867-8072-60d3ec976569 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:48.621373 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec384722-e20f-4867-8072-60d3ec976569 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:48.621485 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec384722-e20f-4867-8072-60d3ec976569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:48.656996 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-ec384722-e20f-4867-8072-60d3ec976569 None None] MFA Rules not processed for user `d7d032177d69477da40ee36f03ae2857`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:48.658132 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ec384722-e20f-4867-8072-60d3ec976569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:48.735292 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1367/2698] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:48 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:48.760395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762320b-ff95-40c9-85dc-75efce567040 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:48.762102 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-8762320b-ff95-40c9-85dc-75efce567040 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:48.840767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762320b-ff95-40c9-85dc-75efce567040 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:48.846349 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea69794-6245-42d3-9a76-fc913789c5d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:48.846940 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea69794-6245-42d3-9a76-fc913789c5d3 service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:48.847224 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea69794-6245-42d3-9a76-fc913789c5d3 service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:48.847503 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea69794-6245-42d3-9a76-fc913789c5d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:48.849192 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1ea69794-6245-42d3-9a76-fc913789c5d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:48.913537 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea69794-6245-42d3-9a76-fc913789c5d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:48.939605 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea69794-6245-42d3-9a76-fc913789c5d3 service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:48.948622 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1332/2699] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:48 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:01:49.466728 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec384722-e20f-4867-8072-60d3ec976569 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:49.534417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec384722-e20f-4867-8072-60d3ec976569 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:49.538838 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c01b3-79fa-42e1-85c4-5a6eb751a745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:49.539780 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c01b3-79fa-42e1-85c4-5a6eb751a745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:49.540066 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c01b3-79fa-42e1-85c4-5a6eb751a745 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:49.540721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c01b3-79fa-42e1-85c4-5a6eb751a745 admin admin] PATH_INFO: `/v3/users/af7929bce65940f580d41edfad9811e2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:49.541535 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c01b3-79fa-42e1-85c4-5a6eb751a745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af7929bce65940f580d41edfad9811e2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:49.568915 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c01b3-79fa-42e1-85c4-5a6eb751a745 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:49.817438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7a5c01b3-79fa-42e1-85c4-5a6eb751a745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af7929bce65940f580d41edfad9811e2'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:49.818100 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7a5c01b3-79fa-42e1-85c4-5a6eb751a745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af7929bce65940f580d41edfad9811e2'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:49.901112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7a5c01b3-79fa-42e1-85c4-5a6eb751a745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af7929bce65940f580d41edfad9811e2'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:49.909492 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7a5c01b3-79fa-42e1-85c4-5a6eb751a745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af7929bce65940f580d41edfad9811e2'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:49.910120 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-7a5c01b3-79fa-42e1-85c4-5a6eb751a745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af7929bce65940f580d41edfad9811e2'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:49.927209 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1368/2700] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:01:49 2021] DELETE /identity/v3/users/af7929bce65940f580d41edfad9811e2 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:49.931604 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49414b-78a3-44ef-87f6-6f7ffbf709d9 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:49.932031 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49414b-78a3-44ef-87f6-6f7ffbf709d9 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:49.932194 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49414b-78a3-44ef-87f6-6f7ffbf709d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:49.954827 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-de49414b-78a3-44ef-87f6-6f7ffbf709d9 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:49.955960 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-de49414b-78a3-44ef-87f6-6f7ffbf709d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:50.022690 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1333/2701] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:50.032693 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c01b3-79fa-42e1-85c4-5a6eb751a745 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:50.033981 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-7a5c01b3-79fa-42e1-85c4-5a6eb751a745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:50.096486 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c01b3-79fa-42e1-85c4-5a6eb751a745 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:50.099741 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb901cd-9d21-445d-b3b1-d79f463acd2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:50.100311 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb901cd-9d21-445d-b3b1-d79f463acd2b service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:50.100624 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb901cd-9d21-445d-b3b1-d79f463acd2b service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:50.100910 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb901cd-9d21-445d-b3b1-d79f463acd2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:50.110050 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb901cd-9d21-445d-b3b1-d79f463acd2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:50.135272 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb901cd-9d21-445d-b3b1-d79f463acd2b service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:50.144809 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1369/2702] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:50 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:01:50.254272 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49414b-78a3-44ef-87f6-6f7ffbf709d9 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:50.254272 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-de49414b-78a3-44ef-87f6-6f7ffbf709d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:50.259211 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49414b-78a3-44ef-87f6-6f7ffbf709d9 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:50.263953 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2800be1-b101-4790-a2c2-a272b02694a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:50.264855 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2800be1-b101-4790-a2c2-a272b02694a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:50.265158 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2800be1-b101-4790-a2c2-a272b02694a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:50.265469 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2800be1-b101-4790-a2c2-a272b02694a5 admin admin] PATH_INFO: `/v3/users/28d5d7d0391341d8a0daba7a7d7ced89` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:50.266552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2800be1-b101-4790-a2c2-a272b02694a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d5d7d0391341d8a0daba7a7d7ced89)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:50.293127 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2800be1-b101-4790-a2c2-a272b02694a5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:50.515230 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-a2800be1-b101-4790-a2c2-a272b02694a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d5d7d0391341d8a0daba7a7d7ced89'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:50.598038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-a2800be1-b101-4790-a2c2-a272b02694a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d5d7d0391341d8a0daba7a7d7ced89'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:50.598633 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-a2800be1-b101-4790-a2c2-a272b02694a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d5d7d0391341d8a0daba7a7d7ced89'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:50.606760 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-a2800be1-b101-4790-a2c2-a272b02694a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d5d7d0391341d8a0daba7a7d7ced89'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:50.607930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-a2800be1-b101-4790-a2c2-a272b02694a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d5d7d0391341d8a0daba7a7d7ced89'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:50.626359 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1334/2703] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:01:50 2021] DELETE /identity/v3/users/28d5d7d0391341d8a0daba7a7d7ced89 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:50.632612 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124a1cb-42eb-4b00-86b5-2a9edde20fee None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:50.632612 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124a1cb-42eb-4b00-86b5-2a9edde20fee None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:50.632612 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124a1cb-42eb-4b00-86b5-2a9edde20fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:50.653921 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-a124a1cb-42eb-4b00-86b5-2a9edde20fee None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:50.655049 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-a124a1cb-42eb-4b00-86b5-2a9edde20fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:50.708754 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2800be1-b101-4790-a2c2-a272b02694a5 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:50.710287 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a2800be1-b101-4790-a2c2-a272b02694a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:50.729953 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1370/2704] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 02:01:50.742425 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124a1cb-42eb-4b00-86b5-2a9edde20fee None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:50.743698 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-a124a1cb-42eb-4b00-86b5-2a9edde20fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:50.783786 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2800be1-b101-4790-a2c2-a272b02694a5 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:50.789426 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a3601-c2a1-445b-a205-d1bcb52320a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:50.793182 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a3601-c2a1-445b-a205-d1bcb52320a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:50.793927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a3601-c2a1-445b-a205-d1bcb52320a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:50.795379 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a3601-c2a1-445b-a205-d1bcb52320a5 admin admin] PATH_INFO: `/v3/projects/57e3d8bb65a640fd9292bf4ae605dbfe` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:50.797322 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a3601-c2a1-445b-a205-d1bcb52320a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e3d8bb65a640fd9292bf4ae605dbfe)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:50.809677 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124a1cb-42eb-4b00-86b5-2a9edde20fee None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:50.814000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf729aaf-be3a-40a9-b2c5-1d666f63b3be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:50.814660 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf729aaf-be3a-40a9-b2c5-1d666f63b3be service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:50.814952 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf729aaf-be3a-40a9-b2c5-1d666f63b3be service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:50.815229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf729aaf-be3a-40a9-b2c5-1d666f63b3be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:50.825103 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf729aaf-be3a-40a9-b2c5-1d666f63b3be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:50.834899 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a3601-c2a1-445b-a205-d1bcb52320a5 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:50.852954 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf729aaf-be3a-40a9-b2c5-1d666f63b3be service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:50.864310 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1371/2705] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:50 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 02:01:50.948450 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-244a3601-c2a1-445b-a205-d1bcb52320a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e3d8bb65a640fd9292bf4ae605dbfe', 'request_id': 'req-244a3601-c2a1-445b-a205-d1bcb52320a5'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:50.954545 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-244a3601-c2a1-445b-a205-d1bcb52320a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e3d8bb65a640fd9292bf4ae605dbfe', 'request_id': 'req-244a3601-c2a1-445b-a205-d1bcb52320a5'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:50.966043 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-244a3601-c2a1-445b-a205-d1bcb52320a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e3d8bb65a640fd9292bf4ae605dbfe', 'request_id': 'req-244a3601-c2a1-445b-a205-d1bcb52320a5'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:51.089225 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-244a3601-c2a1-445b-a205-d1bcb52320a5 admin admin] The token cache is being invalidate because project 57e3d8bb65a640fd9292bf4ae605dbfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:01:51.094941 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-244a3601-c2a1-445b-a205-d1bcb52320a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:51.094941 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-244a3601-c2a1-445b-a205-d1bcb52320a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:51.094941 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1335/2706] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:01:50 2021] DELETE /identity/v3/projects/57e3d8bb65a640fd9292bf4ae605dbfe => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:51.096805 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf729aaf-be3a-40a9-b2c5-1d666f63b3be service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:51.108774 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf729aaf-be3a-40a9-b2c5-1d666f63b3be service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:51.186732 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe25af-661c-4e68-bcb6-e06c5e9ed33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:51.191641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe25af-661c-4e68-bcb6-e06c5e9ed33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:51.191641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe25af-661c-4e68-bcb6-e06c5e9ed33c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:51.191641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe25af-661c-4e68-bcb6-e06c5e9ed33c admin admin] PATH_INFO: `/v3/users/c0f63818819346b0b9830e99a45c476c` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:51.191641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe25af-661c-4e68-bcb6-e06c5e9ed33c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f63818819346b0b9830e99a45c476c)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:51.215710 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe25af-661c-4e68-bcb6-e06c5e9ed33c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:51.487842 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a3601-c2a1-445b-a205-d1bcb52320a5 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:51.490040 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-244a3601-c2a1-445b-a205-d1bcb52320a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:51.503633 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a3601-c2a1-445b-a205-d1bcb52320a5 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:51.507806 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e63ddf-180a-4c58-ab21-499911cee0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:51.508762 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e63ddf-180a-4c58-ab21-499911cee0ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:51.509070 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e63ddf-180a-4c58-ab21-499911cee0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:51.512869 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e63ddf-180a-4c58-ab21-499911cee0ba admin admin] PATH_INFO: `/v3/projects/888e1ffb89b1414aad7461bdfd6e2aff` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:51.514044 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e63ddf-180a-4c58-ab21-499911cee0ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=888e1ffb89b1414aad7461bdfd6e2aff)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:51.542122 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e63ddf-180a-4c58-ab21-499911cee0ba admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:51.576523 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f5fe25af-661c-4e68-bcb6-e06c5e9ed33c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f63818819346b0b9830e99a45c476c'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:51.577163 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f5fe25af-661c-4e68-bcb6-e06c5e9ed33c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f63818819346b0b9830e99a45c476c'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:51.643870 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f5fe25af-661c-4e68-bcb6-e06c5e9ed33c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f63818819346b0b9830e99a45c476c'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:51.657726 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f5fe25af-661c-4e68-bcb6-e06c5e9ed33c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f63818819346b0b9830e99a45c476c'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:51.658386 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-f5fe25af-661c-4e68-bcb6-e06c5e9ed33c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f63818819346b0b9830e99a45c476c'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:51.663392 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-e6e63ddf-180a-4c58-ab21-499911cee0ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '888e1ffb89b1414aad7461bdfd6e2aff', 'request_id': 'req-e6e63ddf-180a-4c58-ab21-499911cee0ba'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:51.668392 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-e6e63ddf-180a-4c58-ab21-499911cee0ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '888e1ffb89b1414aad7461bdfd6e2aff', 'request_id': 'req-e6e63ddf-180a-4c58-ab21-499911cee0ba'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:51.676086 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1372/2707] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:01:51 2021] DELETE /identity/v3/users/c0f63818819346b0b9830e99a45c476c => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:51.680454 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-e6e63ddf-180a-4c58-ab21-499911cee0ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '888e1ffb89b1414aad7461bdfd6e2aff', 'request_id': 'req-e6e63ddf-180a-4c58-ab21-499911cee0ba'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:51.757516 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-e6e63ddf-180a-4c58-ab21-499911cee0ba admin admin] The token cache is being invalidate because project 888e1ffb89b1414aad7461bdfd6e2aff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:01:51.760450 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-e6e63ddf-180a-4c58-ab21-499911cee0ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:51.760450 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-e6e63ddf-180a-4c58-ab21-499911cee0ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:51.760450 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1336/2708] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:01:51 2021] DELETE /identity/v3/projects/888e1ffb89b1414aad7461bdfd6e2aff => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:51.765499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476b2f4-149b-4fb4-93e7-16350ffa1fb9 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:51.765812 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476b2f4-149b-4fb4-93e7-16350ffa1fb9 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:51.766092 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476b2f4-149b-4fb4-93e7-16350ffa1fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:51.788900 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-0476b2f4-149b-4fb4-93e7-16350ffa1fb9 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:51.792476 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0476b2f4-149b-4fb4-93e7-16350ffa1fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:51.855849 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1373/2709] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:51.864603 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2b83c-e36c-4bc2-8939-8ac52cf90e0f None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:51.864989 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2b83c-e36c-4bc2-8939-8ac52cf90e0f None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:51.865299 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2b83c-e36c-4bc2-8939-8ac52cf90e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:51.888191 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-dbb2b83c-e36c-4bc2-8939-8ac52cf90e0f None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:51.889384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-dbb2b83c-e36c-4bc2-8939-8ac52cf90e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:51.897028 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1337/2710] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:51.906917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476b2f4-149b-4fb4-93e7-16350ffa1fb9 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:51.916387 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476b2f4-149b-4fb4-93e7-16350ffa1fb9 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:51.921317 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ff0f2-3947-4aca-b537-04197d668b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:51.922000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ff0f2-3947-4aca-b537-04197d668b82 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:51.922413 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ff0f2-3947-4aca-b537-04197d668b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:51.924111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ff0f2-3947-4aca-b537-04197d668b82 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:51.924111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ff0f2-3947-4aca-b537-04197d668b82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 02:01:51.924111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ff0f2-3947-4aca-b537-04197d668b82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:51.950211 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ff0f2-3947-4aca-b537-04197d668b82 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:51.965006 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1374/2711] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 02:01:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 02:01:51.969442 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2b83c-e36c-4bc2-8939-8ac52cf90e0f None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:51.978194 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2b83c-e36c-4bc2-8939-8ac52cf90e0f None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:51.982667 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d63145-34f1-47bf-b961-59fc9fc1d5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:51.983267 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d63145-34f1-47bf-b961-59fc9fc1d5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:51.983552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d63145-34f1-47bf-b961-59fc9fc1d5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:51.983836 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d63145-34f1-47bf-b961-59fc9fc1d5e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:51.984520 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d63145-34f1-47bf-b961-59fc9fc1d5e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:52.010350 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d63145-34f1-47bf-b961-59fc9fc1d5e3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:52.119415 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1338/2712] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:01:51 2021] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:01:52.123542 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ff0f2-3947-4aca-b537-04197d668b82 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:52.133248 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ff0f2-3947-4aca-b537-04197d668b82 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:52.196001 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c744e2b-f80f-4d42-a952-5c0edf025a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:52.197389 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c744e2b-f80f-4d42-a952-5c0edf025a1c admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:52.197389 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c744e2b-f80f-4d42-a952-5c0edf025a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:52.197389 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c744e2b-f80f-4d42-a952-5c0edf025a1c admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:52.197989 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c744e2b-f80f-4d42-a952-5c0edf025a1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:52.204296 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d63145-34f1-47bf-b961-59fc9fc1d5e3 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:52.206155 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-22d63145-34f1-47bf-b961-59fc9fc1d5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:52.228028 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c744e2b-f80f-4d42-a952-5c0edf025a1c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:52.237129 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d63145-34f1-47bf-b961-59fc9fc1d5e3 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:52.242776 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c5a4d-583d-4f46-b650-3a4426b84e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:52.243593 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c5a4d-583d-4f46-b650-3a4426b84e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:52.243887 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c5a4d-583d-4f46-b650-3a4426b84e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:52.244180 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c5a4d-583d-4f46-b650-3a4426b84e55 admin admin] PATH_INFO: `/v3/projects/dc4742083f1a46e99a459cb4a99ae2de` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:52.245383 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c5a4d-583d-4f46-b650-3a4426b84e55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc4742083f1a46e99a459cb4a99ae2de)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:52.272164 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c5a4d-583d-4f46-b650-3a4426b84e55 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:52.335815 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1375/2713] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:01:52 2021] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:01:52.339739 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c744e2b-f80f-4d42-a952-5c0edf025a1c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:52.349996 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c744e2b-f80f-4d42-a952-5c0edf025a1c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:52.359184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27901b-db77-4692-95a9-99cb29985b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:52.359184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27901b-db77-4692-95a9-99cb29985b4f admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:52.359184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27901b-db77-4692-95a9-99cb29985b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:52.359184 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27901b-db77-4692-95a9-99cb29985b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:52.359589 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27901b-db77-4692-95a9-99cb29985b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:52.382343 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27901b-db77-4692-95a9-99cb29985b4f admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:52.393755 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1376/2714] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:52 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 02:01:52.397785 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27901b-db77-4692-95a9-99cb29985b4f admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:52.408125 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27901b-db77-4692-95a9-99cb29985b4f admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:52.413296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c35454-cb1c-441d-a295-20e764522394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:52.414328 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c35454-cb1c-441d-a295-20e764522394 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:52.414692 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c35454-cb1c-441d-a295-20e764522394 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:52.415179 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c35454-cb1c-441d-a295-20e764522394 admin admin] PATH_INFO: `/v3/projects/e4a79c8a5d6e4d73969ee0ca7f845fca/users/6fa7c7bbfa5a4ce291a0eba665299257/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:52.444593 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c35454-cb1c-441d-a295-20e764522394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a79c8a5d6e4d73969ee0ca7f845fca, user_id=6fa7c7bbfa5a4ce291a0eba665299257, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:52.476813 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c35454-cb1c-441d-a295-20e764522394 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:52.500939 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-361c5a4d-583d-4f46-b650-3a4426b84e55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc4742083f1a46e99a459cb4a99ae2de', 'request_id': 'req-361c5a4d-583d-4f46-b650-3a4426b84e55'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:52.507255 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-361c5a4d-583d-4f46-b650-3a4426b84e55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc4742083f1a46e99a459cb4a99ae2de', 'request_id': 'req-361c5a4d-583d-4f46-b650-3a4426b84e55'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:52.522703 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-361c5a4d-583d-4f46-b650-3a4426b84e55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc4742083f1a46e99a459cb4a99ae2de', 'request_id': 'req-361c5a4d-583d-4f46-b650-3a4426b84e55'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:52.544896 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1377/2715] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:52 2021] PUT /identity/v3/projects/e4a79c8a5d6e4d73969ee0ca7f845fca/users/6fa7c7bbfa5a4ce291a0eba665299257/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:52.547635 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2101ff-4e79-4776-9dce-e610db8e7353 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:52.548210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2101ff-4e79-4776-9dce-e610db8e7353 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:52.548733 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2101ff-4e79-4776-9dce-e610db8e7353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:52.573580 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-2c2101ff-4e79-4776-9dce-e610db8e7353 None None] MFA Rules not processed for user `b585e7c0e87246669424cc9dad992e65`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:52.574748 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-2c2101ff-4e79-4776-9dce-e610db8e7353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:52.600271 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-361c5a4d-583d-4f46-b650-3a4426b84e55 admin admin] The token cache is being invalidate because project dc4742083f1a46e99a459cb4a99ae2de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:01:52.600789 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-361c5a4d-583d-4f46-b650-3a4426b84e55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:52.601918 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-361c5a4d-583d-4f46-b650-3a4426b84e55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:52.603584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1339/2716] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:01:52 2021] DELETE /identity/v3/projects/dc4742083f1a46e99a459cb4a99ae2de => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:52.605453 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbced3aa-4b16-48e4-9f12-16e39bd581ab None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:52.605939 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbced3aa-4b16-48e4-9f12-16e39bd581ab None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:52.606379 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbced3aa-4b16-48e4-9f12-16e39bd581ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:52.653187 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1378/2717] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:52 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:52.655181 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc53cdf-5305-4bfc-bac4-6fea24913a28 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:52.655629 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc53cdf-5305-4bfc-bac4-6fea24913a28 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:52.656085 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc53cdf-5305-4bfc-bac4-6fea24913a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:52.657882 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-dbced3aa-4b16-48e4-9f12-16e39bd581ab None None] MFA Rules not processed for user `6fa7c7bbfa5a4ce291a0eba665299257`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:52.659135 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-dbced3aa-4b16-48e4-9f12-16e39bd581ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:52.683976 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-fbc53cdf-5305-4bfc-bac4-6fea24913a28 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:52.685333 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-fbc53cdf-5305-4bfc-bac4-6fea24913a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:52.782392 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1340/2718] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:52 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:52.798936 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbced3aa-4b16-48e4-9f12-16e39bd581ab None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:52.800724 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-dbced3aa-4b16-48e4-9f12-16e39bd581ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:52.871210 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1379/2719] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:52.881404 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6386fc1-6344-4ae8-b5e1-db1e88871b91 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:52.881726 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6386fc1-6344-4ae8-b5e1-db1e88871b91 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:52.881985 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6386fc1-6344-4ae8-b5e1-db1e88871b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:52.888310 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbced3aa-4b16-48e4-9f12-16e39bd581ab None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:52.899213 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289deca5-2410-4d50-a4b1-12ad04af8c79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:52.899766 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289deca5-2410-4d50-a4b1-12ad04af8c79 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:52.900059 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289deca5-2410-4d50-a4b1-12ad04af8c79 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:52.900419 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289deca5-2410-4d50-a4b1-12ad04af8c79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:52.913302 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-f6386fc1-6344-4ae8-b5e1-db1e88871b91 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:52.914670 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-f6386fc1-6344-4ae8-b5e1-db1e88871b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:52.917393 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289deca5-2410-4d50-a4b1-12ad04af8c79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:52.928200 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1380/2720] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:52.929399 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6386fc1-6344-4ae8-b5e1-db1e88871b91 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:52.939671 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6386fc1-6344-4ae8-b5e1-db1e88871b91 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:52.945431 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289deca5-2410-4d50-a4b1-12ad04af8c79 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:52.946118 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e44dc-e1e8-49d8-bc2f-b2b3afdb632a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:52.947293 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e44dc-e1e8-49d8-bc2f-b2b3afdb632a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:52.947778 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e44dc-e1e8-49d8-bc2f-b2b3afdb632a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:52.948448 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e44dc-e1e8-49d8-bc2f-b2b3afdb632a admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:52.949364 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e44dc-e1e8-49d8-bc2f-b2b3afdb632a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 02:01:52.950015 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e44dc-e1e8-49d8-bc2f-b2b3afdb632a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:52.962772 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1341/2721] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:52 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:01:52.984844 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e44dc-e1e8-49d8-bc2f-b2b3afdb632a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:53.005704 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1381/2722] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 02:01:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 02:01:53.006551 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289deca5-2410-4d50-a4b1-12ad04af8c79 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:53.020552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289deca5-2410-4d50-a4b1-12ad04af8c79 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:53.029568 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab02c4-3fd8-4c74-83ab-6fac964bf807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:53.030170 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab02c4-3fd8-4c74-83ab-6fac964bf807 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:53.030759 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab02c4-3fd8-4c74-83ab-6fac964bf807 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:53.031051 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab02c4-3fd8-4c74-83ab-6fac964bf807 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:53.031693 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab02c4-3fd8-4c74-83ab-6fac964bf807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:53.063134 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab02c4-3fd8-4c74-83ab-6fac964bf807 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:53.205666 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1342/2723] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:01:53 2021] POST /identity/v3/projects => generated 371 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:01:53.209965 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e44dc-e1e8-49d8-bc2f-b2b3afdb632a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:53.220033 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e44dc-e1e8-49d8-bc2f-b2b3afdb632a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:53.284167 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cbc20-9d29-47c7-b4c6-e1b92477f8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:53.285115 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cbc20-9d29-47c7-b4c6-e1b92477f8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:53.285115 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cbc20-9d29-47c7-b4c6-e1b92477f8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:53.285445 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cbc20-9d29-47c7-b4c6-e1b92477f8c0 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:53.286031 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cbc20-9d29-47c7-b4c6-e1b92477f8c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:53.312802 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cbc20-9d29-47c7-b4c6-e1b92477f8c0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:53.408121 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1382/2724] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:01:53 2021] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:01:53.418379 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab02c4-3fd8-4c74-83ab-6fac964bf807 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:53.429494 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab02c4-3fd8-4c74-83ab-6fac964bf807 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:53.441440 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e631f4-131d-4910-9317-0de2144240f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:53.442083 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e631f4-131d-4910-9317-0de2144240f4 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:53.442373 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e631f4-131d-4910-9317-0de2144240f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:53.442659 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e631f4-131d-4910-9317-0de2144240f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:53.443354 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e631f4-131d-4910-9317-0de2144240f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:53.471221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e631f4-131d-4910-9317-0de2144240f4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:53.489852 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1343/2725] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:53 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:53.494389 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cbc20-9d29-47c7-b4c6-e1b92477f8c0 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:53.504840 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cbc20-9d29-47c7-b4c6-e1b92477f8c0 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:53.509116 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdd1a7-cd9d-440f-a0d7-ccef4a1060cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:53.509921 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdd1a7-cd9d-440f-a0d7-ccef4a1060cc admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:53.510183 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdd1a7-cd9d-440f-a0d7-ccef4a1060cc admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:53.510495 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdd1a7-cd9d-440f-a0d7-ccef4a1060cc admin admin] PATH_INFO: `/v3/projects/0014acae464a4b1c8843ecbb34cb177a/users/ab741d7605064bd680dbbf5a56f571d7/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:53.535112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdd1a7-cd9d-440f-a0d7-ccef4a1060cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0014acae464a4b1c8843ecbb34cb177a, user_id=ab741d7605064bd680dbbf5a56f571d7, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:53.563917 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdd1a7-cd9d-440f-a0d7-ccef4a1060cc admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:53.661440 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1383/2726] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:53 2021] PUT /identity/v3/projects/0014acae464a4b1c8843ecbb34cb177a/users/ab741d7605064bd680dbbf5a56f571d7/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:53.679789 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7e569-571c-47ae-9b84-3483472e70d8 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:53.680089 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7e569-571c-47ae-9b84-3483472e70d8 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:53.680633 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7e569-571c-47ae-9b84-3483472e70d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:53.760479 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-e1b7e569-571c-47ae-9b84-3483472e70d8 None None] MFA Rules not processed for user `ab741d7605064bd680dbbf5a56f571d7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:53.761816 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-e1b7e569-571c-47ae-9b84-3483472e70d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:53.877394 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1344/2727] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:53 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:53.878082 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdd1a7-cd9d-440f-a0d7-ccef4a1060cc admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:53.951130 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdd1a7-cd9d-440f-a0d7-ccef4a1060cc admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:53.955197 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba603635-6211-460a-bcbf-1593a3f35b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:53.955778 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba603635-6211-460a-bcbf-1593a3f35b28 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:53.956061 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba603635-6211-460a-bcbf-1593a3f35b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:53.956337 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba603635-6211-460a-bcbf-1593a3f35b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:53.957039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba603635-6211-460a-bcbf-1593a3f35b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:53.983797 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba603635-6211-460a-bcbf-1593a3f35b28 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:54.108529 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1384/2728] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:01:53 2021] POST /identity/v3/projects => generated 375 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:01:54.112666 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7e569-571c-47ae-9b84-3483472e70d8 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:54.122701 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7e569-571c-47ae-9b84-3483472e70d8 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:54.190837 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c648c0-9580-4153-8965-b25bb8860d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:54.191439 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c648c0-9580-4153-8965-b25bb8860d2f admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:54.191722 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c648c0-9580-4153-8965-b25bb8860d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:54.191998 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c648c0-9580-4153-8965-b25bb8860d2f admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:54.192658 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c648c0-9580-4153-8965-b25bb8860d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:54.219489 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c648c0-9580-4153-8965-b25bb8860d2f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:54.343978 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1345/2729] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:01:54 2021] POST /identity/v3/users => generated 294 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:01:54.348419 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba603635-6211-460a-bcbf-1593a3f35b28 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:54.360169 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba603635-6211-460a-bcbf-1593a3f35b28 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:54.366282 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9351d-2355-4044-9c7d-b20faaae604b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:54.368026 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9351d-2355-4044-9c7d-b20faaae604b admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:54.368026 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9351d-2355-4044-9c7d-b20faaae604b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:54.368026 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9351d-2355-4044-9c7d-b20faaae604b admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:54.370417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9351d-2355-4044-9c7d-b20faaae604b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:54.396365 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9351d-2355-4044-9c7d-b20faaae604b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:54.412257 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1385/2730] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:54 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:54.413825 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c648c0-9580-4153-8965-b25bb8860d2f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:54.424056 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c648c0-9580-4153-8965-b25bb8860d2f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:54.429131 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c2adf-98fe-413c-aeb8-d2c67a30daf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:54.430057 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c2adf-98fe-413c-aeb8-d2c67a30daf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:54.430346 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c2adf-98fe-413c-aeb8-d2c67a30daf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:54.430703 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c2adf-98fe-413c-aeb8-d2c67a30daf3 admin admin] PATH_INFO: `/v3/projects/97ebbbfcff224c4383ba662ebf14ddc2/users/0310863418aa439fb0f885dcd023cbf9/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:54.452333 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c2adf-98fe-413c-aeb8-d2c67a30daf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ebbbfcff224c4383ba662ebf14ddc2, user_id=0310863418aa439fb0f885dcd023cbf9, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:54.480763 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c2adf-98fe-413c-aeb8-d2c67a30daf3 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:54.575651 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1346/2731] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:54 2021] PUT /identity/v3/projects/97ebbbfcff224c4383ba662ebf14ddc2/users/0310863418aa439fb0f885dcd023cbf9/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:54.580086 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9351d-2355-4044-9c7d-b20faaae604b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:54.590676 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9351d-2355-4044-9c7d-b20faaae604b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:54.667361 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c9ecd-7eba-4f50-898a-97d04c6234ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:54.667962 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c9ecd-7eba-4f50-898a-97d04c6234ef admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:54.668247 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c9ecd-7eba-4f50-898a-97d04c6234ef admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:54.668522 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c9ecd-7eba-4f50-898a-97d04c6234ef admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:54.669238 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c9ecd-7eba-4f50-898a-97d04c6234ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:54.697112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c9ecd-7eba-4f50-898a-97d04c6234ef admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:54.708611 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1386/2732] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:54 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:54.712688 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c2adf-98fe-413c-aeb8-d2c67a30daf3 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:54.722512 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c2adf-98fe-413c-aeb8-d2c67a30daf3 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:54.726682 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a270a-7a4a-4248-bee0-1e8fee15dd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:54.727621 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a270a-7a4a-4248-bee0-1e8fee15dd76 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:54.728025 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a270a-7a4a-4248-bee0-1e8fee15dd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:54.728354 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a270a-7a4a-4248-bee0-1e8fee15dd76 admin admin] PATH_INFO: `/v3/projects/97ebbbfcff224c4383ba662ebf14ddc2/users/0310863418aa439fb0f885dcd023cbf9/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:54.730542 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a270a-7a4a-4248-bee0-1e8fee15dd76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ebbbfcff224c4383ba662ebf14ddc2, user_id=0310863418aa439fb0f885dcd023cbf9, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:54.759158 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a270a-7a4a-4248-bee0-1e8fee15dd76 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:54.773843 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1347/2733] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:54 2021] PUT /identity/v3/projects/97ebbbfcff224c4383ba662ebf14ddc2/users/0310863418aa439fb0f885dcd023cbf9/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:01:54.775273 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c9ecd-7eba-4f50-898a-97d04c6234ef admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:54.788159 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c9ecd-7eba-4f50-898a-97d04c6234ef admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:54.871226 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34b283-4b68-4483-b63f-4de9b3918311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:54.872045 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34b283-4b68-4483-b63f-4de9b3918311 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:54.872423 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34b283-4b68-4483-b63f-4de9b3918311 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:54.872814 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34b283-4b68-4483-b63f-4de9b3918311 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:54.874102 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34b283-4b68-4483-b63f-4de9b3918311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:54.905113 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34b283-4b68-4483-b63f-4de9b3918311 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:54.919687 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1387/2734] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:01:54 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:01:54.920775 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a270a-7a4a-4248-bee0-1e8fee15dd76 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:54.936617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a270a-7a4a-4248-bee0-1e8fee15dd76 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:54.941286 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2f79a-6873-4abe-9e94-5261e705c637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:54.942418 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2f79a-6873-4abe-9e94-5261e705c637 admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:54.942769 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2f79a-6873-4abe-9e94-5261e705c637 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:54.943114 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2f79a-6873-4abe-9e94-5261e705c637 admin admin] PATH_INFO: `/v3/projects/97ebbbfcff224c4383ba662ebf14ddc2/users/0310863418aa439fb0f885dcd023cbf9/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:54.946550 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2f79a-6873-4abe-9e94-5261e705c637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ebbbfcff224c4383ba662ebf14ddc2, user_id=0310863418aa439fb0f885dcd023cbf9, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:54.976442 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2f79a-6873-4abe-9e94-5261e705c637 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:55.062745 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1348/2735] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:01:54 2021] PUT /identity/v3/projects/97ebbbfcff224c4383ba662ebf14ddc2/users/0310863418aa439fb0f885dcd023cbf9/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:55.077771 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d25955-8980-495b-baa5-dd8a4340cff6 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:55.078069 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d25955-8980-495b-baa5-dd8a4340cff6 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:55.078351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d25955-8980-495b-baa5-dd8a4340cff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:55.124029 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-32d25955-8980-495b-baa5-dd8a4340cff6 None None] MFA Rules not processed for user `0310863418aa439fb0f885dcd023cbf9`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:55.126667 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-32d25955-8980-495b-baa5-dd8a4340cff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:55.216736 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1388/2736] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:55 2021] POST /identity/v3/auth/tokens => generated 3749 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:55.230841 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2f79a-6873-4abe-9e94-5261e705c637 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:55.291209 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2f79a-6873-4abe-9e94-5261e705c637 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:55.294784 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd0cd4-8bff-4b41-bf85-4ad50ba4ac6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:55.295370 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd0cd4-8bff-4b41-bf85-4ad50ba4ac6d service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:55.295662 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd0cd4-8bff-4b41-bf85-4ad50ba4ac6d service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:55.295946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd0cd4-8bff-4b41-bf85-4ad50ba4ac6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:55.364779 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd0cd4-8bff-4b41-bf85-4ad50ba4ac6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:55.396764 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd0cd4-8bff-4b41-bf85-4ad50ba4ac6d service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:55.414288 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1349/2737] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:55 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:01:56.603104 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d25955-8980-495b-baa5-dd8a4340cff6 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:56.604519 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-32d25955-8980-495b-baa5-dd8a4340cff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:56.706859 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d25955-8980-495b-baa5-dd8a4340cff6 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:56.711429 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10585907-d89d-424f-b755-170c18405e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:56.712223 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10585907-d89d-424f-b755-170c18405e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:56.712511 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10585907-d89d-424f-b755-170c18405e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:56.712817 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10585907-d89d-424f-b755-170c18405e9b admin admin] PATH_INFO: `/v3/users/6fa7c7bbfa5a4ce291a0eba665299257` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:56.713965 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10585907-d89d-424f-b755-170c18405e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fa7c7bbfa5a4ce291a0eba665299257)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:56.740713 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10585907-d89d-424f-b755-170c18405e9b admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:56.991237 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-10585907-d89d-424f-b755-170c18405e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fa7c7bbfa5a4ce291a0eba665299257'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:56.993141 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-10585907-d89d-424f-b755-170c18405e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fa7c7bbfa5a4ce291a0eba665299257'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:57.089100 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-10585907-d89d-424f-b755-170c18405e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fa7c7bbfa5a4ce291a0eba665299257'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:57.097783 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-10585907-d89d-424f-b755-170c18405e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fa7c7bbfa5a4ce291a0eba665299257'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:57.098474 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-10585907-d89d-424f-b755-170c18405e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fa7c7bbfa5a4ce291a0eba665299257'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:57.115570 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1389/2738] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:01:56 2021] DELETE /identity/v3/users/6fa7c7bbfa5a4ce291a0eba665299257 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:57.123756 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e8b06-dd76-4fcc-8b2d-4ecfc04e71da None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:57.124356 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e8b06-dd76-4fcc-8b2d-4ecfc04e71da None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:57.124356 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e8b06-dd76-4fcc-8b2d-4ecfc04e71da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:57.146469 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-908e8b06-dd76-4fcc-8b2d-4ecfc04e71da None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:57.147600 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-908e8b06-dd76-4fcc-8b2d-4ecfc04e71da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:57.211558 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1350/2739] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:57.238531 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10585907-d89d-424f-b755-170c18405e9b admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:57.239884 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-10585907-d89d-424f-b755-170c18405e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:57.313485 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10585907-d89d-424f-b755-170c18405e9b admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:57.317263 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858f28e-fbf5-41f7-bd8d-85342b32eaa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:57.317977 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858f28e-fbf5-41f7-bd8d-85342b32eaa6 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:57.318485 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858f28e-fbf5-41f7-bd8d-85342b32eaa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:57.318879 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858f28e-fbf5-41f7-bd8d-85342b32eaa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:57.330586 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858f28e-fbf5-41f7-bd8d-85342b32eaa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:57.356855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858f28e-fbf5-41f7-bd8d-85342b32eaa6 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:57.367499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1390/2740] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:57 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:01:57.927387 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e8b06-dd76-4fcc-8b2d-4ecfc04e71da None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:57.929138 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-908e8b06-dd76-4fcc-8b2d-4ecfc04e71da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:57.941972 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e8b06-dd76-4fcc-8b2d-4ecfc04e71da None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:57.946704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90852ef2-2ca9-4333-a999-29759d739dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:57.947468 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90852ef2-2ca9-4333-a999-29759d739dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:57.947752 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90852ef2-2ca9-4333-a999-29759d739dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:57.948150 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90852ef2-2ca9-4333-a999-29759d739dc6 admin admin] PATH_INFO: `/v3/projects/e4a79c8a5d6e4d73969ee0ca7f845fca` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:57.949259 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90852ef2-2ca9-4333-a999-29759d739dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a79c8a5d6e4d73969ee0ca7f845fca)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:57.975569 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90852ef2-2ca9-4333-a999-29759d739dc6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:58.147560 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-90852ef2-2ca9-4333-a999-29759d739dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a79c8a5d6e4d73969ee0ca7f845fca', 'request_id': 'req-90852ef2-2ca9-4333-a999-29759d739dc6'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:58.159311 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-90852ef2-2ca9-4333-a999-29759d739dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a79c8a5d6e4d73969ee0ca7f845fca', 'request_id': 'req-90852ef2-2ca9-4333-a999-29759d739dc6'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:58.173654 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-90852ef2-2ca9-4333-a999-29759d739dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a79c8a5d6e4d73969ee0ca7f845fca', 'request_id': 'req-90852ef2-2ca9-4333-a999-29759d739dc6'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:58.243799 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-90852ef2-2ca9-4333-a999-29759d739dc6 admin admin] The token cache is being invalidate because project e4a79c8a5d6e4d73969ee0ca7f845fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:01:58.243799 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-90852ef2-2ca9-4333-a999-29759d739dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:58.243799 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-90852ef2-2ca9-4333-a999-29759d739dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:58.243799 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1351/2741] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:01:57 2021] DELETE /identity/v3/projects/e4a79c8a5d6e4d73969ee0ca7f845fca => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:58.858417 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858f28e-fbf5-41f7-bd8d-85342b32eaa6 service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:58.859776 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-6858f28e-fbf5-41f7-bd8d-85342b32eaa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:58.871801 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858f28e-fbf5-41f7-bd8d-85342b32eaa6 service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:58.943216 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262338e-58ec-4538-a6ae-c0d02a1602e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:58.944025 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262338e-58ec-4538-a6ae-c0d02a1602e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:58.945229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262338e-58ec-4538-a6ae-c0d02a1602e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:58.945229 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262338e-58ec-4538-a6ae-c0d02a1602e3 admin admin] PATH_INFO: `/v3/users/ab741d7605064bd680dbbf5a56f571d7` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:58.945709 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262338e-58ec-4538-a6ae-c0d02a1602e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab741d7605064bd680dbbf5a56f571d7)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:58.972299 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262338e-58ec-4538-a6ae-c0d02a1602e3 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:59.166156 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1262338e-58ec-4538-a6ae-c0d02a1602e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab741d7605064bd680dbbf5a56f571d7'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:59.166786 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1262338e-58ec-4538-a6ae-c0d02a1602e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab741d7605064bd680dbbf5a56f571d7'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:59.295084 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1262338e-58ec-4538-a6ae-c0d02a1602e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab741d7605064bd680dbbf5a56f571d7'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:59.303727 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1262338e-58ec-4538-a6ae-c0d02a1602e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab741d7605064bd680dbbf5a56f571d7'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:59.304470 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-1262338e-58ec-4538-a6ae-c0d02a1602e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab741d7605064bd680dbbf5a56f571d7'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:01:59.323300 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1391/2742] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:01:58 2021] DELETE /identity/v3/users/ab741d7605064bd680dbbf5a56f571d7 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:01:59.328173 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e498dde-4b7b-453e-b5cd-064a6121d60b None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:59.329245 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e498dde-4b7b-453e-b5cd-064a6121d60b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:59.329593 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e498dde-4b7b-453e-b5cd-064a6121d60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:59.351910 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-1e498dde-4b7b-453e-b5cd-064a6121d60b None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:01:59.353171 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1e498dde-4b7b-453e-b5cd-064a6121d60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:59.429747 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1352/2743] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:01:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:01:59.441321 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262338e-58ec-4538-a6ae-c0d02a1602e3 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:01:59.443134 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1262338e-58ec-4538-a6ae-c0d02a1602e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:01:59.527165 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262338e-58ec-4538-a6ae-c0d02a1602e3 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:01:59.531236 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc9183-8e4f-4115-9cf8-b3743291d227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:01:59.531824 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc9183-8e4f-4115-9cf8-b3743291d227 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:01:59.532115 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc9183-8e4f-4115-9cf8-b3743291d227 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:01:59.532390 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc9183-8e4f-4115-9cf8-b3743291d227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:01:59.546628 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc9183-8e4f-4115-9cf8-b3743291d227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:01:59.572389 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc9183-8e4f-4115-9cf8-b3743291d227 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:01:59.582846 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1392/2744] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:01:59 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:02:00.058654 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e498dde-4b7b-453e-b5cd-064a6121d60b None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:00.060307 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1e498dde-4b7b-453e-b5cd-064a6121d60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:00.074815 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e498dde-4b7b-453e-b5cd-064a6121d60b None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:00.079936 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8c53e-e833-462b-9c2b-8fce901dac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:00.080259 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8c53e-e833-462b-9c2b-8fce901dac82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:00.080359 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8c53e-e833-462b-9c2b-8fce901dac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:00.080708 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8c53e-e833-462b-9c2b-8fce901dac82 admin admin] PATH_INFO: `/v3/projects/0014acae464a4b1c8843ecbb34cb177a` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:00.081792 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8c53e-e833-462b-9c2b-8fce901dac82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0014acae464a4b1c8843ecbb34cb177a)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:00.107849 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8c53e-e833-462b-9c2b-8fce901dac82 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:00.215388 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-1ba8c53e-e833-462b-9c2b-8fce901dac82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0014acae464a4b1c8843ecbb34cb177a', 'request_id': 'req-1ba8c53e-e833-462b-9c2b-8fce901dac82'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:00.220264 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-1ba8c53e-e833-462b-9c2b-8fce901dac82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0014acae464a4b1c8843ecbb34cb177a', 'request_id': 'req-1ba8c53e-e833-462b-9c2b-8fce901dac82'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:00.231474 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-1ba8c53e-e833-462b-9c2b-8fce901dac82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0014acae464a4b1c8843ecbb34cb177a', 'request_id': 'req-1ba8c53e-e833-462b-9c2b-8fce901dac82'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:00.313346 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-1ba8c53e-e833-462b-9c2b-8fce901dac82 admin admin] The token cache is being invalidate because project 0014acae464a4b1c8843ecbb34cb177a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:02:00.313710 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-1ba8c53e-e833-462b-9c2b-8fce901dac82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:00.316207 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-1ba8c53e-e833-462b-9c2b-8fce901dac82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:00.318007 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1353/2745] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:02:00 2021] DELETE /identity/v3/projects/0014acae464a4b1c8843ecbb34cb177a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:02:00.321686 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc9183-8e4f-4115-9cf8-b3743291d227 service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:00.331275 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc9183-8e4f-4115-9cf8-b3743291d227 service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:00.414474 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16823b59-2e2f-4fd1-b855-1356b044780d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:00.415605 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16823b59-2e2f-4fd1-b855-1356b044780d admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:00.415993 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16823b59-2e2f-4fd1-b855-1356b044780d admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:00.416507 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16823b59-2e2f-4fd1-b855-1356b044780d admin admin] PATH_INFO: `/v3/users/0310863418aa439fb0f885dcd023cbf9` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:00.417703 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16823b59-2e2f-4fd1-b855-1356b044780d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0310863418aa439fb0f885dcd023cbf9)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:00.445281 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16823b59-2e2f-4fd1-b855-1356b044780d admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:00.640350 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-16823b59-2e2f-4fd1-b855-1356b044780d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0310863418aa439fb0f885dcd023cbf9'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:00.641105 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-16823b59-2e2f-4fd1-b855-1356b044780d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0310863418aa439fb0f885dcd023cbf9'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:00.729530 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-16823b59-2e2f-4fd1-b855-1356b044780d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0310863418aa439fb0f885dcd023cbf9'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:00.738933 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-16823b59-2e2f-4fd1-b855-1356b044780d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0310863418aa439fb0f885dcd023cbf9'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:00.739730 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-16823b59-2e2f-4fd1-b855-1356b044780d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0310863418aa439fb0f885dcd023cbf9'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:00.756648 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1393/2746] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:02:00 2021] DELETE /identity/v3/users/0310863418aa439fb0f885dcd023cbf9 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:02:01.272447 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8c53e-e833-462b-9c2b-8fce901dac82 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:01.274378 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-1ba8c53e-e833-462b-9c2b-8fce901dac82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:01.286881 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8c53e-e833-462b-9c2b-8fce901dac82 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:01.350518 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd4b8c-61de-43f5-a083-e2e798561222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:01.351305 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd4b8c-61de-43f5-a083-e2e798561222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:01.351589 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd4b8c-61de-43f5-a083-e2e798561222 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:01.351862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd4b8c-61de-43f5-a083-e2e798561222 admin admin] PATH_INFO: `/v3/projects/97ebbbfcff224c4383ba662ebf14ddc2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:01.352977 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd4b8c-61de-43f5-a083-e2e798561222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97ebbbfcff224c4383ba662ebf14ddc2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:01.379446 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd4b8c-61de-43f5-a083-e2e798561222 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:01.501946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-03bd4b8c-61de-43f5-a083-e2e798561222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97ebbbfcff224c4383ba662ebf14ddc2', 'request_id': 'req-03bd4b8c-61de-43f5-a083-e2e798561222'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:01.501946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-03bd4b8c-61de-43f5-a083-e2e798561222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97ebbbfcff224c4383ba662ebf14ddc2', 'request_id': 'req-03bd4b8c-61de-43f5-a083-e2e798561222'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:01.512703 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-03bd4b8c-61de-43f5-a083-e2e798561222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97ebbbfcff224c4383ba662ebf14ddc2', 'request_id': 'req-03bd4b8c-61de-43f5-a083-e2e798561222'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:01.598100 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-03bd4b8c-61de-43f5-a083-e2e798561222 admin admin] The token cache is being invalidate because project 97ebbbfcff224c4383ba662ebf14ddc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:02:01.598477 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-03bd4b8c-61de-43f5-a083-e2e798561222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:01.599059 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-03bd4b8c-61de-43f5-a083-e2e798561222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:01.600697 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1354/2747] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:02:01 2021] DELETE /identity/v3/projects/97ebbbfcff224c4383ba662ebf14ddc2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:02:01.606464 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbda8bc-93be-460e-b014-f68a888e9a29 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:01.606989 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbda8bc-93be-460e-b014-f68a888e9a29 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:01.607110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbda8bc-93be-460e-b014-f68a888e9a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:01.630668 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-ffbda8bc-93be-460e-b014-f68a888e9a29 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:01.631841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ffbda8bc-93be-460e-b014-f68a888e9a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:01.696658 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1394/2748] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:02:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:02:01.706077 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c10e87-5226-4fc2-9443-c0de6ad5a535 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:01.706369 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c10e87-5226-4fc2-9443-c0de6ad5a535 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:01.706649 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c10e87-5226-4fc2-9443-c0de6ad5a535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:01.729475 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-a6c10e87-5226-4fc2-9443-c0de6ad5a535 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:01.730641 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a6c10e87-5226-4fc2-9443-c0de6ad5a535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:01.737680 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1355/2749] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:02:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:02:01.741817 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbda8bc-93be-460e-b014-f68a888e9a29 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:01.752143 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbda8bc-93be-460e-b014-f68a888e9a29 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:01.756310 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69cb05-266e-4a5f-8736-073f55810492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:01.756934 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69cb05-266e-4a5f-8736-073f55810492 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:01.757216 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69cb05-266e-4a5f-8736-073f55810492 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:01.757493 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69cb05-266e-4a5f-8736-073f55810492 admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:01.758171 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69cb05-266e-4a5f-8736-073f55810492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 02:02:01.758465 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69cb05-266e-4a5f-8736-073f55810492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:01.784454 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69cb05-266e-4a5f-8736-073f55810492 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:01.797807 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1395/2750] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 02:02:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 02:02:01.802465 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c10e87-5226-4fc2-9443-c0de6ad5a535 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:01.812165 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c10e87-5226-4fc2-9443-c0de6ad5a535 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:01.816489 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160fa40-7f22-478b-b54f-e4bad32497ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:01.817112 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160fa40-7f22-478b-b54f-e4bad32497ea admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:01.817400 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160fa40-7f22-478b-b54f-e4bad32497ea admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:01.817684 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160fa40-7f22-478b-b54f-e4bad32497ea admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:01.818361 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160fa40-7f22-478b-b54f-e4bad32497ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:01.845007 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160fa40-7f22-478b-b54f-e4bad32497ea admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:01.913772 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1356/2751] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:02:01 2021] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:02:01.918099 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69cb05-266e-4a5f-8736-073f55810492 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:01.927874 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69cb05-266e-4a5f-8736-073f55810492 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:01.993024 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38323d8f-fb8e-4fda-a5bc-fb0b85994365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:01.993630 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38323d8f-fb8e-4fda-a5bc-fb0b85994365 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:01.993915 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38323d8f-fb8e-4fda-a5bc-fb0b85994365 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:01.994191 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38323d8f-fb8e-4fda-a5bc-fb0b85994365 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:01.995310 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38323d8f-fb8e-4fda-a5bc-fb0b85994365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:02.027177 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38323d8f-fb8e-4fda-a5bc-fb0b85994365 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:02.108521 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1396/2752] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:02:01 2021] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:02:02.112763 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160fa40-7f22-478b-b54f-e4bad32497ea admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:02.123415 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160fa40-7f22-478b-b54f-e4bad32497ea admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:02.127688 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434bbbb-b1dd-42db-98b3-fc9042771e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:02.128268 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434bbbb-b1dd-42db-98b3-fc9042771e56 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:02.128553 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434bbbb-b1dd-42db-98b3-fc9042771e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:02.128855 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434bbbb-b1dd-42db-98b3-fc9042771e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:02.129536 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434bbbb-b1dd-42db-98b3-fc9042771e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:02.155474 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434bbbb-b1dd-42db-98b3-fc9042771e56 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:02.166395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1357/2753] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:02:02 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:02:02.171004 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38323d8f-fb8e-4fda-a5bc-fb0b85994365 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:02.180728 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38323d8f-fb8e-4fda-a5bc-fb0b85994365 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:02.185758 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744241f-2e10-4118-a1bd-de9d02c1d2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:02.193361 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744241f-2e10-4118-a1bd-de9d02c1d2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:02.193361 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744241f-2e10-4118-a1bd-de9d02c1d2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:02.193361 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744241f-2e10-4118-a1bd-de9d02c1d2a5 admin admin] PATH_INFO: `/v3/projects/21221e18cb104ffd823ab49ef5c69ecc/users/5a0ce61798f046639b887d5c80a503b8/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:02.206410 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744241f-2e10-4118-a1bd-de9d02c1d2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21221e18cb104ffd823ab49ef5c69ecc, user_id=5a0ce61798f046639b887d5c80a503b8, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:02.235960 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744241f-2e10-4118-a1bd-de9d02c1d2a5 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:02.324040 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1397/2754] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:02:02 2021] PUT /identity/v3/projects/21221e18cb104ffd823ab49ef5c69ecc/users/5a0ce61798f046639b887d5c80a503b8/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:02:02.334613 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff351dbc-58e0-4cc0-9f1e-7d245c67572b None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:02.335135 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff351dbc-58e0-4cc0-9f1e-7d245c67572b None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:02.335340 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff351dbc-58e0-4cc0-9f1e-7d245c67572b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:02.374261 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-ff351dbc-58e0-4cc0-9f1e-7d245c67572b None None] MFA Rules not processed for user `5a0ce61798f046639b887d5c80a503b8`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:02.375627 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-ff351dbc-58e0-4cc0-9f1e-7d245c67572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:02.451704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1358/2755] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:02:02 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:02:02.456325 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744241f-2e10-4118-a1bd-de9d02c1d2a5 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:02.537476 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744241f-2e10-4118-a1bd-de9d02c1d2a5 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:02.546074 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542360a2-2d0a-4a65-97a7-162f2e1851ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:02.546074 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542360a2-2d0a-4a65-97a7-162f2e1851ad admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:02.546074 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542360a2-2d0a-4a65-97a7-162f2e1851ad admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:02.546074 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542360a2-2d0a-4a65-97a7-162f2e1851ad admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:02.546591 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542360a2-2d0a-4a65-97a7-162f2e1851ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:02.571763 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542360a2-2d0a-4a65-97a7-162f2e1851ad admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:02.696725 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1398/2756] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:02:02 2021] POST /identity/v3/projects => generated 377 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:02:02.700851 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff351dbc-58e0-4cc0-9f1e-7d245c67572b None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:02.710915 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff351dbc-58e0-4cc0-9f1e-7d245c67572b None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:02.773269 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fcfa0-1b5e-47d7-9c50-b9d6b0222876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:02.773864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fcfa0-1b5e-47d7-9c50-b9d6b0222876 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:02.774149 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fcfa0-1b5e-47d7-9c50-b9d6b0222876 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:02.774420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fcfa0-1b5e-47d7-9c50-b9d6b0222876 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:02.775066 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fcfa0-1b5e-47d7-9c50-b9d6b0222876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:02.801740 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fcfa0-1b5e-47d7-9c50-b9d6b0222876 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:02.878441 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1359/2757] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:02:02 2021] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:02:02.883080 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542360a2-2d0a-4a65-97a7-162f2e1851ad admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:02.893744 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542360a2-2d0a-4a65-97a7-162f2e1851ad admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:02.898041 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64b42a-5f36-44f9-bfaa-629212d39d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:02.898634 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64b42a-5f36-44f9-bfaa-629212d39d17 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:02.898973 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64b42a-5f36-44f9-bfaa-629212d39d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:02.899238 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64b42a-5f36-44f9-bfaa-629212d39d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:02.899927 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64b42a-5f36-44f9-bfaa-629212d39d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:02.926888 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64b42a-5f36-44f9-bfaa-629212d39d17 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:02.939037 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1399/2758] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:02:02 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:02:02.943276 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fcfa0-1b5e-47d7-9c50-b9d6b0222876 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:02.953484 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fcfa0-1b5e-47d7-9c50-b9d6b0222876 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:02.957798 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1471e96-a495-46d5-96e8-2bf5044963fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:02.958630 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1471e96-a495-46d5-96e8-2bf5044963fc admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:02.958912 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1471e96-a495-46d5-96e8-2bf5044963fc admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:02.959193 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1471e96-a495-46d5-96e8-2bf5044963fc admin admin] PATH_INFO: `/v3/projects/d9a0fc9c0a384ccd993b86a546b51a8c/users/3e587da2fcae4b21a006a55a5e53ce24/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:02.979314 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1471e96-a495-46d5-96e8-2bf5044963fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a0fc9c0a384ccd993b86a546b51a8c, user_id=3e587da2fcae4b21a006a55a5e53ce24, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:03.005755 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1471e96-a495-46d5-96e8-2bf5044963fc admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:03.072193 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1360/2759] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:02:02 2021] PUT /identity/v3/projects/d9a0fc9c0a384ccd993b86a546b51a8c/users/3e587da2fcae4b21a006a55a5e53ce24/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:02:03.083748 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afff28-4c10-4016-b4b8-b66a41f4267e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:03.084067 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afff28-4c10-4016-b4b8-b66a41f4267e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:03.084321 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afff28-4c10-4016-b4b8-b66a41f4267e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:03.120204 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-45afff28-4c10-4016-b4b8-b66a41f4267e None None] MFA Rules not processed for user `3e587da2fcae4b21a006a55a5e53ce24`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:03.121420 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-45afff28-4c10-4016-b4b8-b66a41f4267e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:03.194669 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1400/2760] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:02:03 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:02:03.199095 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1471e96-a495-46d5-96e8-2bf5044963fc admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:03.267698 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1471e96-a495-46d5-96e8-2bf5044963fc admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:03.272067 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9482e6e-eae8-4b43-863a-3721c5f0f121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:03.272683 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9482e6e-eae8-4b43-863a-3721c5f0f121 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:03.272971 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9482e6e-eae8-4b43-863a-3721c5f0f121 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:03.273252 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9482e6e-eae8-4b43-863a-3721c5f0f121 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:03.273884 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9482e6e-eae8-4b43-863a-3721c5f0f121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:03.302179 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9482e6e-eae8-4b43-863a-3721c5f0f121 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:03.419008 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1361/2761] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:02:03 2021] POST /identity/v3/projects => generated 373 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:02:03.423038 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afff28-4c10-4016-b4b8-b66a41f4267e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:03.433471 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afff28-4c10-4016-b4b8-b66a41f4267e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:03.498920 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0316bf2-15a9-4d75-b36b-ddcedf8bdad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:03.499613 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0316bf2-15a9-4d75-b36b-ddcedf8bdad4 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:03.499910 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0316bf2-15a9-4d75-b36b-ddcedf8bdad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:03.500273 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0316bf2-15a9-4d75-b36b-ddcedf8bdad4 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:03.501059 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0316bf2-15a9-4d75-b36b-ddcedf8bdad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:03.527023 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0316bf2-15a9-4d75-b36b-ddcedf8bdad4 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:03.638039 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1401/2762] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:02:03 2021] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:02:03.642390 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9482e6e-eae8-4b43-863a-3721c5f0f121 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:03.652128 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9482e6e-eae8-4b43-863a-3721c5f0f121 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:03.656804 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e329f-53ba-4d60-a70f-479e69bf9cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:03.657394 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e329f-53ba-4d60-a70f-479e69bf9cef admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:03.657682 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e329f-53ba-4d60-a70f-479e69bf9cef admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:03.658315 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e329f-53ba-4d60-a70f-479e69bf9cef admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:03.659050 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e329f-53ba-4d60-a70f-479e69bf9cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:03.686699 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e329f-53ba-4d60-a70f-479e69bf9cef admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:03.698297 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1362/2763] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:02:03 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:02:03.702548 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0316bf2-15a9-4d75-b36b-ddcedf8bdad4 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:03.712555 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0316bf2-15a9-4d75-b36b-ddcedf8bdad4 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:03.716852 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c73c5f-f026-4556-9009-a61ce7b0e5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:03.717845 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c73c5f-f026-4556-9009-a61ce7b0e5e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:03.717958 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c73c5f-f026-4556-9009-a61ce7b0e5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:03.718219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c73c5f-f026-4556-9009-a61ce7b0e5e7 admin admin] PATH_INFO: `/v3/projects/8e9736ba073e41e8ac275e8007f9fc06/users/f9ebeba28a7a47c38843e41eed8a091d/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:03.740383 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c73c5f-f026-4556-9009-a61ce7b0e5e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9736ba073e41e8ac275e8007f9fc06, user_id=f9ebeba28a7a47c38843e41eed8a091d, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:03.767099 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c73c5f-f026-4556-9009-a61ce7b0e5e7 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:03.878720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1402/2764] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:02:03 2021] PUT /identity/v3/projects/8e9736ba073e41e8ac275e8007f9fc06/users/f9ebeba28a7a47c38843e41eed8a091d/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:02:03.882714 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e329f-53ba-4d60-a70f-479e69bf9cef admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:03.894158 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e329f-53ba-4d60-a70f-479e69bf9cef admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:03.961941 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7aef7-6908-466a-ad63-d45b50dbfa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:03.962452 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7aef7-6908-466a-ad63-d45b50dbfa0d admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:03.962736 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7aef7-6908-466a-ad63-d45b50dbfa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:03.963011 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7aef7-6908-466a-ad63-d45b50dbfa0d admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:03.963693 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7aef7-6908-466a-ad63-d45b50dbfa0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:03.989266 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7aef7-6908-466a-ad63-d45b50dbfa0d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:04.000144 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1363/2765] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:02:03 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:02:04.004228 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c73c5f-f026-4556-9009-a61ce7b0e5e7 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:04.013965 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c73c5f-f026-4556-9009-a61ce7b0e5e7 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:04.018309 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71cd36-8ce6-4a46-8a88-c9938b3a5c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:04.019231 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71cd36-8ce6-4a46-8a88-c9938b3a5c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:04.019526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71cd36-8ce6-4a46-8a88-c9938b3a5c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:04.019803 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71cd36-8ce6-4a46-8a88-c9938b3a5c8a admin admin] PATH_INFO: `/v3/projects/8e9736ba073e41e8ac275e8007f9fc06/users/f9ebeba28a7a47c38843e41eed8a091d/roles/56d36413cf4047229b6f9d36a3990b0d` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:04.021585 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71cd36-8ce6-4a46-8a88-c9938b3a5c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9736ba073e41e8ac275e8007f9fc06, user_id=f9ebeba28a7a47c38843e41eed8a091d, role_id=56d36413cf4047229b6f9d36a3990b0d)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:04.052171 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71cd36-8ce6-4a46-8a88-c9938b3a5c8a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:04.062852 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1403/2766] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:02:04 2021] PUT /identity/v3/projects/8e9736ba073e41e8ac275e8007f9fc06/users/f9ebeba28a7a47c38843e41eed8a091d/roles/56d36413cf4047229b6f9d36a3990b0d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:02:04.067294 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7aef7-6908-466a-ad63-d45b50dbfa0d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:04.076828 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7aef7-6908-466a-ad63-d45b50dbfa0d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:04.143300 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019bdcd-239a-4c9e-a727-b30d69fea632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:04.143924 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019bdcd-239a-4c9e-a727-b30d69fea632 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:04.144236 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019bdcd-239a-4c9e-a727-b30d69fea632 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:04.144540 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019bdcd-239a-4c9e-a727-b30d69fea632 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:04.145299 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019bdcd-239a-4c9e-a727-b30d69fea632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:04.170721 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019bdcd-239a-4c9e-a727-b30d69fea632 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:04.181625 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1364/2767] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:02:04 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:02:04.186474 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71cd36-8ce6-4a46-8a88-c9938b3a5c8a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:04.196958 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71cd36-8ce6-4a46-8a88-c9938b3a5c8a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:04.201626 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea18092-e917-4bab-8f22-892c0696b145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:04.202713 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea18092-e917-4bab-8f22-892c0696b145 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:04.203004 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea18092-e917-4bab-8f22-892c0696b145 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:04.203371 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea18092-e917-4bab-8f22-892c0696b145 admin admin] PATH_INFO: `/v3/projects/8e9736ba073e41e8ac275e8007f9fc06/users/f9ebeba28a7a47c38843e41eed8a091d/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:04.205346 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea18092-e917-4bab-8f22-892c0696b145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9736ba073e41e8ac275e8007f9fc06, user_id=f9ebeba28a7a47c38843e41eed8a091d, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:04.232145 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea18092-e917-4bab-8f22-892c0696b145 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:04.302186 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1404/2768] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:02:04 2021] PUT /identity/v3/projects/8e9736ba073e41e8ac275e8007f9fc06/users/f9ebeba28a7a47c38843e41eed8a091d/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:02:04.312830 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eab296-fcc7-4ce5-b988-2e00ab777fb6 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:04.313124 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eab296-fcc7-4ce5-b988-2e00ab777fb6 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:04.313408 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eab296-fcc7-4ce5-b988-2e00ab777fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:04.350293 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-25eab296-fcc7-4ce5-b988-2e00ab777fb6 None None] MFA Rules not processed for user `f9ebeba28a7a47c38843e41eed8a091d`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:04.351452 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-25eab296-fcc7-4ce5-b988-2e00ab777fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:04.431088 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1365/2769] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:02:04 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:02:04.444905 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea18092-e917-4bab-8f22-892c0696b145 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:04.446546 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-1ea18092-e917-4bab-8f22-892c0696b145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:04.510847 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea18092-e917-4bab-8f22-892c0696b145 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:04.514285 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591f09c-31e9-4c73-a82c-ffcd71444519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:04.514884 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591f09c-31e9-4c73-a82c-ffcd71444519 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:04.515167 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591f09c-31e9-4c73-a82c-ffcd71444519 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:04.515443 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591f09c-31e9-4c73-a82c-ffcd71444519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:04.579074 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591f09c-31e9-4c73-a82c-ffcd71444519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:04.605618 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591f09c-31e9-4c73-a82c-ffcd71444519 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:04.615403 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1405/2770] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:02:04 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:02:06.815312 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eab296-fcc7-4ce5-b988-2e00ab777fb6 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:06.824547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eab296-fcc7-4ce5-b988-2e00ab777fb6 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:06.828455 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd85f5-ac69-44b5-b6ba-f220e3bd4a97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:06.829038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd85f5-ac69-44b5-b6ba-f220e3bd4a97 service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:06.829322 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd85f5-ac69-44b5-b6ba-f220e3bd4a97 service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:06.829601 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd85f5-ac69-44b5-b6ba-f220e3bd4a97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:06.891111 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd85f5-ac69-44b5-b6ba-f220e3bd4a97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:06.916830 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd85f5-ac69-44b5-b6ba-f220e3bd4a97 service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:06.926028 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1366/2771] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:02:06 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:02:08.252709 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591f09c-31e9-4c73-a82c-ffcd71444519 service cinder] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:08.261171 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591f09c-31e9-4c73-a82c-ffcd71444519 service cinder] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:08.265126 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da45619-e5ad-4840-81df-cdc3c8dbd231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:08.265701 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da45619-e5ad-4840-81df-cdc3c8dbd231 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:08.265986 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da45619-e5ad-4840-81df-cdc3c8dbd231 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:08.266262 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da45619-e5ad-4840-81df-cdc3c8dbd231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:08.274988 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da45619-e5ad-4840-81df-cdc3c8dbd231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:08.300595 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da45619-e5ad-4840-81df-cdc3c8dbd231 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:08.311020 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1406/2772] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:02:08 2021] GET /identity/v3/auth/tokens => generated 3747 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:02:13.860249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd85f5-ac69-44b5-b6ba-f220e3bd4a97 service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:13.930374 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd85f5-ac69-44b5-b6ba-f220e3bd4a97 service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:13.934675 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92238542-4b6c-4041-b7b0-87642114abd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:13.935466 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92238542-4b6c-4041-b7b0-87642114abd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:13.935753 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92238542-4b6c-4041-b7b0-87642114abd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:13.936033 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92238542-4b6c-4041-b7b0-87642114abd4 admin admin] PATH_INFO: `/v3/users/5a0ce61798f046639b887d5c80a503b8` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:13.937186 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92238542-4b6c-4041-b7b0-87642114abd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a0ce61798f046639b887d5c80a503b8)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:13.962754 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92238542-4b6c-4041-b7b0-87642114abd4 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:14.130429 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-92238542-4b6c-4041-b7b0-87642114abd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a0ce61798f046639b887d5c80a503b8'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:14.208534 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-92238542-4b6c-4041-b7b0-87642114abd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a0ce61798f046639b887d5c80a503b8'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:14.209191 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-92238542-4b6c-4041-b7b0-87642114abd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a0ce61798f046639b887d5c80a503b8'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:14.218266 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-92238542-4b6c-4041-b7b0-87642114abd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a0ce61798f046639b887d5c80a503b8'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:14.218872 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-92238542-4b6c-4041-b7b0-87642114abd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a0ce61798f046639b887d5c80a503b8'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:14.236064 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1367/2773] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:02:13 2021] DELETE /identity/v3/users/5a0ce61798f046639b887d5c80a503b8 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:02:14.240997 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d8ddb-62b0-45a9-b4c3-65fa4c7ca73a None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:14.241589 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d8ddb-62b0-45a9-b4c3-65fa4c7ca73a None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:14.241589 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d8ddb-62b0-45a9-b4c3-65fa4c7ca73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:14.265532 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-299d8ddb-62b0-45a9-b4c3-65fa4c7ca73a None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:14.266798 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-299d8ddb-62b0-45a9-b4c3-65fa4c7ca73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:14.339367 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1407/2774] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:02:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 02:02:14.350226 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92238542-4b6c-4041-b7b0-87642114abd4 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:14.351637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-92238542-4b6c-4041-b7b0-87642114abd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:14.420401 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92238542-4b6c-4041-b7b0-87642114abd4 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:14.424154 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a7c20-7e14-4c0b-8318-fd079bc74094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:14.425037 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a7c20-7e14-4c0b-8318-fd079bc74094 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:14.425324 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a7c20-7e14-4c0b-8318-fd079bc74094 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:14.425718 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a7c20-7e14-4c0b-8318-fd079bc74094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:14.434979 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a7c20-7e14-4c0b-8318-fd079bc74094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:14.465756 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a7c20-7e14-4c0b-8318-fd079bc74094 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:14.482857 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1368/2775] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:02:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:02:14.949473 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d8ddb-62b0-45a9-b4c3-65fa4c7ca73a None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:14.950818 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-299d8ddb-62b0-45a9-b4c3-65fa4c7ca73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:14.965046 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d8ddb-62b0-45a9-b4c3-65fa4c7ca73a None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:14.968816 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a0a69-f55b-49bc-ad97-5046afce0391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:14.969596 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a0a69-f55b-49bc-ad97-5046afce0391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:14.969888 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a0a69-f55b-49bc-ad97-5046afce0391 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:14.970174 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a0a69-f55b-49bc-ad97-5046afce0391 admin admin] PATH_INFO: `/v3/projects/21221e18cb104ffd823ab49ef5c69ecc` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:14.971339 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a0a69-f55b-49bc-ad97-5046afce0391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21221e18cb104ffd823ab49ef5c69ecc)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:14.998367 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a0a69-f55b-49bc-ad97-5046afce0391 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:15.141876 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ed2a0a69-f55b-49bc-ad97-5046afce0391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21221e18cb104ffd823ab49ef5c69ecc', 'request_id': 'req-ed2a0a69-f55b-49bc-ad97-5046afce0391'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:15.147463 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ed2a0a69-f55b-49bc-ad97-5046afce0391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21221e18cb104ffd823ab49ef5c69ecc', 'request_id': 'req-ed2a0a69-f55b-49bc-ad97-5046afce0391'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:15.159805 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ed2a0a69-f55b-49bc-ad97-5046afce0391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21221e18cb104ffd823ab49ef5c69ecc', 'request_id': 'req-ed2a0a69-f55b-49bc-ad97-5046afce0391'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:15.250242 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ed2a0a69-f55b-49bc-ad97-5046afce0391 admin admin] The token cache is being invalidate because project 21221e18cb104ffd823ab49ef5c69ecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:02:15.250878 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ed2a0a69-f55b-49bc-ad97-5046afce0391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:15.251265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-ed2a0a69-f55b-49bc-ad97-5046afce0391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:15.253058 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1408/2776] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:02:14 2021] DELETE /identity/v3/projects/21221e18cb104ffd823ab49ef5c69ecc => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:02:15.257046 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a7c20-7e14-4c0b-8318-fd079bc74094 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:15.268103 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a7c20-7e14-4c0b-8318-fd079bc74094 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:15.355663 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a159b10-08c0-4980-90a4-c56ea732fc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:15.357420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a159b10-08c0-4980-90a4-c56ea732fc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:15.358616 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a159b10-08c0-4980-90a4-c56ea732fc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:15.359185 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a159b10-08c0-4980-90a4-c56ea732fc44 admin admin] PATH_INFO: `/v3/users/3e587da2fcae4b21a006a55a5e53ce24` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:15.361760 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a159b10-08c0-4980-90a4-c56ea732fc44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e587da2fcae4b21a006a55a5e53ce24)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:15.393563 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a159b10-08c0-4980-90a4-c56ea732fc44 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:15.555403 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-4a159b10-08c0-4980-90a4-c56ea732fc44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e587da2fcae4b21a006a55a5e53ce24'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:15.649224 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-4a159b10-08c0-4980-90a4-c56ea732fc44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e587da2fcae4b21a006a55a5e53ce24'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:15.649656 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-4a159b10-08c0-4980-90a4-c56ea732fc44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e587da2fcae4b21a006a55a5e53ce24'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:15.658553 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-4a159b10-08c0-4980-90a4-c56ea732fc44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e587da2fcae4b21a006a55a5e53ce24'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:15.659186 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-4a159b10-08c0-4980-90a4-c56ea732fc44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e587da2fcae4b21a006a55a5e53ce24'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:15.676844 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1369/2777] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:02:15 2021] DELETE /identity/v3/users/3e587da2fcae4b21a006a55a5e53ce24 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:02:16.439194 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a0a69-f55b-49bc-ad97-5046afce0391 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:16.441409 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ed2a0a69-f55b-49bc-ad97-5046afce0391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:16.457469 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a0a69-f55b-49bc-ad97-5046afce0391 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:16.525463 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf572002-c446-4bf6-914c-8bd0ae08d7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:16.526247 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf572002-c446-4bf6-914c-8bd0ae08d7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:16.526526 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf572002-c446-4bf6-914c-8bd0ae08d7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:16.526799 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf572002-c446-4bf6-914c-8bd0ae08d7fb admin admin] PATH_INFO: `/v3/projects/d9a0fc9c0a384ccd993b86a546b51a8c` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:16.527867 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf572002-c446-4bf6-914c-8bd0ae08d7fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a0fc9c0a384ccd993b86a546b51a8c)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:16.554604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf572002-c446-4bf6-914c-8bd0ae08d7fb admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:16.700676 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-bf572002-c446-4bf6-914c-8bd0ae08d7fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a0fc9c0a384ccd993b86a546b51a8c', 'request_id': 'req-bf572002-c446-4bf6-914c-8bd0ae08d7fb'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:16.706025 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-bf572002-c446-4bf6-914c-8bd0ae08d7fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a0fc9c0a384ccd993b86a546b51a8c', 'request_id': 'req-bf572002-c446-4bf6-914c-8bd0ae08d7fb'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:16.718203 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-bf572002-c446-4bf6-914c-8bd0ae08d7fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a0fc9c0a384ccd993b86a546b51a8c', 'request_id': 'req-bf572002-c446-4bf6-914c-8bd0ae08d7fb'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:16.798921 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-bf572002-c446-4bf6-914c-8bd0ae08d7fb admin admin] The token cache is being invalidate because project d9a0fc9c0a384ccd993b86a546b51a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:02:16.799207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-bf572002-c446-4bf6-914c-8bd0ae08d7fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:16.800119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-bf572002-c446-4bf6-914c-8bd0ae08d7fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:16.801831 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1409/2778] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:02:16 2021] DELETE /identity/v3/projects/d9a0fc9c0a384ccd993b86a546b51a8c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:02:16.805606 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a159b10-08c0-4980-90a4-c56ea732fc44 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:16.807265 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-4a159b10-08c0-4980-90a4-c56ea732fc44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:16.820417 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a159b10-08c0-4980-90a4-c56ea732fc44 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:16.918210 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6093a75-2916-4c03-9ffa-32227704f89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:16.919048 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6093a75-2916-4c03-9ffa-32227704f89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:16.919338 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6093a75-2916-4c03-9ffa-32227704f89c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:16.919613 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6093a75-2916-4c03-9ffa-32227704f89c admin admin] PATH_INFO: `/v3/users/f9ebeba28a7a47c38843e41eed8a091d` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:16.920831 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6093a75-2916-4c03-9ffa-32227704f89c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ebeba28a7a47c38843e41eed8a091d)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:16.947670 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6093a75-2916-4c03-9ffa-32227704f89c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:17.125800 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d6093a75-2916-4c03-9ffa-32227704f89c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ebeba28a7a47c38843e41eed8a091d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:17.203078 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d6093a75-2916-4c03-9ffa-32227704f89c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ebeba28a7a47c38843e41eed8a091d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:17.207202 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d6093a75-2916-4c03-9ffa-32227704f89c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ebeba28a7a47c38843e41eed8a091d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:17.212112 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d6093a75-2916-4c03-9ffa-32227704f89c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ebeba28a7a47c38843e41eed8a091d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:17.212766 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-d6093a75-2916-4c03-9ffa-32227704f89c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ebeba28a7a47c38843e41eed8a091d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:17.229790 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1370/2779] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:02:16 2021] DELETE /identity/v3/users/f9ebeba28a7a47c38843e41eed8a091d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:02:17.733064 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf572002-c446-4bf6-914c-8bd0ae08d7fb admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:17.735466 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-bf572002-c446-4bf6-914c-8bd0ae08d7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:17.747748 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf572002-c446-4bf6-914c-8bd0ae08d7fb admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:17.809374 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bb03b-465c-4a1e-a179-77bcb5c07aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:17.810213 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bb03b-465c-4a1e-a179-77bcb5c07aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:17.810499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bb03b-465c-4a1e-a179-77bcb5c07aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:17.810777 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bb03b-465c-4a1e-a179-77bcb5c07aa5 admin admin] PATH_INFO: `/v3/projects/8e9736ba073e41e8ac275e8007f9fc06` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:17.811877 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bb03b-465c-4a1e-a179-77bcb5c07aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e9736ba073e41e8ac275e8007f9fc06)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:17.837474 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bb03b-465c-4a1e-a179-77bcb5c07aa5 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:17.923271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0d7bb03b-465c-4a1e-a179-77bcb5c07aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e9736ba073e41e8ac275e8007f9fc06', 'request_id': 'req-0d7bb03b-465c-4a1e-a179-77bcb5c07aa5'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:17.928712 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0d7bb03b-465c-4a1e-a179-77bcb5c07aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e9736ba073e41e8ac275e8007f9fc06', 'request_id': 'req-0d7bb03b-465c-4a1e-a179-77bcb5c07aa5'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:17.940092 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0d7bb03b-465c-4a1e-a179-77bcb5c07aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e9736ba073e41e8ac275e8007f9fc06', 'request_id': 'req-0d7bb03b-465c-4a1e-a179-77bcb5c07aa5'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:18.042465 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0d7bb03b-465c-4a1e-a179-77bcb5c07aa5 admin admin] The token cache is being invalidate because project 8e9736ba073e41e8ac275e8007f9fc06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:02:18.042681 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0d7bb03b-465c-4a1e-a179-77bcb5c07aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:18.043250 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-0d7bb03b-465c-4a1e-a179-77bcb5c07aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:18.044699 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1410/2780] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:02:17 2021] DELETE /identity/v3/projects/8e9736ba073e41e8ac275e8007f9fc06 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:02:18.050629 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad507c-0f7f-43d7-b153-a66e189eeba0 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:18.051118 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad507c-0f7f-43d7-b153-a66e189eeba0 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:18.051226 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad507c-0f7f-43d7-b153-a66e189eeba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:18.072864 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-21ad507c-0f7f-43d7-b153-a66e189eeba0 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:18.074004 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-21ad507c-0f7f-43d7-b153-a66e189eeba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:18.136819 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1371/2781] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:02:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:02:18.145160 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a162a18-3ef0-4dd8-89f2-7babc89d2a8e None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:18.152044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a162a18-3ef0-4dd8-89f2-7babc89d2a8e None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:18.152044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a162a18-3ef0-4dd8-89f2-7babc89d2a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:18.168154 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-6a162a18-3ef0-4dd8-89f2-7babc89d2a8e None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:18.169336 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-6a162a18-3ef0-4dd8-89f2-7babc89d2a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:18.177166 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1411/2782] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:02:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:02:18.181369 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad507c-0f7f-43d7-b153-a66e189eeba0 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:18.190523 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad507c-0f7f-43d7-b153-a66e189eeba0 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:18.194968 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbe608-113c-49db-8a9c-a569b100c5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:18.195549 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbe608-113c-49db-8a9c-a569b100c5fd admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:18.195853 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbe608-113c-49db-8a9c-a569b100c5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:18.196121 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbe608-113c-49db-8a9c-a569b100c5fd admin admin] PATH_INFO: `/v3/domains` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:18.196835 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbe608-113c-49db-8a9c-a569b100c5fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 02:02:18.197135 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbe608-113c-49db-8a9c-a569b100c5fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:18.223467 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbe608-113c-49db-8a9c-a569b100c5fd admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:18.236936 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1372/2783] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 02:02:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 02:02:18.241322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a162a18-3ef0-4dd8-89f2-7babc89d2a8e None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:18.250225 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a162a18-3ef0-4dd8-89f2-7babc89d2a8e None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:18.256527 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060939c3-5e25-4fa8-9ccb-9f5b5c5982af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:18.257224 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060939c3-5e25-4fa8-9ccb-9f5b5c5982af admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:18.257577 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060939c3-5e25-4fa8-9ccb-9f5b5c5982af admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:18.257945 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060939c3-5e25-4fa8-9ccb-9f5b5c5982af admin admin] PATH_INFO: `/v3/projects` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:18.258649 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060939c3-5e25-4fa8-9ccb-9f5b5c5982af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:18.285453 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060939c3-5e25-4fa8-9ccb-9f5b5c5982af admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:18.421759 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1412/2784] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:02:18 2021] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:02:18.431521 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbe608-113c-49db-8a9c-a569b100c5fd admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:18.438058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbe608-113c-49db-8a9c-a569b100c5fd admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:18.502088 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231fb0c-1651-453e-8bc2-3f0ea19f9a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:18.502675 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231fb0c-1651-453e-8bc2-3f0ea19f9a05 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:18.502956 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231fb0c-1651-453e-8bc2-3f0ea19f9a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:18.503229 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231fb0c-1651-453e-8bc2-3f0ea19f9a05 admin admin] PATH_INFO: `/v3/users` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:18.503843 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231fb0c-1651-453e-8bc2-3f0ea19f9a05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:18.529552 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231fb0c-1651-453e-8bc2-3f0ea19f9a05 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:18.613913 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1373/2785] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:02:18 2021] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:02:18.617914 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060939c3-5e25-4fa8-9ccb-9f5b5c5982af admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:18.628298 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060939c3-5e25-4fa8-9ccb-9f5b5c5982af admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:18.632713 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a85b07-7421-4325-bff0-9a9c7b0564d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:18.633296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a85b07-7421-4325-bff0-9a9c7b0564d0 admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:18.633585 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a85b07-7421-4325-bff0-9a9c7b0564d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:18.633894 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a85b07-7421-4325-bff0-9a9c7b0564d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:18.634579 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a85b07-7421-4325-bff0-9a9c7b0564d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:18.661001 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a85b07-7421-4325-bff0-9a9c7b0564d0 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:18.671499 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1413/2786] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:02:18 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:02:18.676142 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231fb0c-1651-453e-8bc2-3f0ea19f9a05 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:18.685940 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231fb0c-1651-453e-8bc2-3f0ea19f9a05 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:18.689992 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b3452-591f-411e-ae6c-36d2c5ee4e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:18.690792 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b3452-591f-411e-ae6c-36d2c5ee4e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:18.691068 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b3452-591f-411e-ae6c-36d2c5ee4e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:18.691346 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b3452-591f-411e-ae6c-36d2c5ee4e5c admin admin] PATH_INFO: `/v3/projects/4482f8636835433fbd2e6018d6d97ed2/users/f4a4626ec1a244f9a48e03cdd4d6a59a/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:18.800140 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b3452-591f-411e-ae6c-36d2c5ee4e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4482f8636835433fbd2e6018d6d97ed2, user_id=f4a4626ec1a244f9a48e03cdd4d6a59a, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:18.826848 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b3452-591f-411e-ae6c-36d2c5ee4e5c admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:18.899674 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1374/2787] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:02:18 2021] PUT /identity/v3/projects/4482f8636835433fbd2e6018d6d97ed2/users/f4a4626ec1a244f9a48e03cdd4d6a59a/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:02:18.910474 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52374102-bb75-45ee-8038-107d60fb84dd None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:18.910973 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52374102-bb75-45ee-8038-107d60fb84dd None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:18.911083 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52374102-bb75-45ee-8038-107d60fb84dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:18.948256 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-52374102-bb75-45ee-8038-107d60fb84dd None None] MFA Rules not processed for user `f4a4626ec1a244f9a48e03cdd4d6a59a`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:18.949420 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-52374102-bb75-45ee-8038-107d60fb84dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:19.019803 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1414/2788] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:02:18 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:02:19.031005 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b3452-591f-411e-ae6c-36d2c5ee4e5c admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:19.032686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-233b3452-591f-411e-ae6c-36d2c5ee4e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:19.110746 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b3452-591f-411e-ae6c-36d2c5ee4e5c admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:19.114171 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1243339-3254-4d79-8e1d-5413b34c94fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:19.114742 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1243339-3254-4d79-8e1d-5413b34c94fa service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:19.115035 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1243339-3254-4d79-8e1d-5413b34c94fa service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:19.115316 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1243339-3254-4d79-8e1d-5413b34c94fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:19.123322 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1243339-3254-4d79-8e1d-5413b34c94fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:19.147931 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1243339-3254-4d79-8e1d-5413b34c94fa service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:19.156934 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1375/2789] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:02:19 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:02:19.179335 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52374102-bb75-45ee-8038-107d60fb84dd None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:19.246016 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52374102-bb75-45ee-8038-107d60fb84dd None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:19.250114 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ade607-f11d-4538-8a17-07380926f12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:19.250905 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ade607-f11d-4538-8a17-07380926f12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:19.251189 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ade607-f11d-4538-8a17-07380926f12e admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:19.251469 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ade607-f11d-4538-8a17-07380926f12e admin admin] PATH_INFO: `/v3/users/f4a4626ec1a244f9a48e03cdd4d6a59a` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:19.252546 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ade607-f11d-4538-8a17-07380926f12e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a4626ec1a244f9a48e03cdd4d6a59a)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:19.278846 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ade607-f11d-4538-8a17-07380926f12e admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:19.496037 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-c1ade607-f11d-4538-8a17-07380926f12e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a4626ec1a244f9a48e03cdd4d6a59a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:19.496906 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-c1ade607-f11d-4538-8a17-07380926f12e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a4626ec1a244f9a48e03cdd4d6a59a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:19.597322 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-c1ade607-f11d-4538-8a17-07380926f12e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a4626ec1a244f9a48e03cdd4d6a59a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:19.605439 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-c1ade607-f11d-4538-8a17-07380926f12e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a4626ec1a244f9a48e03cdd4d6a59a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:19.606072 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-c1ade607-f11d-4538-8a17-07380926f12e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a4626ec1a244f9a48e03cdd4d6a59a'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:19.627219 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1415/2790] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:02:19 2021] DELETE /identity/v3/users/f4a4626ec1a244f9a48e03cdd4d6a59a => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:02:19.628958 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3d82a-1bbc-43a1-a91f-8c5ec58aaa61 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:19.629252 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3d82a-1bbc-43a1-a91f-8c5ec58aaa61 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:19.629531 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3d82a-1bbc-43a1-a91f-8c5ec58aaa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:19.651497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-a7d3d82a-1bbc-43a1-a91f-8c5ec58aaa61 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:19.654644 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a7d3d82a-1bbc-43a1-a91f-8c5ec58aaa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:19.723355 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1376/2791] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:02:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 02:02:19.732545 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ade607-f11d-4538-8a17-07380926f12e admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:19.734119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c1ade607-f11d-4538-8a17-07380926f12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:19.796233 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ade607-f11d-4538-8a17-07380926f12e admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:19.799770 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e81b80-3e3f-4ac3-b2a1-cf93fdb1024e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:19.800342 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e81b80-3e3f-4ac3-b2a1-cf93fdb1024e service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:19.800658 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e81b80-3e3f-4ac3-b2a1-cf93fdb1024e service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:19.800943 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e81b80-3e3f-4ac3-b2a1-cf93fdb1024e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:19.809471 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e81b80-3e3f-4ac3-b2a1-cf93fdb1024e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:19.834360 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e81b80-3e3f-4ac3-b2a1-cf93fdb1024e service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:19.843687 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1416/2792] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:02:19 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:02:20.344829 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3d82a-1bbc-43a1-a91f-8c5ec58aaa61 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:20.346298 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a7d3d82a-1bbc-43a1-a91f-8c5ec58aaa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:20.357880 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3d82a-1bbc-43a1-a91f-8c5ec58aaa61 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:20.362760 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bdb00-9f19-4e5c-81f5-9ef0460f4bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:20.363131 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bdb00-9f19-4e5c-81f5-9ef0460f4bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:20.363459 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bdb00-9f19-4e5c-81f5-9ef0460f4bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:20.364261 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bdb00-9f19-4e5c-81f5-9ef0460f4bfa admin admin] PATH_INFO: `/v3/projects/4482f8636835433fbd2e6018d6d97ed2` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:20.365384 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bdb00-9f19-4e5c-81f5-9ef0460f4bfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4482f8636835433fbd2e6018d6d97ed2)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:20.391685 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bdb00-9f19-4e5c-81f5-9ef0460f4bfa admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:20.517763 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fe4bdb00-9f19-4e5c-81f5-9ef0460f4bfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4482f8636835433fbd2e6018d6d97ed2', 'request_id': 'req-fe4bdb00-9f19-4e5c-81f5-9ef0460f4bfa'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:20.522688 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fe4bdb00-9f19-4e5c-81f5-9ef0460f4bfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4482f8636835433fbd2e6018d6d97ed2', 'request_id': 'req-fe4bdb00-9f19-4e5c-81f5-9ef0460f4bfa'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:20.534058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fe4bdb00-9f19-4e5c-81f5-9ef0460f4bfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4482f8636835433fbd2e6018d6d97ed2', 'request_id': 'req-fe4bdb00-9f19-4e5c-81f5-9ef0460f4bfa'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:20.619240 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fe4bdb00-9f19-4e5c-81f5-9ef0460f4bfa admin admin] The token cache is being invalidate because project 4482f8636835433fbd2e6018d6d97ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:02:20.619470 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fe4bdb00-9f19-4e5c-81f5-9ef0460f4bfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:20.620071 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-fe4bdb00-9f19-4e5c-81f5-9ef0460f4bfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:20.621642 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1377/2793] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:02:20 2021] DELETE /identity/v3/projects/4482f8636835433fbd2e6018d6d97ed2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:02:20.628158 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443e226-399a-43eb-af45-245ed4539ea2 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:20.628648 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443e226-399a-43eb-af45-245ed4539ea2 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:20.628782 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443e226-399a-43eb-af45-245ed4539ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:20.651339 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-8443e226-399a-43eb-af45-245ed4539ea2 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:20.652463 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-8443e226-399a-43eb-af45-245ed4539ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:20.715720 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1417/2794] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:02:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 02:02:20.723093 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675d18c-669b-4494-855b-e5c993af9c14 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:20.723395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675d18c-669b-4494-855b-e5c993af9c14 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:20.723717 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675d18c-669b-4494-855b-e5c993af9c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:20.745931 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-5675d18c-669b-4494-855b-e5c993af9c14 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:20.747627 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5675d18c-669b-4494-855b-e5c993af9c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:20.754739 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1378/2795] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:02:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:02:20.759112 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443e226-399a-43eb-af45-245ed4539ea2 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:20.769053 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443e226-399a-43eb-af45-245ed4539ea2 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:20.773223 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7fccf-4334-46f0-b9b7-3792c2a45e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:20.773827 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7fccf-4334-46f0-b9b7-3792c2a45e5a admin admin] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:20.774111 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7fccf-4334-46f0-b9b7-3792c2a45e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:20.774387 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7fccf-4334-46f0-b9b7-3792c2a45e5a admin admin] PATH_INFO: `/v3/domains` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:20.775055 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7fccf-4334-46f0-b9b7-3792c2a45e5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=60176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Aug 23 02:02:20.775350 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7fccf-4334-46f0-b9b7-3792c2a45e5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:20.800714 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7fccf-4334-46f0-b9b7-3792c2a45e5a admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:20.814220 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1418/2796] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 23 02:02:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 02:02:20.818626 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675d18c-669b-4494-855b-e5c993af9c14 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:20.827977 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675d18c-669b-4494-855b-e5c993af9c14 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:20.832350 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f2285-c1c5-4912-b898-b3b4ead771a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:20.832959 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f2285-c1c5-4912-b898-b3b4ead771a1 admin admin] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:20.833241 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f2285-c1c5-4912-b898-b3b4ead771a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:20.833520 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f2285-c1c5-4912-b898-b3b4ead771a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:20.834153 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f2285-c1c5-4912-b898-b3b4ead771a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:20.859492 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f2285-c1c5-4912-b898-b3b4ead771a1 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:20.975950 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1379/2797] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 23 02:02:20 2021] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 02:02:20.979994 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7fccf-4334-46f0-b9b7-3792c2a45e5a admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:20.989999 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7fccf-4334-46f0-b9b7-3792c2a45e5a admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:21.050788 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3141ea3-1ee5-41fc-8748-12c02c8c0758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:21.051384 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3141ea3-1ee5-41fc-8748-12c02c8c0758 admin admin] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:21.051677 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3141ea3-1ee5-41fc-8748-12c02c8c0758 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:21.051963 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3141ea3-1ee5-41fc-8748-12c02c8c0758 admin admin] PATH_INFO: `/v3/users` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:21.052608 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3141ea3-1ee5-41fc-8748-12c02c8c0758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:21.078426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3141ea3-1ee5-41fc-8748-12c02c8c0758 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:21.220019 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1419/2798] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 23 02:02:20 2021] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 02:02:21.223830 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f2285-c1c5-4912-b898-b3b4ead771a1 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:21.234010 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f2285-c1c5-4912-b898-b3b4ead771a1 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:21.238153 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e770b09-e011-4837-8872-2e99810256c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:21.238734 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e770b09-e011-4837-8872-2e99810256c6 admin admin] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:21.239025 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e770b09-e011-4837-8872-2e99810256c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:21.239307 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e770b09-e011-4837-8872-2e99810256c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:21.240026 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e770b09-e011-4837-8872-2e99810256c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:21.265684 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e770b09-e011-4837-8872-2e99810256c6 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:21.275554 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1380/2799] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 23 02:02:21 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 02:02:21.280126 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3141ea3-1ee5-41fc-8748-12c02c8c0758 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:21.289554 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3141ea3-1ee5-41fc-8748-12c02c8c0758 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:21.293709 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1c627-5a83-4736-857e-188962fdcc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:21.299730 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1c627-5a83-4736-857e-188962fdcc95 admin admin] REQUEST_METHOD: `PUT` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:21.299730 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1c627-5a83-4736-857e-188962fdcc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:21.299730 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1c627-5a83-4736-857e-188962fdcc95 admin admin] PATH_INFO: `/v3/projects/03cc0e1cecad4a74a3bbaea883d6959c/users/d4c66426ba78437bb03ff9e16eaa23eb/roles/fafc5ecb5c074178be50f3c8d8006db2` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:21.316672 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1c627-5a83-4736-857e-188962fdcc95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03cc0e1cecad4a74a3bbaea883d6959c, user_id=d4c66426ba78437bb03ff9e16eaa23eb, role_id=fafc5ecb5c074178be50f3c8d8006db2)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:21.343296 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1c627-5a83-4736-857e-188962fdcc95 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:21.459971 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1420/2800] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 23 02:02:21 2021] PUT /identity/v3/projects/03cc0e1cecad4a74a3bbaea883d6959c/users/d4c66426ba78437bb03ff9e16eaa23eb/roles/fafc5ecb5c074178be50f3c8d8006db2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:02:21.470551 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297e2a9-4345-4c48-aef9-eacbe40fd9eb None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:21.471052 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297e2a9-4345-4c48-aef9-eacbe40fd9eb None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:21.471165 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297e2a9-4345-4c48-aef9-eacbe40fd9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:21.506685 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-9297e2a9-4345-4c48-aef9-eacbe40fd9eb None None] MFA Rules not processed for user `d4c66426ba78437bb03ff9e16eaa23eb`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:21.507859 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-9297e2a9-4345-4c48-aef9-eacbe40fd9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:21.578638 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1381/2801] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:02:21 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:02:21.587896 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1c627-5a83-4736-857e-188962fdcc95 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:21.589473 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c7f1c627-5a83-4736-857e-188962fdcc95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:21.652207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1c627-5a83-4736-857e-188962fdcc95 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:21.656191 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cc887-47fd-48b8-91e6-6c0c10533c25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:21.656797 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cc887-47fd-48b8-91e6-6c0c10533c25 service cinder] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:21.657095 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cc887-47fd-48b8-91e6-6c0c10533c25 service cinder] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:21.657364 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cc887-47fd-48b8-91e6-6c0c10533c25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:21.665344 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cc887-47fd-48b8-91e6-6c0c10533c25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:21.690292 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cc887-47fd-48b8-91e6-6c0c10533c25 service cinder] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:21.698571 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1421/2802] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:02:21 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:02:23.518985 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc4487-769a-457a-a8aa-b60de5ee4933 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:23.519494 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc4487-769a-457a-a8aa-b60de5ee4933 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:23.519600 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc4487-769a-457a-a8aa-b60de5ee4933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:23.541120 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-6dbc4487-769a-457a-a8aa-b60de5ee4933 None None] MFA Rules not processed for user `d4c66426ba78437bb03ff9e16eaa23eb`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:23.542249 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-6dbc4487-769a-457a-a8aa-b60de5ee4933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:23.548301 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1382/2803] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:02:23 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:02:31.320463 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546beb72-0883-416a-9396-c0b72ab8f7fa None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:31.321002 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546beb72-0883-416a-9396-c0b72ab8f7fa None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:31.321002 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546beb72-0883-416a-9396-c0b72ab8f7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:31.343641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-546beb72-0883-416a-9396-c0b72ab8f7fa None None] MFA Rules not processed for user `9a8e4253a98b44659801d40e83cf8f75`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:31.344884 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-546beb72-0883-416a-9396-c0b72ab8f7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:31.405926 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1422/2804] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:02:31 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:02:32.880759 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc4487-769a-457a-a8aa-b60de5ee4933 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:32.882075 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-6dbc4487-769a-457a-a8aa-b60de5ee4933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:32.949056 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc4487-769a-457a-a8aa-b60de5ee4933 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:32.952767 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347898dd-ebd2-49b6-bc75-7dacb80a5c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:32.953401 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347898dd-ebd2-49b6-bc75-7dacb80a5c9d service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:32.953753 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347898dd-ebd2-49b6-bc75-7dacb80a5c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:32.954111 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347898dd-ebd2-49b6-bc75-7dacb80a5c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:32.955808 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-347898dd-ebd2-49b6-bc75-7dacb80a5c9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:33.035876 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347898dd-ebd2-49b6-bc75-7dacb80a5c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:33.062415 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347898dd-ebd2-49b6-bc75-7dacb80a5c9d service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:33.072060 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1383/2805] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:02:32 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:02:41.638650 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546beb72-0883-416a-9396-c0b72ab8f7fa None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:41.648222 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546beb72-0883-416a-9396-c0b72ab8f7fa None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:41.651566 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8a374-516f-471f-bd48-863fb9b3bbad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:41.652135 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8a374-516f-471f-bd48-863fb9b3bbad service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:41.652423 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8a374-516f-471f-bd48-863fb9b3bbad service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:41.652752 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8a374-516f-471f-bd48-863fb9b3bbad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:41.654948 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-e1f8a374-516f-471f-bd48-863fb9b3bbad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:41.730409 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8a374-516f-471f-bd48-863fb9b3bbad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:41.756274 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8a374-516f-471f-bd48-863fb9b3bbad service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:41.767744 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1423/2806] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:02:41 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:02:41.798782 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347898dd-ebd2-49b6-bc75-7dacb80a5c9d service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:41.800550 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-347898dd-ebd2-49b6-bc75-7dacb80a5c9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:41.811849 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347898dd-ebd2-49b6-bc75-7dacb80a5c9d service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:41.815470 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88626673-e7a8-49ce-bcff-28b52bbcfff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:41.816608 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88626673-e7a8-49ce-bcff-28b52bbcfff5 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:41.816730 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88626673-e7a8-49ce-bcff-28b52bbcfff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:41.817097 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88626673-e7a8-49ce-bcff-28b52bbcfff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:41.818816 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-88626673-e7a8-49ce-bcff-28b52bbcfff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:41.832374 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88626673-e7a8-49ce-bcff-28b52bbcfff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:41.858633 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88626673-e7a8-49ce-bcff-28b52bbcfff5 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:41.869169 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1384/2807] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:02:41 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:02:43.151231 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57c829-5bad-44e5-9cee-28cc0207f781 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:43.151740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57c829-5bad-44e5-9cee-28cc0207f781 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:43.151864 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57c829-5bad-44e5-9cee-28cc0207f781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:43.175261 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-8f57c829-5bad-44e5-9cee-28cc0207f781 None None] MFA Rules not processed for user `8f0dd32880d14ec9990bc09685d26326`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:43.176410 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-8f57c829-5bad-44e5-9cee-28cc0207f781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:43.238114 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1424/2808] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Aug 23 02:02:43 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 02:02:43.360612 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88626673-e7a8-49ce-bcff-28b52bbcfff5 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:43.361931 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-88626673-e7a8-49ce-bcff-28b52bbcfff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:43.434559 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88626673-e7a8-49ce-bcff-28b52bbcfff5 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:43.439014 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36df1f-c729-4301-b8ea-ae54233327ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e4cab3c8cb4a18bf3c1a8a85d1675c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:43.439584 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36df1f-c729-4301-b8ea-ae54233327ef service swift] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:43.439872 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36df1f-c729-4301-b8ea-ae54233327ef service swift] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:43.440155 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36df1f-c729-4301-b8ea-ae54233327ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:43.448124 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36df1f-c729-4301-b8ea-ae54233327ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:43.473975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36df1f-c729-4301-b8ea-ae54233327ef service swift] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:43.481664 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1385/2809] 10.222.0.20 () {60 vars in 1385 bytes} [Mon Aug 23 02:02:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 02:02:44.625405 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b921d-05c9-4451-8fc1-2f12fabd2e15 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:44.625907 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b921d-05c9-4451-8fc1-2f12fabd2e15 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:44.626007 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b921d-05c9-4451-8fc1-2f12fabd2e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:44.647284 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-658b921d-05c9-4451-8fc1-2f12fabd2e15 None None] MFA Rules not processed for user `8f0dd32880d14ec9990bc09685d26326`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:44.648412 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-658b921d-05c9-4451-8fc1-2f12fabd2e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:44.655157 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1425/2810] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Aug 23 02:02:44 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:02:44.666561 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36df1f-c729-4301-b8ea-ae54233327ef service swift] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:44.677342 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36df1f-c729-4301-b8ea-ae54233327ef service swift] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:44.681978 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0d374-0f55-4adc-8f70-8f2b732393a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e4cab3c8cb4a18bf3c1a8a85d1675c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:44.682533 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0d374-0f55-4adc-8f70-8f2b732393a9 service swift] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:44.682816 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0d374-0f55-4adc-8f70-8f2b732393a9 service swift] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:44.683093 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0d374-0f55-4adc-8f70-8f2b732393a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:44.690840 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0d374-0f55-4adc-8f70-8f2b732393a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:44.718318 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0d374-0f55-4adc-8f70-8f2b732393a9 service swift] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:44.726239 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1386/2811] 10.222.0.20 () {60 vars in 1385 bytes} [Mon Aug 23 02:02:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 02:02:45.260119 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9a95c-a232-4c4f-b639-29e9057b9d77 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:45.260416 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9a95c-a232-4c4f-b639-29e9057b9d77 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:45.260841 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9a95c-a232-4c4f-b639-29e9057b9d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:45.284971 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-aeb9a95c-a232-4c4f-b639-29e9057b9d77 None None] MFA Rules not processed for user `8f0dd32880d14ec9990bc09685d26326`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:45.286099 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-aeb9a95c-a232-4c4f-b639-29e9057b9d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:45.292497 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1426/2812] 10.222.0.20 () {58 vars in 968 bytes} [Mon Aug 23 02:02:45 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:02:45.303897 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0d374-0f55-4adc-8f70-8f2b732393a9 service swift] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:45.314302 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0d374-0f55-4adc-8f70-8f2b732393a9 service swift] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:45.318835 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a2532-d1ca-4fdc-b0ea-1aad918e00a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82e4cab3c8cb4a18bf3c1a8a85d1675c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:45.319396 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a2532-d1ca-4fdc-b0ea-1aad918e00a8 service swift] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:45.319713 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a2532-d1ca-4fdc-b0ea-1aad918e00a8 service swift] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:45.319998 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a2532-d1ca-4fdc-b0ea-1aad918e00a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:45.328310 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a2532-d1ca-4fdc-b0ea-1aad918e00a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:45.353227 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a2532-d1ca-4fdc-b0ea-1aad918e00a8 service swift] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:45.360911 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1387/2813] 10.222.0.20 () {60 vars in 1385 bytes} [Mon Aug 23 02:02:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 02:02:48.601015 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9a95c-a232-4c4f-b639-29e9057b9d77 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:48.667840 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9a95c-a232-4c4f-b639-29e9057b9d77 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:48.672500 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc482cbd-a62e-4eb6-a639-149652e43c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:48.673351 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc482cbd-a62e-4eb6-a639-149652e43c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:48.673637 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc482cbd-a62e-4eb6-a639-149652e43c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:48.674175 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc482cbd-a62e-4eb6-a639-149652e43c8c admin admin] PATH_INFO: `/v3/users/d4c66426ba78437bb03ff9e16eaa23eb` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:48.675363 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc482cbd-a62e-4eb6-a639-149652e43c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4c66426ba78437bb03ff9e16eaa23eb)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:48.701420 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc482cbd-a62e-4eb6-a639-149652e43c8c admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:48.889035 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-dc482cbd-a62e-4eb6-a639-149652e43c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4c66426ba78437bb03ff9e16eaa23eb'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:48.889683 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-dc482cbd-a62e-4eb6-a639-149652e43c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4c66426ba78437bb03ff9e16eaa23eb'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:48.950746 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-dc482cbd-a62e-4eb6-a639-149652e43c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4c66426ba78437bb03ff9e16eaa23eb'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:48.958426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-dc482cbd-a62e-4eb6-a639-149652e43c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4c66426ba78437bb03ff9e16eaa23eb'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:48.959101 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-dc482cbd-a62e-4eb6-a639-149652e43c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4c66426ba78437bb03ff9e16eaa23eb'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:48.976480 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1427/2814] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:02:48 2021] DELETE /identity/v3/users/d4c66426ba78437bb03ff9e16eaa23eb => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 02:02:48.981017 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a5044-d296-49ad-b278-bfd21cd42b36 None None] REQUEST_METHOD: `POST` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:48.981497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a5044-d296-49ad-b278-bfd21cd42b36 None None] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:48.981605 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a5044-d296-49ad-b278-bfd21cd42b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:49.003754 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.auth.core [None req-a17a5044-d296-49ad-b278-bfd21cd42b36 None None] MFA Rules not processed for user `f126ecc3e0554a38839d919cf3fec6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=60175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:02:49.004926 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a17a5044-d296-49ad-b278-bfd21cd42b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:49.066705 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1388/2815] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:02:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:02:49.083567 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc482cbd-a62e-4eb6-a639-149652e43c8c admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:49.084875 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-dc482cbd-a62e-4eb6-a639-149652e43c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:49.148030 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc482cbd-a62e-4eb6-a639-149652e43c8c admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:49.151523 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6aba8-a293-4f51-96ab-d4682ac9ee2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:49.152097 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6aba8-a293-4f51-96ab-d4682ac9ee2a service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:49.152384 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6aba8-a293-4f51-96ab-d4682ac9ee2a service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:49.152838 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6aba8-a293-4f51-96ab-d4682ac9ee2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:49.161878 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6aba8-a293-4f51-96ab-d4682ac9ee2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:49.187288 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6aba8-a293-4f51-96ab-d4682ac9ee2a service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:49.196604 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1428/2816] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:02:49 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:02:49.552187 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a5044-d296-49ad-b278-bfd21cd42b36 None None] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:02:49.553150 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-a17a5044-d296-49ad-b278-bfd21cd42b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:02:49.567379 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a5044-d296-49ad-b278-bfd21cd42b36 None None] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:02:49.573729 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93577e-303a-40d0-acd6-59a46144be9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:02:49.574862 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93577e-303a-40d0-acd6-59a46144be9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:02:49.575440 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93577e-303a-40d0-acd6-59a46144be9d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:02:49.575891 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93577e-303a-40d0-acd6-59a46144be9d admin admin] PATH_INFO: `/v3/projects/03cc0e1cecad4a74a3bbaea883d6959c` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:02:49.577750 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93577e-303a-40d0-acd6-59a46144be9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=03cc0e1cecad4a74a3bbaea883d6959c)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:02:49.604762 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93577e-303a-40d0-acd6-59a46144be9d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:02:49.719826 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5e93577e-303a-40d0-acd6-59a46144be9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03cc0e1cecad4a74a3bbaea883d6959c', 'request_id': 'req-5e93577e-303a-40d0-acd6-59a46144be9d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:49.724961 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5e93577e-303a-40d0-acd6-59a46144be9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03cc0e1cecad4a74a3bbaea883d6959c', 'request_id': 'req-5e93577e-303a-40d0-acd6-59a46144be9d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:49.736677 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5e93577e-303a-40d0-acd6-59a46144be9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03cc0e1cecad4a74a3bbaea883d6959c', 'request_id': 'req-5e93577e-303a-40d0-acd6-59a46144be9d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:49.813405 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5e93577e-303a-40d0-acd6-59a46144be9d admin admin] The token cache is being invalidate because project 03cc0e1cecad4a74a3bbaea883d6959c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:02:49.813690 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5e93577e-303a-40d0-acd6-59a46144be9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:49.814273 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5e93577e-303a-40d0-acd6-59a46144be9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:02:49.815678 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1389/2817] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:02:49 2021] DELETE /identity/v3/projects/03cc0e1cecad4a74a3bbaea883d6959c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:03:54.585353 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6aba8-a293-4f51-96ab-d4682ac9ee2a service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:03:54.593822 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6aba8-a293-4f51-96ab-d4682ac9ee2a service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:03:54.648913 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1c1ff-1a0f-4dcc-98e3-204594ac1c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:03:54.649483 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1c1ff-1a0f-4dcc-98e3-204594ac1c1e service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:03:54.649770 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1c1ff-1a0f-4dcc-98e3-204594ac1c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:03:54.650062 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1c1ff-1a0f-4dcc-98e3-204594ac1c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:03:54.651802 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ceb1c1ff-1a0f-4dcc-98e3-204594ac1c1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:03:54.660743 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1c1ff-1a0f-4dcc-98e3-204594ac1c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:03:54.687037 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1c1ff-1a0f-4dcc-98e3-204594ac1c1e service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:03:54.695076 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1429/2818] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:03:54 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:04:23.840517 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93577e-303a-40d0-acd6-59a46144be9d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:04:23.841861 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5e93577e-303a-40d0-acd6-59a46144be9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:04:23.908304 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93577e-303a-40d0-acd6-59a46144be9d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:04:23.911655 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d13d9a-33f5-4595-a878-de6b71864bff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ec554d6a304e029ee4f244f4a18e24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:04:23.912267 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d13d9a-33f5-4595-a878-de6b71864bff service cinder] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:04:23.912555 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d13d9a-33f5-4595-a878-de6b71864bff service cinder] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:04:23.912867 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d13d9a-33f5-4595-a878-de6b71864bff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:04:23.914492 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-c0d13d9a-33f5-4595-a878-de6b71864bff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:04:23.977660 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d13d9a-33f5-4595-a878-de6b71864bff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:04:24.002930 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d13d9a-33f5-4595-a878-de6b71864bff service cinder] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:04:24.011463 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1390/2819] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:04:23 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:04:32.876037 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63fb78-8974-457c-9520-06ed4b539750 None None] REQUEST_METHOD: `POST` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:04:32.876556 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63fb78-8974-457c-9520-06ed4b539750 None None] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:04:32.876701 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63fb78-8974-457c-9520-06ed4b539750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:04:32.898714 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.auth.core [None req-ff63fb78-8974-457c-9520-06ed4b539750 None None] MFA Rules not processed for user `9a8e4253a98b44659801d40e83cf8f75`. Rule list: `[]` (Enabled: `True`). {{(pid=60176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 02:04:32.899859 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ff63fb78-8974-457c-9520-06ed4b539750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:04:32.905804 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1430/2820] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 23 02:04:32 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 02:04:33.345817 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d13d9a-33f5-4595-a878-de6b71864bff service cinder] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:04:33.347151 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-c0d13d9a-33f5-4595-a878-de6b71864bff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:04:33.358020 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d13d9a-33f5-4595-a878-de6b71864bff service cinder] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:04:33.361852 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3d3c9-9935-495c-9882-b348ca7a025a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:04:33.362412 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3d3c9-9935-495c-9882-b348ca7a025a service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:04:33.362700 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3d3c9-9935-495c-9882-b348ca7a025a service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:04:33.362981 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3d3c9-9935-495c-9882-b348ca7a025a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:04:33.364542 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-cbc3d3c9-9935-495c-9882-b348ca7a025a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:04:33.373314 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3d3c9-9935-495c-9882-b348ca7a025a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:04:33.398617 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3d3c9-9935-495c-9882-b348ca7a025a service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:04:33.406780 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1391/2821] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:04:33 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:04:34.244740 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63fb78-8974-457c-9520-06ed4b539750 None None] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:04:34.246265 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-ff63fb78-8974-457c-9520-06ed4b539750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:04:34.323652 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63fb78-8974-457c-9520-06ed4b539750 None None] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:04:34.328157 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c03920-1d62-4919-a0c8-72adfa52e58d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4a6c587fd604395908134c50ce7618d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:04:34.329321 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c03920-1d62-4919-a0c8-72adfa52e58d service placement] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:04:34.329609 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c03920-1d62-4919-a0c8-72adfa52e58d service placement] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:04:34.329889 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c03920-1d62-4919-a0c8-72adfa52e58d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:04:34.336674 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-11c03920-1d62-4919-a0c8-72adfa52e58d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:04:34.342522 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c03920-1d62-4919-a0c8-72adfa52e58d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:04:34.367644 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c03920-1d62-4919-a0c8-72adfa52e58d service placement] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:04:34.377920 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1431/2822] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:04:34 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:04:34.471527 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3d3c9-9935-495c-9882-b348ca7a025a service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:04:34.472858 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-cbc3d3c9-9935-495c-9882-b348ca7a025a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:04:34.486992 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3d3c9-9935-495c-9882-b348ca7a025a service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:04:34.491479 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb124f8-bd45-437b-8fcd-e6ae2cc0e539 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4a6c587fd604395908134c50ce7618d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:04:34.492042 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb124f8-bd45-437b-8fcd-e6ae2cc0e539 service placement] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:04:34.492329 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb124f8-bd45-437b-8fcd-e6ae2cc0e539 service placement] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:04:34.492649 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb124f8-bd45-437b-8fcd-e6ae2cc0e539 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:04:34.494233 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2bb124f8-bd45-437b-8fcd-e6ae2cc0e539 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:04:34.505090 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb124f8-bd45-437b-8fcd-e6ae2cc0e539 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:04:34.530603 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb124f8-bd45-437b-8fcd-e6ae2cc0e539 service placement] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:04:34.540005 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1392/2823] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:04:34 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:04:38.938271 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c03920-1d62-4919-a0c8-72adfa52e58d service placement] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:04:38.939721 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-11c03920-1d62-4919-a0c8-72adfa52e58d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:04:39.088329 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c03920-1d62-4919-a0c8-72adfa52e58d service placement] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:04:39.095095 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972ed5d-b3ec-45d9-8446-ce95cd9d0c85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:04:39.096050 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972ed5d-b3ec-45d9-8446-ce95cd9d0c85 service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:04:39.096814 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972ed5d-b3ec-45d9-8446-ce95cd9d0c85 service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:04:39.096814 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972ed5d-b3ec-45d9-8446-ce95cd9d0c85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:04:39.099138 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-7972ed5d-b3ec-45d9-8446-ce95cd9d0c85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:04:39.112438 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972ed5d-b3ec-45d9-8446-ce95cd9d0c85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:04:39.138102 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972ed5d-b3ec-45d9-8446-ce95cd9d0c85 service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:04:39.152761 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1432/2824] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:04:38 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:04:42.086332 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb124f8-bd45-437b-8fcd-e6ae2cc0e539 service placement] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:04:42.087650 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2bb124f8-bd45-437b-8fcd-e6ae2cc0e539 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:04:42.161309 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb124f8-bd45-437b-8fcd-e6ae2cc0e539 service placement] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:04:42.164947 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46908a-3c68-4a72-ab3e-7f4b948b07e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:04:42.165533 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46908a-3c68-4a72-ab3e-7f4b948b07e9 service neutron] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:04:42.165818 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46908a-3c68-4a72-ab3e-7f4b948b07e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:04:42.166094 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46908a-3c68-4a72-ab3e-7f4b948b07e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:04:42.168190 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-6c46908a-3c68-4a72-ab3e-7f4b948b07e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:04:42.180475 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46908a-3c68-4a72-ab3e-7f4b948b07e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:04:42.206729 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46908a-3c68-4a72-ab3e-7f4b948b07e9 service neutron] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:04:42.215664 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1393/2825] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:04:42 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:04:43.847574 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972ed5d-b3ec-45d9-8446-ce95cd9d0c85 service nova] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:04:43.858057 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972ed5d-b3ec-45d9-8446-ce95cd9d0c85 service nova] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:04:43.863032 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00746f-8ef2-4fcf-937b-1ccf27268d89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:04:43.863596 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00746f-8ef2-4fcf-937b-1ccf27268d89 service nova] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:04:43.863880 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00746f-8ef2-4fcf-937b-1ccf27268d89 service nova] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:04:43.864155 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00746f-8ef2-4fcf-937b-1ccf27268d89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:04:43.865831 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-4f00746f-8ef2-4fcf-937b-1ccf27268d89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:04:43.877269 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00746f-8ef2-4fcf-937b-1ccf27268d89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:04:43.902646 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00746f-8ef2-4fcf-937b-1ccf27268d89 service nova] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:04:43.912918 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1433/2826] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:04:43 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:04:55.551506 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46908a-3c68-4a72-ab3e-7f4b948b07e9 service neutron] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:04:55.552939 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-6c46908a-3c68-4a72-ab3e-7f4b948b07e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:04:55.568715 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46908a-3c68-4a72-ab3e-7f4b948b07e9 service neutron] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:04:55.573839 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa7127-34a1-453b-8e7a-64928714ea3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094c5e571da7480584098ba6ebcb70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:04:55.574410 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa7127-34a1-453b-8e7a-64928714ea3f service nova] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:04:55.574718 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa7127-34a1-453b-8e7a-64928714ea3f service nova] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:04:55.575000 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa7127-34a1-453b-8e7a-64928714ea3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:04:55.576646 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-fdaa7127-34a1-453b-8e7a-64928714ea3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:04:55.588884 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa7127-34a1-453b-8e7a-64928714ea3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:04:55.614420 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa7127-34a1-453b-8e7a-64928714ea3f service nova] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:04:55.625096 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1394/2827] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:04:55 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:05:52.855798 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00746f-8ef2-4fcf-937b-1ccf27268d89 service nova] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:05:52.877000 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00746f-8ef2-4fcf-937b-1ccf27268d89 service nova] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:05:52.881507 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3afde-54dd-428d-9603-6362d0adb974 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4a6c587fd604395908134c50ce7618d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:05:52.882110 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3afde-54dd-428d-9603-6362d0adb974 service placement] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:05:52.882401 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3afde-54dd-428d-9603-6362d0adb974 service placement] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:05:52.882682 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3afde-54dd-428d-9603-6362d0adb974 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:05:52.884364 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-0ea3afde-54dd-428d-9603-6362d0adb974 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:05:52.913034 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3afde-54dd-428d-9603-6362d0adb974 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:05:52.938329 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3afde-54dd-428d-9603-6362d0adb974 service placement] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:05:52.947519 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1434/2828] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:05:52 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:06:32.626932 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa7127-34a1-453b-8e7a-64928714ea3f service nova] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:06:32.628637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-fdaa7127-34a1-453b-8e7a-64928714ea3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:06:32.746015 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa7127-34a1-453b-8e7a-64928714ea3f service nova] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:06:32.755312 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8bb6b-c4a2-46a8-b525-28e6c7bac3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:06:32.756116 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8bb6b-c4a2-46a8-b525-28e6c7bac3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:06:32.756444 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8bb6b-c4a2-46a8-b525-28e6c7bac3af admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:06:32.756761 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8bb6b-c4a2-46a8-b525-28e6c7bac3af admin admin] PATH_INFO: `/v3/users/b585e7c0e87246669424cc9dad992e65` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:06:32.757866 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8bb6b-c4a2-46a8-b525-28e6c7bac3af admin admin] RBAC: Authorizing `identity:delete_user(user_id=b585e7c0e87246669424cc9dad992e65)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:06:32.784289 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8bb6b-c4a2-46a8-b525-28e6c7bac3af admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:06:33.006221 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5cc8bb6b-c4a2-46a8-b525-28e6c7bac3af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b585e7c0e87246669424cc9dad992e65'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:33.107287 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5cc8bb6b-c4a2-46a8-b525-28e6c7bac3af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b585e7c0e87246669424cc9dad992e65'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:33.107872 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5cc8bb6b-c4a2-46a8-b525-28e6c7bac3af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b585e7c0e87246669424cc9dad992e65'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:33.116663 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5cc8bb6b-c4a2-46a8-b525-28e6c7bac3af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b585e7c0e87246669424cc9dad992e65'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:33.117273 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-5cc8bb6b-c4a2-46a8-b525-28e6c7bac3af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b585e7c0e87246669424cc9dad992e65'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:33.134631 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1395/2829] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:06:32 2021] DELETE /identity/v3/users/b585e7c0e87246669424cc9dad992e65 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:06:33.144367 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3afde-54dd-428d-9603-6362d0adb974 service placement] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:06:33.153708 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3afde-54dd-428d-9603-6362d0adb974 service placement] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:06:33.208847 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b44d92-6f65-49c8-aa0a-7477ee6f803b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:06:33.210426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b44d92-6f65-49c8-aa0a-7477ee6f803b service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:06:33.210426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b44d92-6f65-49c8-aa0a-7477ee6f803b service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:06:33.210426 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b44d92-6f65-49c8-aa0a-7477ee6f803b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:06:33.211598 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-56b44d92-6f65-49c8-aa0a-7477ee6f803b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:06:33.276722 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b44d92-6f65-49c8-aa0a-7477ee6f803b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:06:33.302418 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b44d92-6f65-49c8-aa0a-7477ee6f803b service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:06:33.312490 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1435/2830] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:06:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:06:33.599020 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8bb6b-c4a2-46a8-b525-28e6c7bac3af admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:06:33.600411 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-5cc8bb6b-c4a2-46a8-b525-28e6c7bac3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:06:33.613717 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8bb6b-c4a2-46a8-b525-28e6c7bac3af admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:06:33.619139 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dfe9a-c455-44d2-b5cf-b8ffad45c20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:06:33.620040 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dfe9a-c455-44d2-b5cf-b8ffad45c20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:06:33.620391 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dfe9a-c455-44d2-b5cf-b8ffad45c20d admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:06:33.620765 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dfe9a-c455-44d2-b5cf-b8ffad45c20d admin admin] PATH_INFO: `/v3/projects/ba20ee0dab434973abcdb6e3cf80a34a` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:06:33.621955 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329dfe9a-c455-44d2-b5cf-b8ffad45c20d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba20ee0dab434973abcdb6e3cf80a34a)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:06:33.647686 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329dfe9a-c455-44d2-b5cf-b8ffad45c20d admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:06:33.781507 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-329dfe9a-c455-44d2-b5cf-b8ffad45c20d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba20ee0dab434973abcdb6e3cf80a34a', 'request_id': 'req-329dfe9a-c455-44d2-b5cf-b8ffad45c20d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:33.786748 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-329dfe9a-c455-44d2-b5cf-b8ffad45c20d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba20ee0dab434973abcdb6e3cf80a34a', 'request_id': 'req-329dfe9a-c455-44d2-b5cf-b8ffad45c20d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:33.798675 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-329dfe9a-c455-44d2-b5cf-b8ffad45c20d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba20ee0dab434973abcdb6e3cf80a34a', 'request_id': 'req-329dfe9a-c455-44d2-b5cf-b8ffad45c20d'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:33.882690 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-329dfe9a-c455-44d2-b5cf-b8ffad45c20d admin admin] The token cache is being invalidate because project ba20ee0dab434973abcdb6e3cf80a34a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:06:33.883127 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-329dfe9a-c455-44d2-b5cf-b8ffad45c20d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:33.883579 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-329dfe9a-c455-44d2-b5cf-b8ffad45c20d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:33.885218 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1396/2831] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:06:33 2021] DELETE /identity/v3/projects/ba20ee0dab434973abcdb6e3cf80a34a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:06:33.889764 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b44d92-6f65-49c8-aa0a-7477ee6f803b service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:06:33.899289 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b44d92-6f65-49c8-aa0a-7477ee6f803b service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:06:33.960218 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162449b-20d0-4309-abb0-6b40c807b7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:06:33.961044 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162449b-20d0-4309-abb0-6b40c807b7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:06:33.961430 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162449b-20d0-4309-abb0-6b40c807b7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:06:33.961731 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162449b-20d0-4309-abb0-6b40c807b7d9 admin admin] PATH_INFO: `/v3/users/d7d032177d69477da40ee36f03ae2857` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:06:33.962806 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162449b-20d0-4309-abb0-6b40c807b7d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d032177d69477da40ee36f03ae2857)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:06:33.988793 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162449b-20d0-4309-abb0-6b40c807b7d9 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:06:34.200054 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-9162449b-20d0-4309-abb0-6b40c807b7d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d032177d69477da40ee36f03ae2857'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:34.200773 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-9162449b-20d0-4309-abb0-6b40c807b7d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d032177d69477da40ee36f03ae2857'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:34.255343 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-9162449b-20d0-4309-abb0-6b40c807b7d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d032177d69477da40ee36f03ae2857'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:34.263649 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-9162449b-20d0-4309-abb0-6b40c807b7d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d032177d69477da40ee36f03ae2857'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:34.264982 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-9162449b-20d0-4309-abb0-6b40c807b7d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d032177d69477da40ee36f03ae2857'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:34.281781 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1436/2832] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:06:33 2021] DELETE /identity/v3/users/d7d032177d69477da40ee36f03ae2857 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:06:34.590440 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dfe9a-c455-44d2-b5cf-b8ffad45c20d admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:06:34.591935 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-329dfe9a-c455-44d2-b5cf-b8ffad45c20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:06:34.605497 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dfe9a-c455-44d2-b5cf-b8ffad45c20d admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:06:34.667668 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95586309-94dc-46e4-8b12-8095cf872c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:06:34.668395 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95586309-94dc-46e4-8b12-8095cf872c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:06:34.668785 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95586309-94dc-46e4-8b12-8095cf872c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:06:34.669335 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95586309-94dc-46e4-8b12-8095cf872c8f admin admin] PATH_INFO: `/v3/projects/43a820182dcb47b09cc7c3cb5985a1ca` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:06:34.670999 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95586309-94dc-46e4-8b12-8095cf872c8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=43a820182dcb47b09cc7c3cb5985a1ca)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:06:34.697605 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95586309-94dc-46e4-8b12-8095cf872c8f admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:06:34.781891 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-95586309-94dc-46e4-8b12-8095cf872c8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43a820182dcb47b09cc7c3cb5985a1ca', 'request_id': 'req-95586309-94dc-46e4-8b12-8095cf872c8f'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:34.786729 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-95586309-94dc-46e4-8b12-8095cf872c8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43a820182dcb47b09cc7c3cb5985a1ca', 'request_id': 'req-95586309-94dc-46e4-8b12-8095cf872c8f'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:34.798144 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-95586309-94dc-46e4-8b12-8095cf872c8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43a820182dcb47b09cc7c3cb5985a1ca', 'request_id': 'req-95586309-94dc-46e4-8b12-8095cf872c8f'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:34.858908 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-95586309-94dc-46e4-8b12-8095cf872c8f admin admin] The token cache is being invalidate because project 43a820182dcb47b09cc7c3cb5985a1ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:06:34.859190 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-95586309-94dc-46e4-8b12-8095cf872c8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:34.859766 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-95586309-94dc-46e4-8b12-8095cf872c8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:34.861176 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1397/2833] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:06:34 2021] DELETE /identity/v3/projects/43a820182dcb47b09cc7c3cb5985a1ca => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:06:45.361581 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162449b-20d0-4309-abb0-6b40c807b7d9 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:06:45.371857 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-9162449b-20d0-4309-abb0-6b40c807b7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:06:45.427637 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162449b-20d0-4309-abb0-6b40c807b7d9 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:06:45.480832 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8474105-c56f-4d7b-a0f8-43560782b4a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eedaf4b880f24ac48ee6e04b75059ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:06:45.481411 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8474105-c56f-4d7b-a0f8-43560782b4a1 service neutron] REQUEST_METHOD: `GET` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:06:45.481697 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8474105-c56f-4d7b-a0f8-43560782b4a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:06:45.481973 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8474105-c56f-4d7b-a0f8-43560782b4a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:06:45.483641 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-c8474105-c56f-4d7b-a0f8-43560782b4a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:06:45.549717 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8474105-c56f-4d7b-a0f8-43560782b4a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:06:45.574918 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8474105-c56f-4d7b-a0f8-43560782b4a1 service neutron] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:06:45.584513 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1437/2834] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:06:45 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 02:06:57.475042 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95586309-94dc-46e4-8b12-8095cf872c8f admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:06:57.476525 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-95586309-94dc-46e4-8b12-8095cf872c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:06:57.488003 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95586309-94dc-46e4-8b12-8095cf872c8f admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:06:57.492049 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fc088-d6e3-42b4-9832-104fa2bcd084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:06:57.492896 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fc088-d6e3-42b4-9832-104fa2bcd084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:06:57.493181 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fc088-d6e3-42b4-9832-104fa2bcd084 admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:06:57.493457 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fc088-d6e3-42b4-9832-104fa2bcd084 admin admin] PATH_INFO: `/v3/users/9a8e4253a98b44659801d40e83cf8f75` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:06:57.494507 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fc088-d6e3-42b4-9832-104fa2bcd084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8e4253a98b44659801d40e83cf8f75)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:06:57.521057 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fc088-d6e3-42b4-9832-104fa2bcd084 admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:06:57.709058 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-2d6fc088-d6e3-42b4-9832-104fa2bcd084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8e4253a98b44659801d40e83cf8f75'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:57.820072 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-2d6fc088-d6e3-42b4-9832-104fa2bcd084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8e4253a98b44659801d40e83cf8f75'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:57.820699 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-2d6fc088-d6e3-42b4-9832-104fa2bcd084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8e4253a98b44659801d40e83cf8f75'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:57.829437 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-2d6fc088-d6e3-42b4-9832-104fa2bcd084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8e4253a98b44659801d40e83cf8f75'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:57.830038 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-2d6fc088-d6e3-42b4-9832-104fa2bcd084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8e4253a98b44659801d40e83cf8f75'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:57.846653 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1398/2835] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:06:57 2021] DELETE /identity/v3/users/9a8e4253a98b44659801d40e83cf8f75 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:06:58.183461 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8474105-c56f-4d7b-a0f8-43560782b4a1 service neutron] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:06:58.193686 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8474105-c56f-4d7b-a0f8-43560782b4a1 service neutron] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:06:58.256855 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bc31f-8880-4e0d-bfc8-35bf9591c0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:06:58.257643 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bc31f-8880-4e0d-bfc8-35bf9591c0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:06:58.257929 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bc31f-8880-4e0d-bfc8-35bf9591c0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:06:58.258207 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bc31f-8880-4e0d-bfc8-35bf9591c0e9 admin admin] PATH_INFO: `/v3/projects/382ca8f9b14441659267fc49d336434f` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:06:58.259288 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bc31f-8880-4e0d-bfc8-35bf9591c0e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=382ca8f9b14441659267fc49d336434f)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:06:58.286022 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bc31f-8880-4e0d-bfc8-35bf9591c0e9 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:06:58.386462 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-515bc31f-8880-4e0d-bfc8-35bf9591c0e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '382ca8f9b14441659267fc49d336434f', 'request_id': 'req-515bc31f-8880-4e0d-bfc8-35bf9591c0e9'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:58.391552 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-515bc31f-8880-4e0d-bfc8-35bf9591c0e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '382ca8f9b14441659267fc49d336434f', 'request_id': 'req-515bc31f-8880-4e0d-bfc8-35bf9591c0e9'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:58.402706 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-515bc31f-8880-4e0d-bfc8-35bf9591c0e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '382ca8f9b14441659267fc49d336434f', 'request_id': 'req-515bc31f-8880-4e0d-bfc8-35bf9591c0e9'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:58.494762 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-515bc31f-8880-4e0d-bfc8-35bf9591c0e9 admin admin] The token cache is being invalidate because project 382ca8f9b14441659267fc49d336434f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:06:58.495057 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-515bc31f-8880-4e0d-bfc8-35bf9591c0e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:58.495640 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-515bc31f-8880-4e0d-bfc8-35bf9591c0e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:58.497101 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1438/2836] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:06:58 2021] DELETE /identity/v3/projects/382ca8f9b14441659267fc49d336434f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:06:58.501153 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fc088-d6e3-42b4-9832-104fa2bcd084 admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:06:58.502542 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-2d6fc088-d6e3-42b4-9832-104fa2bcd084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:06:58.515201 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fc088-d6e3-42b4-9832-104fa2bcd084 admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:06:58.577832 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd953b4-6555-4a0a-a2e3-98d0bd5c86df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:06:58.578637 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd953b4-6555-4a0a-a2e3-98d0bd5c86df admin admin] REQUEST_METHOD: `DELETE` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:06:58.578927 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd953b4-6555-4a0a-a2e3-98d0bd5c86df admin admin] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:06:58.579208 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd953b4-6555-4a0a-a2e3-98d0bd5c86df admin admin] PATH_INFO: `/v3/users/0b0ceb645da84a6faf4c758a0f1a4922` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:06:58.580286 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd953b4-6555-4a0a-a2e3-98d0bd5c86df admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b0ceb645da84a6faf4c758a0f1a4922)` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:06:58.606860 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd953b4-6555-4a0a-a2e3-98d0bd5c86df admin admin] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:06:58.794023 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-3dd953b4-6555-4a0a-a2e3-98d0bd5c86df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b0ceb645da84a6faf4c758a0f1a4922'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:58.843622 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-3dd953b4-6555-4a0a-a2e3-98d0bd5c86df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b0ceb645da84a6faf4c758a0f1a4922'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:58.844198 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-3dd953b4-6555-4a0a-a2e3-98d0bd5c86df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b0ceb645da84a6faf4c758a0f1a4922'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:58.851975 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-3dd953b4-6555-4a0a-a2e3-98d0bd5c86df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b0ceb645da84a6faf4c758a0f1a4922'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:58.852547 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.notifications [None req-3dd953b4-6555-4a0a-a2e3-98d0bd5c86df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b0ceb645da84a6faf4c758a0f1a4922'} {{(pid=60175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:58.869028 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1399/2837] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 23 02:06:58 2021] DELETE /identity/v3/users/0b0ceb645da84a6faf4c758a0f1a4922 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:06:59.128042 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bc31f-8880-4e0d-bfc8-35bf9591c0e9 admin admin] Authenticating user token {{(pid=60176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:06:59.129443 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.fernet_utils [None req-515bc31f-8880-4e0d-bfc8-35bf9591c0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:06:59.141842 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bc31f-8880-4e0d-bfc8-35bf9591c0e9 admin admin] Validating token access rules against request {{(pid=60176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:06:59.202246 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edd152-ab75-4591-8546-74f5f187d7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f126ecc3e0554a38839d919cf3fec6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f6bd6480e9c4a609f8c029a43846e42', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:06:59.203020 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edd152-ab75-4591-8546-74f5f187d7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:06:59.203305 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edd152-ab75-4591-8546-74f5f187d7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:06:59.203583 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edd152-ab75-4591-8546-74f5f187d7f8 admin admin] PATH_INFO: `/v3/projects/56e253c94fb54dc3867572ce45ab0914` {{(pid=60176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:06:59.204669 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edd152-ab75-4591-8546-74f5f187d7f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e253c94fb54dc3867572ce45ab0914)` {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:06:59.229923 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edd152-ab75-4591-8546-74f5f187d7f8 admin admin] RBAC: Authorization granted {{(pid=60176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:06:59.317694 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-99edd152-ab75-4591-8546-74f5f187d7f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e253c94fb54dc3867572ce45ab0914', 'request_id': 'req-99edd152-ab75-4591-8546-74f5f187d7f8'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:59.322497 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-99edd152-ab75-4591-8546-74f5f187d7f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e253c94fb54dc3867572ce45ab0914', 'request_id': 'req-99edd152-ab75-4591-8546-74f5f187d7f8'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:59.336034 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-99edd152-ab75-4591-8546-74f5f187d7f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e253c94fb54dc3867572ce45ab0914', 'request_id': 'req-99edd152-ab75-4591-8546-74f5f187d7f8'} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:59.397283 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-99edd152-ab75-4591-8546-74f5f187d7f8 admin admin] The token cache is being invalidate because project 56e253c94fb54dc3867572ce45ab0914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=60176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 02:06:59.397563 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-99edd152-ab75-4591-8546-74f5f187d7f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:59.398222 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: DEBUG keystone.notifications [None req-99edd152-ab75-4591-8546-74f5f187d7f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=60176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 02:06:59.399714 dv-cinder-805529-1-iscsi devstack@keystone.service[60176]: [pid: 60176|app: 0|req: 1439/2838] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 23 02:06:59 2021] DELETE /identity/v3/projects/56e253c94fb54dc3867572ce45ab0914 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 02:10:56.800846 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd953b4-6555-4a0a-a2e3-98d0bd5c86df admin admin] Authenticating user token {{(pid=60175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 02:10:56.802270 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-3dd953b4-6555-4a0a-a2e3-98d0bd5c86df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:10:56.875803 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd953b4-6555-4a0a-a2e3-98d0bd5c86df admin admin] Validating token access rules against request {{(pid=60175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 02:10:56.938134 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739fb95-b44b-49a8-a253-3aa6b92c4500 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4a6c587fd604395908134c50ce7618d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2728fddda1c4691b33daad4fa4ef3d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=60175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 02:10:56.938704 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739fb95-b44b-49a8-a253-3aa6b92c4500 service placement] REQUEST_METHOD: `GET` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 02:10:56.938991 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739fb95-b44b-49a8-a253-3aa6b92c4500 service placement] SCRIPT_NAME: `/identity` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 02:10:56.939270 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739fb95-b44b-49a8-a253-3aa6b92c4500 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=60175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 02:10:56.940945 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.fernet_utils [None req-9739fb95-b44b-49a8-a253-3aa6b92c4500 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=60175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 02:10:56.951598 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739fb95-b44b-49a8-a253-3aa6b92c4500 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Aug 23 02:10:56.976946 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739fb95-b44b-49a8-a253-3aa6b92c4500 service placement] RBAC: Authorization granted {{(pid=60175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 02:10:56.986116 dv-cinder-805529-1-iscsi devstack@keystone.service[60175]: [pid: 60175|app: 0|req: 1400/2839] 10.222.0.20 () {60 vars in 1366 bytes} [Mon Aug 23 02:10:56 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)